Written as if Bidwell had commissioned it. This is the artefact I would put in front of a client before spending any of their money, and the part that matters is the method justification: why an interview and not a survey, and what I would refuse to report.
- Primary question
- When an ecommerce brand has already let one paid-media agency go, what evidence does the next one have to put in front of them before a call is worth taking?
- Secondary questions
- Which claim on an agency page is read as a lie first? What does “measurement” mean to a finance director as opposed to a growth lead? At what point does a flat retainer stop feeling like a saving and start feeling like a risk?
- Method, and why this one
- Semi-structured interviews, 45 minutes, remote. The question is about belief and prior experience, not about task success, so an interview beats a usability test: I need the story of the last agency, and that only comes out in conversation. I would pair it with a 20-minute unmoderated first-click test on the pricing and case-study sections, because “can they find the number” is a task question and interviews are bad at it.
- What I would not run
- A survey. With a population this small and this variable, a survey would give me percentages of a sample I could not defend, which is exactly the failure mode this brand is positioned against.
- Recruit
- Twelve participants: eight buyers, four sellers. Buyers screened on UK ecommerce, £1m–£25m turnover, £15k+ a month in paid media, and having ended an agency relationship in the last 24 months. Split four growth/ecommerce leads and four finance-side signatories, because the synthesis suggests they read the same page for different things. Four agency-side participants for the counter-view, recruited outside my own network.
- Screener knock-outs
- Anyone currently in a pitch process with an agency I have worked with. Anyone whose media is bought by a parent company. Anyone who has never seen an invoice for it.
- Sample size reasoning
- Eight buyers is where I would expect theme saturation for a question this focused; the four-and-four split means each sub-segment gets four, which is enough to notice a pattern and not enough to claim a rate. I would not report any finding as a percentage at n=12.
- Timeline
- Week 1 screener and recruit. Weeks 2–3 interviews, six a week, transcribed same day. Week 4 synthesis and first-click test. Week 5 readout, with the raw notes handed over rather than summarised away.
- Ethics and consent
- Recorded with consent, transcripts pseudonymised, commercial figures aggregated before anything is shown to anyone. Participants get the readout. No client names in the output without written sign-off.