Almost every client I've signed came from this exact moment: the retainer runs, the reports arrive, and somewhere between them the results went missing. The instinct is to switch agencies. It's usually wrong, because the next agency has the same shape as the last one. Here's what the moment actually sounds like, and how to diagnose it before spending anything.
Real sentences from real first calls. If one of these is yours, keep reading:
Said by a fractional CMO about an agency that had been on retainer for over a year. Technical fixes shipped, a few template blogs per month. Nothing anyone could call a strategy, and everyone quietly knew it.
A marketing director in a niche B2B market. The vendor delivered exactly what was contracted: lists. Deciding what strategically mattered was left to a team with no time to decide it.
A director of marketing whose agency retainer ran for years while 75 to 80% of leads came from AdWords. The agency wasn't failing loudly. It was failing quietly, on schedule, invoice after invoice.
A Head of Marketing comparing her previous SEO vendors to work that started from revenue. The difference she meant: analysis she could forward to leadership without rewriting a word of it.
Run this before any contract decision. It costs nothing and it usually changes the decision.
Run the pipeline question
Ask: "which three things we shipped last quarter produced pipeline, and how do you know?" You're not testing whether they can answer instantly. You're testing whether the question has ever occurred to them.
Separate the contract from the gap
Most disappointing agencies deliver exactly what was contracted. The gap is usually a strategy layer nobody was ever hired to own. Naming that precisely changes your options: you may need to add ownership, not switch vendors.
Decide: fix, add, or replace
Fix: keep the agency, give them sharper direction. Add: keep execution where it is, put senior strategy above it. Replace: when trust is gone or the work itself is weak. Each is right sometimes. Switching agencies to solve a strategy gap is the one move that never works.
Whatever you do, take the documentation
Before any transition: get admin access to every tool, export the keyword and content plans, and document what was done and why. The expensive part of vendor churn is the context that leaves with them.
Both columns can come from the same budget line. Only one of them shows up in your CRM.
None of those companies had a lazy agency. They had a missing layer. Someone was executing SEO, nobody was owning it: no forecast of what the work should produce, no monthly comparison against that forecast, no one whose personal reputation depended on organic showing up in the CRM.
That layer is what I sell, so weigh this page accordingly. But the diagnosis stands whoever you hire: if you switch vendors without adding ownership, you'll be re-reading this page in a year. The options for adding it are laid out honestly in the agency vs consultant comparison, the hiring guide covers how to test candidates, and in-house vs consultant covers the build-your-own path.
Honest read on what your agency actually built
Fix, add, or replace: a recommendation, not a pitch
Sometimes the answer is "keep them", and I'll say so
Bring the last three months of agency reports. You'll leave knowing whether you have a vendor problem or a strategy gap.