Loading...
A Tale of Two Dashboards
In this episode of *Lunch Hour Legal Marketing*, Conrad Saam reflects on a client relationship that ended abruptly and unpacks the deeper lesson behind the breakup: law firms and marketing agencies are often measuring success on entirely different scorecards.
The agency believed the campaign was performing well based on cost per lead and call volume. The client, meanwhile, cared only about signed cases and saw no results. Between those two views sat a fractional CMO, incomplete feedback loops, and a lack of shared definitions around what qualified as success.
The conversation surfaces a core truth for legal marketing: if the firm and the agency are not working from the same data, the same definitions, and the same dashboard, even a campaign that looks strong on paper can collapse in practice. The real opportunity lies in aligning around “wanted leads,” improving attribution, and assigning someone inside the firm to obsess over what falls out of the intake funnel.
Welcome to *Lunch Hour Legal Marketing*. Conrad Saam from Mockingbird opens the show with a personal note: they lost a client that week.
He admits the departure may not have been entirely bad. But it did expose a meaningful problem—one that goes beyond a single account. In his view, the real issue was systemic: law firms and agencies are often judging marketing success by entirely different standards.
The episode becomes a post-mortem on that failed relationship, and a broader discussion about how agency-client partnerships go wrong when the two sides are not aligned on what actually matters.
This account involved three parties:
Conrad explains that when agencies are brought in through a fractional CMO, they are expected to work primarily through that person. That is good relationship management. Going around the CMO to speak directly with the client can create tension and undercut trust.
But there is a downside.
When the agency’s main stakeholder is the fractional CMO rather than the firm itself, the agency may lose direct visibility into what the actual client values most. That creates risk—especially if the relationship between the CMO and the client weakens or if key expectations are never clearly communicated.
As Conrad puts it, three-person relationships are inherently more fragile.
The problem surfaced in a short Monday email from the fractional CMO. The message was simple: the client was concerned about paid performance and was “at the point of considering options.”
That came as a surprise.
When Conrad checked with his paid search lead, the reaction was immediate: this was one of their best-performing accounts. From the agency’s perspective, the numbers looked strong.
That disconnect—alarm on one side, confidence on the other—became the entire story.
At that point, Guy asks the question that matters most:
How is the client measuring success?
Is it:
The answer: the client cared about new clients, not cost per lead.
That immediately exposed the gap. The agency had been optimizing and reporting on cost per lead. The client was evaluating outcomes based on signed cases.
Those are not the same thing.
And crucially, there was no shared process in place to connect one to the other.
Conrad shares the campaign metrics for the month:
From an agency perspective, those are strong numbers—especially in personal injury, where non-branded search can be expensive and competitive.
If the leads were qualified, the campaign looked excellent.
That is exactly why the agency was caught off guard by the client’s dissatisfaction.
The agency quickly responded to the concern, reviewed the data, and discussed it with the fractional CMO. A meeting had already been scheduled for Wednesday to go over performance in more detail.
But before that meeting could happen, the client sent a termination notice that same Monday afternoon.
Conrad responded directly, attempting to preserve the relationship and offering to review the early campaign results. He emphasized that the agency wanted the client to have all the data before making a final decision.
The client’s reply was sharp and final:
“I don’t wish to discuss further. Cost per lead is pointless. We have not signed a single case that can be attributed to your services since you took over.”
The client continued:
“To be clear, this is not an attribution problem. I know where every case I have signed since 2/1 came from, and none of them were from digital marketing efforts.”
And then the final blow:
“Moreover, nothing we bring to your attention gets addressed in a timely manner, if at all. This has been an all-around disastrous experience.”
Conrad is candid: the agency made a real mistake.
The biggest one was failing to align the reporting model with the client’s definition of success.
The agency had a dashboard showing healthy cost per lead. The client had a dashboard showing no signed cases from digital. Both sides believed they were looking at the truth.
That was the problem.
“The man who has two watches never knows what time it is.”
That, Conrad says, is exactly what happened here.
The agency was reading one watch. The client was reading another. There was no shared source of truth, no agreed-upon definition of a “wanted lead,” and no consistent signal being passed back from the firm to the agency.
In legal marketing—especially in PI—lead generation alone is not enough. If the law firm wants signed cases, then the agency needs visibility into what happened after the lead came in.
Without that, cost per lead is only a proxy.
Guy argues that this is the root issue in many law firm marketing relationships.
A campaign should not be optimized merely to leads in the abstract. It should be optimized to wanted leads—the kinds of inquiries the firm actually wants to turn into cases.
That requires the law firm to define what a wanted lead is.
It also requires the firm to feed that information back into the system so the agency can improve targeting, budget allocation, and performance over time.
If that feedback loop never happens, then the agency keeps optimizing toward proxies while the client judges performance by outcomes the agency cannot clearly see.
That is not just a reporting problem. It is a strategic failure.
Conrad also believes the client made a mistake.
The campaign had only been running for six weeks. A meeting was already scheduled for two days later to review the data in full. Instead of taking that meeting and digging into the discrepancy, the client terminated immediately and refused further discussion.
From Conrad’s perspective, that was a hasty move.
Marketing campaigns take time. Attribution takes investigation. If one side sees strong lead quality and the other sees zero signed cases, that should trigger analysis—not immediate disengagement.
The client may have been frustrated, but by ending the relationship abruptly, they shut down the very conversation that might have explained what was actually happening.
After the termination, the agency went back and listened to all 64 calls.
It was not pleasant.
Conrad notes that listening to intake calls for PI firms is emotionally draining and gives him renewed respect for how difficult intake work really is.
But the review revealed something important: of those 64 calls, the agency believed 27 were good, qualified leads.
That made the client’s claim even harder to reconcile. The chance that none of 27 qualified leads would produce a signed case seemed extremely low.
So if intake was not broken—and Conrad says it wasn’t—then something else had to be wrong. Either attribution was incomplete, or the law firm and agency were categorizing outcomes very differently.
The client insisted it was not.
But Guy pushes back. If the lead data looked that strong on the front end, and the case data showed zero on the back end, then something in the attribution chain was likely broken—or at least misunderstood.
It could have been:
Conrad makes another point here: not every digital win shows up neatly as a direct PPC case. Someone may first encounter a firm through paid search, then return later through branded search, Google Business Profile, or another channel. If the attribution model is too narrow, marketing can look like it failed even when it contributed meaningfully.
At one point, someone asks the obvious question:
Shouldn’t the fractional CMO have been bridging this gap?
Conrad’s answer is yes.
A strong CMO should be reading both watches. They should understand the agency’s metrics and the client’s business outcomes. They should be translating between the two, spotting disconnects early, and making sure no one is blindsided.
That does not mean the CMO is solely responsible. Conrad is careful not to throw them under the bus. But he does believe this kind of surprise should not happen if someone is actively managing the relationship and reviewing both lead quality and business results on a regular basis.
Conrad believes this issue is going to drive a major shift in agency-client relationships over the next year.
The old model—where agencies report on their own preferred metrics while clients measure success in their own internal systems—is becoming unsustainable.
Both sides need to work from the same dashboard, or at least from tightly connected systems.
And more importantly, the agency should be working off the client’s watch, not its own.
Agencies are good at producing upward-trending graphs. But if those graphs are detached from actual retained cases, they are not enough.
The conversation also touches on AI tools in the intake and attribution stack.
Conrad mentions CallRail’s lead scoring system, which can help score calls—but only if it is trained properly. Like any AI system, it is only as useful as the definitions and feedback it receives.
If the law firm never feeds back which leads turned into wanted cases, then the scoring model never becomes truly valuable.
That is the recurring lesson: technology can support alignment, but it cannot substitute for it.
Guy frames a difficult agency decision.
What do you do when a law firm refuses to share the data needed to optimize for true business outcomes?
There are two options:
1. Fall back on proxy metrics like cost per lead, first-time calls, or traffic
2. Refuse the engagement because you know the relationship will eventually break down
Conrad admits that his agency often takes those clients anyway.
Why?
Because that is what the market wants, and because experienced legal marketers can still do a good job based on best practices. A specialist agency is not starting from zero; it already has strong assumptions about what tends to work in PI campaigns.
Still, that model has limits.
If the firm has unusual case criteria, hidden preferences, or unshared business constraints, then even good lead generation can miss the mark.
Interestingly, Guy says the more common challenge is not clients who refuse to collaborate outright. It is clients who agree philosophically—but lack the internal systems to follow through.
They say they want accountability. They say they want shared KPIs. They say they want optimization toward qualified leads.
But then:
In those situations, the firm and agency may want the same thing, but the infrastructure is not there to support it.
That creates waste, confusion, and false conclusions.
Conrad points out that some intake problems are easier to solve than others.
Missed call rate is one of them.
If you show a law firm owner that they just spent $143 on a click and nobody answered the phone, the urgency becomes real very quickly.
Conrad says benchmarking can be powerful here. When firms see how they compare to others—especially if they are in the bottom 20% for missed call rate—they tend to fix the issue fast.
In his experience, simply knowing the number is enough to create action.
“If you know what your phone call answer rate is, it’ll piss you off and you will be above average. If you don’t know what it is, you’ll think you’re doing a great job.”
Toward the end of the discussion, Conrad identifies the most important role in a high-performing law firm marketing operation.
It is not necessarily the agency.
It is not necessarily the intake team.
It is the person inside the firm who is obsessed with the gap between what came in and what got signed.
That person studies:
That, Conrad says, is the magic of a great CMO or COO.
“Somebody is focused on that, your firm is winning.”
When someone owns that leakage analysis, the firm can identify where performance is truly breaking down—whether the issue is marketing, intake, attribution, or operations.
The deepest lesson from this episode is not about one failed account. It is about how easily agency-client relationships break when performance is defined differently on each side.
The agency saw strong cost per lead and healthy call volume.
The client saw zero signed cases.
The fractional CMO was positioned between them, but the feedback loop never fully closed.
No one was reading from the same watch.
For law firms, the message is clear: define success in business terms, share that definition early, and build the systems needed to feed results back into the marketing process.
For agencies, the message is equally clear: cost per lead is not enough if the client is buying signed cases. Work from the client’s scorecard whenever possible, and insist on shared visibility into what happens after the lead arrives.
Because when one dashboard shows gold and the other shows garbage, the relationship is already in danger—even if the campaign itself may be working.