TL;DR
- 67% of lost B2B sales result from inadequate qualification — yet most pipeline agency evaluations skip straight to pricing and case studies without probing how the agency qualifies anything.
- Only 44% of companies use any lead scoring at all. Of those that do, most collapse fit and timing into a single pass/fail score, creating pipelines that look full but convert empty.
- Early disqualification saves up to 32% of sales time. An agency without a defined disqualification process is selling lead volume, not pipeline quality.
- These 12 questions cover the structural gaps that decide whether you get qualified meetings or a CRM full of names your reps will learn to ignore.
Why Most Agency Evaluations Miss the Real Questions
The pipeline agency evaluation playbook is broken. Most teams run the same three-step process: ask for pricing, review a case study deck, call a reference. Then they sign — and discover six weeks later that "qualified" means "someone who opened an email."
Here is the structural problem: 67% of lost B2B sales result from inadequate qualification, yet only 44% of companies use any lead scoring at all. The agencies selling pipeline services know these numbers. What changes is whether they've built their methodology around them — or around the easier metric of meetings booked.
The difference between a pipeline partner and a lead vendor is invisible in a pricing call. It lives in twelve specific questions — questions about how they score, what they disqualify, who owns the data, and what happens when the pipeline doesn't convert.
The 12 Questions
A named, documented framework — whether BANT, MEDDIC, CHAMP, or a proprietary system — with a clear explanation of how each criterion is verified, not assumed. They should describe the data sources that feed each qualification gate and how the framework adapts to your ICP rather than being applied uniformly. A consistently-used BANT beats an unused MEDDPICC every time.
"We qualify every lead before passing it to you." No methodology named, no criteria described, no verification process. This is a trust-me answer, and trust is not a qualification framework.
Fit and timing are scored on independent axes, not collapsed into a single pass/fail score. A high-fit, wrong-timing lead goes into a nurture cadence with re-engagement triggers. A right-timing, poor-fit lead is flagged for review. This two-axis system prevents the most common pipeline failure mode: a calendar full of meetings with people who will never buy.
A single score that combines everything. When fit and timing share a number, you cannot distinguish between "right person, wrong quarter" and "wrong person who happens to be shopping." Both produce the same pipeline metric. Only one produces revenue.
Specific, documented disqualification criteria with defined thresholds: budget below X, authority unconfirmed after Y attempts, timeline beyond Z months, product fit gap identified. They track disqualification rate as a health metric and can tell you what percentage of leads they kill before passing anything to your team. Early disqualification saves up to 32% of sales time.
"We send everything over and let your team decide." Translation: they have no qualification filter. Every name that responds gets passed. Your reps become the qualification layer — the most expensive one in the stack.
You own all account and contact data generated during the engagement, with a contractual guarantee. Data is delivered in a portable format (CSV or CRM-native export) within a defined window after termination. No data lock-in, no proprietary formats, no "our platform stores the records" without export capability.
Data lives in their platform only, with no export clause in the contract, or ownership language that is ambiguous about who retains records post-engagement. If you cannot walk away with your pipeline, you did not build a pipeline — you rented a list.
Weekly reports with defined metrics: accounts engaged, meetings booked, show rate, qualification pass rate, meetings advanced to opportunity, pipeline value created. They distinguish between activity metrics (emails sent, calls made) and outcome metrics (opportunities created, pipeline velocity). Reports arrive on a consistent schedule with trend analysis, not just raw numbers.
Monthly reports that emphasize activity volume — emails sent, dials made, LinkedIn touches — with no conversion metrics. Activity volume is a cost driver dressed as a KPI. If they cannot report show rate and opportunity conversion rate, they are not measuring what matters.
A defined integration plan with your specific CRM (not "we work with all CRMs"), including field mapping, activity logging, stage synchronization, and a documented handoff protocol. They can describe exactly what your reps see when a qualified meeting lands in their queue. Only 35% of sales professionals trust their own CRM data — and a sloppy integration makes this worse, not better.
"We'll figure out the integration as we go" or a promise of "seamless integration" without specifics. If the handoff process is not defined before the engagement starts, your CRM will become a graveyard of incomplete records your reps cannot action.
A defined notice period (typically 30 days or less), no termination penalty beyond notice, and a clear process for data handoff and work-in-progress transition. The contract includes specific performance benchmarks that trigger review conversations before either side reaches the exit clause. A confident agency has nothing to hide in the exit terms.
Annual lock-in with no termination for cause, or termination clauses that impose penalties, data retention fees, or "completion payments" on remaining contract value. An agency that needs a contract to retain clients is compensating for predictable churn.
A transparent fee structure provided in the first conversation, whether flat monthly retainer, per-qualified-meeting, or hybrid. All variable components are disclosed upfront — tech stack costs, data enrichment fees, onboarding charges. Pricing aligned with qualified meetings (rather than leads delivered) creates incentive alignment around quality over volume.
"It depends on scope" with no range provided, or pricing that is only revealed after a proposal is built. Per-lead pricing models are a structural red flag — they reward the agency for delivering volume, not conversion. The incentive runs directly against your outcome.
Named individuals with specific roles: SDRs, account managers, strategists. They can describe each person's pipeline experience, industry familiarity, and the tools they use daily. The team composition matches the scope — a mid-market outbound program should not be staffed exclusively by junior SDRs with no domain context.
"We have a dedicated team" with no names, no backgrounds, and no commitment to who will actually execute. The principal who sells the engagement and the team who runs it are rarely the same people. If you cannot meet the execution team before signing, assume a gap between the pitch and the delivery.
A guarantee tied to a specific, measurable output — minimum number of qualified meetings per month, minimum show rate, or a replacement policy for no-show meetings. The guarantee has defined terms: what qualifies as a meeting, how "qualified" is verified, and what triggers a replacement or credit. Guarantees tied to pipeline volume show confidence in their qualification system.
"We guarantee results" with no definition of results, or guarantees tied exclusively to activity metrics like "X emails sent per month." A guarantee on output you cannot measure is not a guarantee — it is marketing copy. No legitimate agency guarantees revenue outcomes, because they do not control your close process.
A clear distinction between operational metrics (dials, emails, connection rate) and outcome metrics (show rate, qualification rate, opportunity conversion, pipeline velocity, average deal size). They track negative signals as actively as positive ones — disqualification rate, no-show trends, contact decay — and use those signals to adjust outreach strategy. Negative scoring has been shown to cut lead volume 40% while lifting win rates 22%.
A dashboard that only tracks activity — emails sent, calls made, LinkedIn connection requests. If they cannot report show rate or opportunity conversion by cohort, they are not running a pipeline agency. They are running an outreach factory with pipeline-branded packaging.
A defined nurture path for high-fit, wrong-timing leads with specific re-engagement cadences and trigger events (funding announcements, leadership changes, contract renewal windows). Wrong-fit leads — even with urgent timing — are flagged and either disqualified or routed to a different motion. The system treats timing as a variable to manage, not a reason to discard a qualified account.
"We focus on ready-to-buy leads only" with no explanation of what happens to the rest. This means they are discarding pipeline that could convert in 90 days — and you are paying to generate awareness with accounts that need relationship building, not a cold meeting.
Key Takeaways
- Qualification is the contract. An agency's qualification methodology is more predictive of results than their pricing, their case studies, or their reference calls. Ask about it first.
- Fit and timing must be scored separately. A single score collapses two independent variables into one meaningless number. Demand independent axes with defined actions for each quadrant.
- Disqualification is a feature, not a failure. An agency that cannot tell you what percentage of leads they disqualify — and why — is not qualifying. They are passing everything downstream and calling it pipeline.
- Data ownership is non-negotiable. If the contract does not explicitly grant you ownership of all account and contact data, with export rights, you are renting a list — not building pipeline.
- Activity metrics are not outcome metrics. Emails sent and calls made measure cost. Show rate, qualification rate, and opportunity conversion measure value. Make sure their dashboard distinguishes between them.
- Per-lead pricing is a structural red flag. It rewards volume over quality. Per-qualified-meeting pricing aligns incentives with your outcome. Pricing transparency in the first conversation signals operational maturity.
- Ask all twelve questions before you ask about price. By the time you reach pricing, you should already know whether the agency has a qualification system you would trust with your pipeline — or one designed to maximize their margins at the expense of your reps' time.
Start With Your Own Pipeline Clarity First
These questions work best when you arrive at the evaluation with your own pipeline baseline in hand — current qualification criteria, conversion rates by stage, and the specific metrics you will use to judge whether an agency is working.
If your internal qualification language is still "marketing sends leads and sales qualifies them," the agency will define the terms on their terms — and you will discover the gap three months into the engagement.
Download the Pipeline Velocity Worksheet
Map your current pipeline metrics, qualification criteria, and conversion rates before you brief an agency — so you arrive at the evaluation with your own numbers, not their framing.
About the Author
Jake McMahon is a PLG and GTM growth consultant with 8+ years in B2B SaaS product leadership. He's worked with Series A to Series C companies on pipeline architecture, outbound qualification systems, and growth operating models. His academic background is in Behavioural Psychology and Big Data.
Pipeline qualification
Qualify Deals That Close, Not Just Fill Your Pipeline
The Pipeline Velocity Worksheet gives you a calibrated 5-step qualification system — ICP fit scoring, intent signal detection, timing calibration, stakeholder mapping, and next-step commitment testing — so you can evaluate any pipeline partner against your own framework, not theirs.
Download the Worksheet →