Back to benchmarks

Company Discovery with MCP: List generation with precision, recall and hallucination

October 2026 | 3 models | 108 agent runs

This is an open benchmark of finding companies with filters, the work behind lead generation, prospecting, deal sourcing and market mapping. Most searches that matter are for private companies: bootstrapped operators, PE-backed platforms, venture-backed startups. We gave three frontier models the same 18 find-companies queries twice, once with web search only and once with the akta.pro MCP, and then checked every company they returned against the query.

18 queries (mostly private companies) · October 2026 · 3 models, 2 modes · 6,263 companies judged · 360 top-20 companies

18

Queries

100 companies asked for each

108

Agent runs

3 models × 2 modes × 18 queries

6,263

Companies judged

Each marked correct or not

360

Top-20 companies

A curated top 20 per query

Setups covered

Claude Sonnet 5 with akta.pro MCPGPT-5.6 Luna with akta.pro MCPGPT-5.6 Terra with akta.pro MCPClaude Sonnet 5 · web searchGPT-5.6 Luna · web searchGPT-5.6 Terra · web search

List quality is reported as precision and Recall (Top 20).

Precision asks whether each returned company actually meets the query. Recall (Top 20) asks whether the list contains the companies that matter: each market’s curated top 20. A list can fail either way, padded with misfits or missing the leaders, so we report both, plus the number of correct companies a team actually receives.

Every returned company was also checked for a real web presence. Companies with no working website that an independent agent could not confirm exist were treated as made up (hallucinated) and removed before scoring; wrong websites were counted separately. Both are reported in ‘Why companies fail’.

TL;DR

Augmented with the akta.pro MCP, every model returned more accurate lists, more correct companies and more of each market’s leaders.

Pick a view to see how the setups stack up.

Share of returned companies that met every criterion · pooled over 18 queries

Claude Sonnet 5+9.4 pts
GPT-5.6 Luna+20.7 pts
GPT-5.6 Terra+12.0 pts
All three, pooled+14.2 pts
LLM with web search
LLM with akta.pro MCP

Full definitions in ‘Methodology & definitions’. The full leaderboard and per-query results are in ‘Results’ and ‘By query’.

Precision

73.0%+14.2 pts

With akta.pro MCP vs 58.8% web only

Recall (Top 20)

58.4%+13.7 pts

With akta.pro MCP vs 44.7% web only

Correct companies

3,583+14%

With akta.pro MCP vs 3,143 web only, from 8% shorter lists

Even the weakest model wins with akta.pro: GPT-5.6 Luna had the loosest web-only lists of the three. With the akta.pro MCP it beat both Claude Sonnet 5 and GPT-5.6 Terra running on web search on every benchmarked metric: precision 73.1% vs 63.2% and 61.3%, Recall (Top 20) 56.7% vs 48.3% and 41.7%, and 1,153 correct companies vs 1,078 and 1,081.

Web search makes companies up; akta.pro almost never does: 160 web-search companies (3.0%) could not be shown to exist, against 5 (0.1%) with akta.pro. Another 7.2% of web-search companies came back with the wrong website, against 0.7%. For lead gen and outreach, a wrong website means enriching, emailing or matching the wrong company in the CRM.

Six findings from the benchmark, framed for what matters to teams building lead-gen, prospecting and deal-sourcing agents:

01

Precision up for every model

Up 9 to 21 points. Augmented, Sonnet 5, GPT-5.6 Luna and GPT-5.6 Terra all landed at about 73%, against 63%, 52% and 61% with web search only.

02

More of each market’s leaders

Recall (Top 20) rose by 7.5, 12.5 and 21.1 points. Pooled, akta.pro MCP runs found 58.4% of the curated leaders against 44.7% for web only.

03

More correct companies, less noise

3,583 correct companies against 3,143 (+440, or 14% more), while returning 440 fewer companies in total. Every model returned more correct companies when augmented.

04

Consistent across queries

More precise in 41 of 54 model-and-query pairs. Averaged across the three models, the augmented runs were more precise on 15 of 18 queries.

05

Investment and lead-gen queries gain the most

On investment queries, precision rose from 53% to 78% and Recall (Top 20) from 40% to 84%. On lead-gen queries, precision rose from 56% to 74% and Recall (Top 20) from 26% to 52%.

06

It finds companies web search does not

81.5% of the companies returned by akta.pro MCP runs were not returned by any web-only run.

A higher floor, a tighter spread

With akta.pro, the worst case gets much better

Averages matter less than what a team gets on a bad day. With the akta.pro MCP the weakest results improved the most, and quality depended far less on which model ran or which query was asked. That makes the output predictable enough to build a workflow on.

Worst model, precision

72.6%+20.3 pts

Lowest of the three models with akta.pro MCP, vs 52.3% web only

Best-to-worst model gap

0.8

Points of precision between best and worst model, vs 10.9 web only

Queries under 50% precision

3

Of 18 queries, mean of three models, vs 8 web only

Five hardest queries

48.4%+17.7 pts

Average precision on the five weakest queries, vs 30.7% web only

LLM with web search
LLM with akta.pro MCP

Across the three models

Across the 18 queries

0%25%50%75%100%

Precision range, worst to best. Across models, each point is one model pooled over 18 queries. Across queries, each point is one query, averaged over the three models. With akta.pro the whole range moves right and narrows.

The floor rises on every metric: the weakest model’s Recall (Top 20) went from 41.7% to 55.8%, and its correct companies from 984 to 1,153. Every akta.pro MCP setup beat every web-only setup on precision, Recall (Top 20) and correct companies.

Model choice matters less: on web search alone, precision ranged from 52.3% to 63.2% depending on the model. With akta.pro, all three landed between 72.6% and 73.4%. Recall (Top 20) still varies by model and query, since some markets’ leaders are simply hard to find, so the consistency gain is clearest on precision.

Each setup ran once per query, so this measures consistency across models and queries, not across repeated runs of the same model.

Why we ran this

Finding private companies is where web search runs out

“Find bootstrapped HVAC companies in the US under $10M valuation.”
“Find UK managed service providers with $5–10M in revenue.”
“Find US AI-native companies selling to Microsoft.”
“Find US companies where Tiger Global or Sequoia led a Series B or later.”

Queries like these sit at the start of lead generation, prospecting and outbound: a sales team builds its target account list this way before enrichment and sequencing. They also start deal sourcing and market mapping for investors. In both cases they are increasingly handed to AI agents, often in bulk.

Almost all of them are about private companies, and that is where web search struggles. The facts that define the list (ownership, funding round, lead investor, revenue band, founding year) are rarely stated plainly on a private company’s own pages, and often not stated anywhere a search engine can reach. A model with web search either skips the company or guesses, and the agent passes the list on without knowing which.

akta.pro exposes a structured database of private and public companies (70+ rich structured fields, including firmographics, ownership, funding and estimated financials) to agents through the akta.pro MCP. This study measures how much that changes the list: how many returned companies are correct, how many correct companies are found, and how much of each market’s top 20 is covered.

Vendor self-benchmark: akta.pro designed and ran this study. The queries, harness, judging rules and how the top-20 lists were built are described in full below. Please check the work rather than take our word for it.

Setup

Three models, two modes, one prompt

Models: One Anthropic model and two OpenAI models: Claude Sonnet 5, GPT-5.6 Luna and GPT-5.6 Terra. We chose them because they are what teams actually run for bulk work: enriching thousands of accounts, building target lists and feeding GTM outreach, where each query touches hundreds of companies and runs many times a week. Heavier reasoning models such as Claude Opus suit deep, one-off research; at bulk volume their extra thinking time and per-call cost rarely pay off, so we left them out.

Web only: The model’s own built-in web search tool, in a single model call. It searches, reads and returns the list.

With akta.pro MCP: The same model connected to the akta.pro MCP (company search, filtered list generation, company data) with web search turned off. These runs are multi-step: the agent plans, queries, filters and verifies depending on the model.

One prompt: Both modes received the same instruction and the same structured output (name, website, ownership, HQ city and country, product category). Each model and mode ran once per query.

Find <query>. Return a list of the top 100 companies sorted by <revenue | funding>

The 18 queries: Written to resemble real requests from lead-gen, investment and market-mapping workflows, most targeting private companies. They are grouped loosely by use case: investment (funding, investor and ownership screens), lead gen (prospect lists defined by firmographics, revenue band or buyer) and capability (companies defined by what they build or how they operate).

#QueryCompanies
judged
Judged
correct
Investment
1a16z-backed US AI companies, funded in last 2 years299124
2US companies with a Tiger Global or Sequoia-led Series B+287128
3European software, $20M+ Series B–D from Accel or Index262127
4US unicorns founded in the last 3 years240109
5PE-backed US/Canada professional services, $25–100M revenue373142
6Corporate/PE-owned specialty chemicals, US & W. Europe, $50–500M revenue389308
7Nordic & Dutch energy storage hardware, no raise in 12 months346281
Lead gen
8Series C+ PLG SaaS with usage-based pricing275243
9Bootstrapped US HVAC service cos, sub-$10M valuation516371
10Bootstrapped UK managed service providers, $5–10M revenue395202
11Bootstrapped US vet clinics, est. before 2000, $5–10M revenue473171
12US AI-native companies selling to Microsoft31089
13Middle East real estate & proptech, $1M+ funding381329
Capability
14Series B+ Southeast Asian fintech with AI220166
15Indian vertical marketplaces with network effects426327
16Private European AI medical imaging software330252
17US data-monetization cos with a public API, funded in last 3 years440123
18AI legal tech founded after 2010, global301230

How every company was judged

  • Candidate pool: For each query we took the union of companies returned by all models, in both modes, and de-duplicated it: 6,263 company-query pairs in total.
  • Fact pack: For every company, an independent web search agent built a live fact pack. It broke the query down into its relevant parts (location, ownership, funding rounds, investors, founding year, customers, AI capabilities, as relevant), searched the live web for each sub-query and aggregated the sourced answers.
  • Verdict: An LLM judge evaluated each company against every criterion in the query, using the live fact pack sourced across all sub-queries, and marked it Yes or No with a one-line rationale.

The curated top 20

Recall (Top 20) needs a reference list of each market’s leaders. Once the LLM judge had confirmed which companies were correct, we combined them into one list of all relevant companies per query, with funding and revenue data aggregated where available. A separate set of independent web agents each gathered its own top 20 for the query; their unique companies were added to the list and companies that did not fit the query were removed. From this list we established a curated top 20 per query, and calculated Recall (Top 20) for each model against it.

Results

All six setups on the headline metrics across the 18 queries, grouped by mode and sorted by precision; the best value in each column is marked. Definitions for every metric are in the ‘Methodology & definitions’ section.

SetupCompanies
returned
CorrectPrecisionTop-20 hits
(of 360)
Recall
(Top 20)
With akta.pro MCP
GPT-5.6 Terra with akta.pro MCPBEST OVERALL1,6251,19273.4%22662.8%
GPT-5.6 Luna with akta.pro MCP1,5781,15373.1%20456.7%
Claude Sonnet 5 with akta.pro MCP1,7051,23872.6%20155.8%
Web only
Claude Sonnet 5, web only1,7051,07863.2%17448.3%
GPT-5.6 Terra, web only1,7631,08161.3%15041.7%
GPT-5.6 Luna, web only1,88098452.3%15944.2%

Precision: is each company actually a match?

Precision is the share of returned companies that meet every criterion in the query. It decides how much cleanup a list needs before it goes into a CRM, an outreach sequence or an investment pipeline, and it does not depend on the curated top 20.

Claude Sonnet 5+9.4 pts
GPT-5.6 Luna+20.7 pts
GPT-5.6 Terra+12.0 pts
All three, pooled+14.2 pts
LLM with web search
LLM with akta.pro MCP

Figure 1. Precision by model, pooled over 18 queries. akta.pro MCP raised precision for every model: by 9.4 points for Sonnet 5, 20.7 for Luna and 12.0 for Terra. All three augmented setups landed at 73%, so the MCP lifted the weaker web-only models the most.

With web search only, between 37% and 48% of returned companies failed the query. Typical failures were a company in the wrong country, a VC-backed company in a bootstrapped query, a company too large for the revenue band, or a round led by someone else.

With the akta.pro MCP, the agent could filter on ownership, geography and funding before returning a company, rather than inferring those facts from web pages. Luna’s web-only lists were the loosest (52%), and the MCP closed that gap entirely.

Recall (Top 20): did each mode find the leaders?

Whether it is a prospect list for outbound or a pipeline of investment targets, a list is judged first on whether it contains the companies that matter. For these queries the number of valid companies is large, often hundreds, so total recall is neither measurable nor very useful: what matters is that the top companies are returned, alongside overall precision. Recall (Top 20) is the share of each query’s curated top 20 that a run returned.

Claude Sonnet 5+7.5 pts
GPT-5.6 Luna+12.5 pts
GPT-5.6 Terra+21.1 pts
All three, pooled+13.7 pts
LLM with web search
LLM with akta.pro MCP

Figure 2. Recall (Top 20) by model, over 360 top-20 companies. akta.pro MCP raised Recall (Top 20) for every model: by 21.1 points for Terra, 12.5 for Luna and 7.5 for Sonnet 5. Terra with the akta.pro MCP found 62.8% of the leaders, the highest of any setup.

The lead is largest on investment queries (84% vs 40%, mean of three models) and lead-gen queries (52% vs 26%). On capability queries, web search found more of the top 20 (74% vs 31%), because the leaders in categories such as AI legal tech, Indian marketplaces and Southeast Asian fintech are heavily covered in the press.

Correct companies: what each mode adds

Precision and recall describe quality. The number of correct companies describes what a sales or deal team actually receives. Augmented with akta.pro MCP, every model returned more correct companies, while returning the same number of companies or fewer.

Claude Sonnet 5+160
GPT-5.6 Luna+169
GPT-5.6 Terra+111
LLM with web search
LLM with akta.pro MCP

Figure 3. Correct companies returned, summed over 18 queries. +160 for Sonnet 5 (+15%), +169 for Luna (+17%), +111 for Terra (+10%): 3,583 against 3,143 in total, from 4,908 companies returned against 5,348.

Unique coverage by source group

Grouping runs by source shows what each adds. akta.pro MCP is every augmented run (all three models). Claude web only is Sonnet 5 with web search. OpenAI web only is Luna and Terra with web search. Companies are counted once per query within a group.

akta.pro MCP
OpenAI web only
Claude web only
LLM with web search
LLM with akta.pro MCP

Figure 4. Share of a group’s companies that no other group returned. 81.5% of the companies akta.pro MCP runs returned were not returned by any web-only run, at 71.5% precision as a group, against 63.2% and 54.1% for the two web-only groups.

Source groupRuns per
query
Companies
returned
CorrectPrecisionUnique to
group
Unique %
akta.pro MCP32,5971,85871.5%2,11781.5%
Claude web only (Sonnet 5)11,7051,07863.2%95756.1%
OpenAI web only (Luna, Terra)23,0851,66954.1%2,25973.2%
#Queryakta.pro MCP
correct
akta.pro MCP
unique %
Claude web
correct
Claude web
unique %
OpenAI web
correct
OpenAI web
unique %
Investment
1a16z-backed US AI9465%4548%4464%
2Tiger/Sequoia-led Series B+8461%4647%5963%
3Accel/Index EU software10253%5532%5866%
4US unicorns, under 3 yrs7666%2234%5169%
5PE-backed prof. services5092%4385%6689%
6PE/corp specialty chemicals12792%8077%12985%
7Nordic/Dutch energy storage13276%8055%12872%
Lead gen
8PLG usage-based SaaS10174%9542%12850%
9Bootstrapped US HVAC190100%5899%12499%
10Bootstrapped UK MSPs8193%4282%9093%
11Bootstrapped US vet clinics7099%3197%7198%
12AI-native, sells to Microsoft5790%2235%3159%
13Middle East proptech14480%9760%13985%
Capability
14SEA fintech, Series B+5443%7938%11853%
15Indian vertical marketplaces20185%9029%13446%
16EU AI medical imaging12769%7943%12760%
17US data-monetization APIs7794%2459%4279%
18AI legal tech9185%9036%13050%

By query

Each query shows precision and Recall (Top 20) averaged across the three models, with web only and with akta.pro MCP joined by a line. The augmented runs were more precise on 15 of 18 queries and found more of the top 20 on 10 of 18, and the gains were largest exactly where web pages blur the defining facts.

LLM with web search
LLM with akta.pro MCP
Web search higher
Query
0%25%50%75%100%
Change

Investment

Lead gen

Capability

Figure 5. Precision by query, mean of Sonnet 5, GPT-5.6 Luna and GPT-5.6 Terra. Change is in percentage points. Hover a row for exact values.

Investment queries show the clearest gains: precision of 78% against 53%, higher on all 7 queries. For a16z-backed AI companies, augmented precision averaged 84% against 35%. For Tiger/Sequoia-led rounds it was 82% against 40%, for Accel/Index-backed European software 89% against 49%, and for PE- or corporate-owned specialty chemicals 95% against 72%. Lead-investor, round and ownership data is exactly what a company database holds and web pages blur.

Lead-gen queries improved on 5 of 6 (74% vs 56%). Bootstrapped HVAC is the extreme case: 95% precision with the akta.pro MCP against 59% with web search. For bootstrapped UK managed service providers it was 72% against 43%, for AI-native companies selling to Microsoft 51% against 21%, and for Middle East proptech 97% against 84%. The exception was PLG SaaS (87% vs 94%), a category the press covers in the query’s own terms.

Recall (Top 20) follows the same pattern. The augmented runs found more of each market’s leaders on investment queries (84% vs 40%) and lead-gen queries (52% vs 26%), including 93% vs 7% on PE-backed professional services, 100% vs 7% on specialty chemicals and 70% vs 20% on UK managed service providers. Exceptions were Nordic and Dutch energy storage, PLG SaaS and bootstrapped HVAC. On capability queries, web search found more of the top 20 (74% vs 31%).

Capability queries are mixed: precision was 71% with the akta.pro MCP against 73% with web search. The MCP helped on Southeast Asian fintech (93% vs 80%), US data-monetization APIs (41% vs 25%) and European AI medical imaging (82% vs 78%). Web search did better on Indian marketplaces and AI legal tech, well-covered categories where the web describes companies in the query’s own terms.

Why companies fail

With akta.pro, fewer wrong companies, and almost none made up

Precision says how many returned companies were wrong. This section looks at why. Every company that failed its query was classified by the criterion it failed, using the judge’s written rationale. Separately, we requested every returned company’s website. For the 1,133 companies whose website did not resolve, did not respond or redirected elsewhere, an independent web agent (Parallel), not shown the website the model gave, checked whether the company exists and found its official website.

What went wrong, by reason

LLM with web search

Total failed53.1%

LLM with akta.pro MCP

Total failed28.8%

Figure 6. Problem companies per 100 returned, by reason. Pooled over three models and 18 queries (5,348 companies returned on web search, 4,908 with akta.pro MCP). “Fake or wrong website” comes from the website and existence check; the other four are the main criterion each wrong company failed, which add up to 41.3 points on web search and 27.0 with akta.pro MCP.

Web search invents companies and gets websites wrong; akta.pro MCP almost never does. Web-search runs returned 160 companies that could not be shown to exist, 3.0% of everything they returned, against 5 (0.1%) with the akta.pro MCP. All of them were removed before scoring. Web search also gave a real company the wrong website 385 times (7.2%), against 35 (0.7%), and Sonnet 5 on web search got 1 in 10 websites wrong. Agents use the website to identify a company for enrichment, outreach and CRM matching, so a wrong website attaches the right name to the wrong company. akta.pro returns companies already matched to their entity and website.

Web search fails on the facts it cannot see. The two largest web-only failures are a funding mismatch (wrong round, the named investor not involved or not the lead, a raise outside the time window) and the wrong ownership type (VC-backed in a bootstrapped query, independent in a PE-backed one). Together they cost web-only lists 22.1 points of precision. With the akta.pro MCP that falls to 6.8, because funding rounds, investors and ownership are structured fields the agent can filter on before it returns a company.

akta.pro MCP misses are different. Its largest failure is sector fit (7.8 points against 1.5): companies in a neighbouring category that matched the filters, such as architecture or waste-management firms in a query for legal, accounting and consulting firms, or software vendors in a query for marketplaces. Most of these came from three broadly worded queries (PE-backed professional services, Indian vertical marketplaces and AI legal tech). Founding-date misses were similar for both modes and came mostly from US unicorns, where the augmented runs included unicorns older than three years.

The existence check used Parallel’s lowest-cost processor; common names can match a different real company, so made-up counts are a lower bound. “Company identity” covers companies that are defunct, absorbed by an acquirer, confused with a namesake, or not operating companies. Reasons come from classifying the judge’s rationale with an LLM; each wrong company has one main reason.

Where akta.pro MCP wins

The case for the akta.pro MCP is not that web search is bad; it is that web search is built to find pages, not to verify the facts that define a private-company list. The data below shows where the separation is widest.

Where akta.pro MCP leads

Precision: 73.0% pooled, +14.2 pts over web only, and higher for every model.

Investment queries: precision 78% vs 53%, up to +48.5 pts on a single query, and Recall (Top 20) 84% vs 40%.

Lead-gen queries: precision 74% vs 56%, with bootstrapped HVAC at 95%, and Recall (Top 20) 52% vs 26%.

Recall (Top 20): 58.4% pooled, with GPT-5.6 Terra the highest when augmented of any setup at 62.8%.

Correct companies: +440 (+14%) from shorter lists.

Unique coverage: 81.5% of akta.pro MCP companies were found by no web-only run.

Made-up companies and wrong websites: 0.1% of akta.pro MCP companies could not be shown to exist, vs 3.0% web only; wrong websites 0.7% vs 7.2%.

Why akta.pro finds more companies, more precisely

Grounded in a company database: every company comes from a structured record, not a web page the model has to interpret, so ownership, funding, revenue and HQ are looked up rather than guessed.

Filters before it returns: the agent applies geography, ownership, round, lead investor, revenue band and founding year up front, so misfits are dropped instead of padding the list. This is where the +14.2 pt precision gain comes from.

Refreshed to keep status current: records are refreshed regularly, so a company that raised, was acquired or changed ownership is matched on where it stands today, not on an old article.

Reaches companies the web barely covers: bootstrapped and PE-owned companies with little press are in the database even when no page names them, which is why 81.5% of akta.pro MCP companies were unique and correct companies rose by +440.

Real companies, one ID each: every result is an existing, entity-resolved company with its own website, so aliases are merged rather than double-counted, and made-up companies and wrong websites all but disappear.

Where web search edges ahead: on broad thematic categories the press covers heavily (Indian marketplaces, AI legal tech, PLG SaaS), web-only runs were more precise and found more of the top 20. These are categories where companies describe themselves in the query’s own words, so a page match is usually a real match.

What this means

Structured data makes agent-built company lists usable

Web search lets a model find companies that are written about. The akta.pro MCP lets it check the facts that define the list (who owns the company, who funded it, how big it is, who it sells to) before it returns the company. That is why the gains are largest in precision, and on queries defined by those facts.

For lead gen and GTM teams: every wrong row costs something: an SDR’s time, an email send, a credit spent enriching the wrong account. With akta.pro, 73% of returned companies met every filter against 59% on web search, wrong websites fell from 7.2% to 0.7%, and almost no companies were made up. Prospect lists can go straight into enrichment, the CRM and outreach sequences with far less manual cleanup, and stay consistent whichever model the agent runs on.

For investment and market mapping: the risk is missing the companies that matter. akta.pro runs found 58.4% of each market’s curated top 20 against 44.7%, with the largest gains on queries defined by investor, round, ownership and revenue band, the facts a funding or PE screen depends on.

Search still has a role. It does well on categories the press covers heavily, and it surfaces some companies the MCP runs did not. For agent builders, the practical design is to run company search and verification through the akta.pro MCP and to use web search to widen the list where a category is well documented.

Methodology & definitions

Metric definitions

  • Returned: distinct companies a run listed for a query, after de-duplication by name.
  • Correct: returned companies the judge marked Yes against every criterion of the query. Every company is either Yes or No.
  • Precision: correct ÷ returned, summed across queries.
  • Recall (Top 20): companies from the curated top 20 that a run returned ÷ 20, summed across queries (360 top-20 companies in total).
  • Source group: akta.pro MCP (every augmented run, three models), Claude web only (Sonnet 5) or OpenAI web only (Luna and Terra).
  • Unique % by source group: share of a group’s distinct companies that neither of the other two groups returned.
  • Failure reason: the main criterion a wrong company failed (funding, ownership, attribute, revenue band, founding date, sector, geography or company identity), classified from the judge’s rationale.
  • Made up or unverifiable: a company whose website did not work or redirected, and which an independent web agent, not shown the model’s website, could not confirm exists or find a working website for. These companies were removed before scoring.

Limitations

  • Vendor self-benchmark: akta.pro wrote the queries, curated the top-20 reference lists, ran the harness and chose the metrics. Precision does not depend on the curated lists and is the cleanest comparison.
  • Model selection: We also ran Claude Haiku 4.5 and left it out of the study, because its web-only runs returned no companies on 11 of 18 queries, leaving too little for a fair comparison.
  • Verdicts depend on public web evidence: Fact packs are built from live web search only, so companies with little web presence have thinner evidence behind their verdicts.
  • LLM judge, not human adjudication: Verdicts were not adjudicated by humans beyond spot checks.
  • One run per setup: LLM agents are non-deterministic and we did not repeat runs, so small differences are within run-to-run noise.
  • Configuration: Each mode used one reasonable configuration. Different prompts, tool budgets or search settings would change the numbers, especially for web only, which ran as a single call.

Reproducibility: The queries, judging rules and metric definitions are all on this page. We will share the harness, each query’s breakdown into individual filters and per-query scores on request. If you find a flaw in the methodology, tell us. We would rather fix it than defend it.

Try our data for free

Start with 50 credits monthly on us — no credit card required.