Skip to main content
Back to Radar Radar · Methodology · updated September 2026

Radar Methodology.

How Radar gathers AI response data through live queries, calculates your AI Readiness Score, handles LLM response variance, and detects hallucinations. Every metric is transparent and traceable: we store the measured inputs, timestamps, and provider coverage behind each score. LLM responses are non-deterministic, so identical reruns are not guaranteed (see LLM Variance Handling below).

13 audit dimensions4 measured API engines0-100 normalized scoreLive queries, not snapshots
Dimension weightsProposed · roadmap calibration
Selected dimensionAI Crawl Check

Access for 17 AI, search, and SEO crawler user-agents, with retrieval access and training policy assessed separately.

9% proposed
Today · all completed dimensions weighted equally
Radar access and evidence, from Scout · 0:30

This is an AI-generated animated film with a synthetic character voice. The workshop and screens are illustrative concept visuals, not a recording of the live product or a customer audit. No score change or completed fix is shown.

01 / The 13 audit dimensions

Each dimension measures one part of your AI visibility.

Each dimension measures a specific aspect of your AI visibility infrastructure. Proposed weights are an importance ranking for the calibrated weighting on our roadmap; today every completed dimension counts equally.

AI Crawl Check

Proposed weight: 9%

Measures: Access for 17 AI, search, and SEO crawler user-agents, with retrieval access and training policy assessed separately.

Why it matters: Retrieval crawlers need access to fetch your content for AI answers. Training access is a separate policy choice.

Robots.txt Analysis

Proposed weight: 8%

Measures: Deep parse of robots.txt rules for 20 known AI and search bots.

Why it matters: Misconfigured robots.txt is the most common reason sites are invisible to AI.

llms.txt Validation

Proposed weight: 8%

Measures: Whether your llms.txt file exists, is valid, and contains useful structured content.

Why it matters: llms.txt is a proposed file that summarizes a site for language models. The current methodology still scores it, although Google says Google Search ignores it and no major AI engine documents using it to choose citations (checked September 2026). We are reviewing its weight for the next methodology version.

AI Readiness Score

Proposed weight: 8%

Measures: 5-category audit across technical, content, structured data, authority, and discoverability.

Why it matters: A holistic assessment of whether your site is optimized for AI citation.

Citation Tracker

Proposed weight: 9%

Measures: Whether the ChatGPT, Claude, Gemini, and Perplexity APIs mention and cite your brand.

Why it matters: The ultimate measure: are AI models actually talking about you?

Reddit Monitor

Proposed weight: 5%

Measures: Brand mentions across Reddit, including detection of seeded or artificial content.

Why it matters: Reddit is a major training data source for LLMs. Your Reddit presence shapes AI outputs.

AEO Page Auditor

Proposed weight: 8%

Measures: Answer Engine Optimization readiness across 6 categories for a specific page.

Why it matters: Page-level optimization determines whether AI can extract quotable answers.

Citation Tester

Proposed weight: 8%

Measures: Whether AI platforms cite your specific page when asked a relevant question.

Why it matters: Tests the direct pathway from question to your content.

Source Influence

Proposed weight: 7%

Measures: Which domains are shaping AI narratives in your category.

Why it matters: Understanding the competitive landscape tells you what you are up against.

Prompt SOV

Proposed weight: 7%

Measures: Your position-weighted share of brand mentions in the AI responses Radar collected for your category.

Why it matters: Shows which brands the measured models name, and how early, when asked about your category. It counts mentions within the sampled responses, not endorsements or market share.

Prompt SOV Score overview

Schema Audit

Proposed weight: 7%

Measures: Scores contextual JSON-LD coverage and field completeness across 13 supported schema types.

Why it matters: Radar uses these entities as its business-identity and page-context signals.

Hallucination Check

Proposed weight: 8%

Measures: Detects factual errors in what AI models claim about your brand.

Why it matters: AI hallucinations can damage your brand. You need to know what is being said wrong.

Brand Disambiguation

Proposed weight: 8%

Measures: Whether AI engines link your brand name to the right entity or confuse it with a same-named company, person, or product.

Why it matters: If AI describes a different entity that shares your name, buyers get the wrong company. Entity accuracy protects your identity in AI answers.

Composite metric

Crawl Integrity Score

A composite metric across AI Crawl Check, Robots.txt Analysis, and llms.txt Validation. The Crawl Integrity Score averages three component scores: bot access policy for 17 bots (checked with simulated requests from Radar's servers; Google-Extended is a robots.txt token only), robots.txt rule analysis for 20 bots, and llms.txt validation against Radar's rubric. Read the components to see which one moved the average.

AI Crawl Check17 bots · simulated requests
+
Robots.txt Analysis20 bots · rule parse
+
llms.txt ValidationRadar rubric
÷ 3
Crawl Integrity ScoreAverage of three
02 / Scoring model

One average. Five grades. No hidden weights.

The overall Radar score averages the dimensions that completed for your domain, normalized to 0-100. Today all completed dimensions are weighted equally. The proposed weights shown above are our importance ranking and the basis for the calibrated weighting on our roadmap; they do not affect today's score.

Grade bands

Drag a score to read its grade

72/ 100BGood
F0-29 · CriticalD30-49 · PoorC50-69 · AverageB70-84 · GoodA85-100 · Excellent

A grade summarizes the checks an audit completed. It is not a prediction that AI engines will cite or recommend a site.

Calibration: The dimension importance ranking started as a judgement informed by the fixes we made on our own site between October 2025 and March 2026: a directional prior from a single case, not a statistically calibrated model, and that case recorded no AI answers before or after the fixes. Calibration is ongoing: calibrated weight sets are built and evaluated against real audit outcomes before any promotion into the live score.

What "good" looks like: A grade summarizes the checks an audit completed. It is not a prediction that AI engines will cite or recommend a site; the live checks in a full audit measure that directly, for the prompts they test.

03 / Scoring changelog

When a rule changes, we say so.

When a scoring rule changes, a score can move without anything on the site changing. Every such change is dated and explained here, and the same note appears beside the score it affected.

Gemini · gemini-3.5-flash-lite

Gemini model update from 4 November

From 4 November 2026, new Radar runs will use Gemini 3.5 Flash-Lite for Gemini answers and their Google Search sources. This prepares Radar for Google’s retirement of Gemini 2.5 Flash on 1 December.

We tested both models on four recent customer audits and compared our own audit with its previous run. Most scores changed by five points or less. Larger changes also occurred between repeated runs on the old model, so those differences cannot confidently be attributed to the switch.

Your saved runs and scores stay unchanged. Results collected before and after the model change are not directly comparable.

Citation Check · Reddit Monitor

Balanced comparisons and Reddit quote ownership

Citation Check treats balanced pros-and-cons comparisons as cautionary unless the answer clearly recommends or rejects your brand. This clarification can change sentiment points without a change to your site. The classifier also receives up to 6,000 characters per answer instead of 400, so later caveats are less likely to be cut off. Sentiment weights and regex fallback rules are unchanged.

Reddit Monitor’s backup search keeps a quote only when it matches wording in a source block tied to that same thread. Quotes with ambiguous ownership are dropped. This can change sentiment and promotional-content signals, and may remove mentions that no longer have enough evidence to identify your brand. The main search path is unchanged.

Saved runs retain their original scores. Compare results with these methodology changes in mind; no fixed score adjustment applies to every brand.

ChatGPT · gpt-6-luna

ChatGPT results now use gpt-6-luna

OpenAI retires gpt-4o-mini, the model behind Radar's ChatGPT results, on 14 January 2027 and names gpt-6-luna as its replacement. From this date, new Radar runs use gpt-6-luna to collect ChatGPT's answers, to identify your brand and its category, and to judge parts of several scores: sentiment, which brands in an answer are competitors, and whether facts about your brand are correct. Your category shapes the questions Prompt SOV asks, so a different category can mean different questions. In our matched tests on one brand, OpenAI, the model change alone moved scores by 4 points or less and changed no grade.

Testing the change also exposed four problems, now fixed. Prompt SOV no longer counts a brand's own products, add-ons or sub-brands as its competitors, or technologies an answer mentions only as background. Source Influence ignores large platforms such as google.com and github.com, and that filter also removed the audited site when it was one of them; the audited site is no longer filtered out. In Citation Check, Prompt SOV, Source Influence and Answer Engine, ChatGPT answers that were cut off, refused, empty or otherwise incomplete were scored as if complete; they are now treated like a failed request, and those answers get more room. Reddit Monitor's backup search now keeps a quote only when it matches the source word for word, and counts each thread once.

Together, the fixes and the model change can move a score with no change on your site. On our test brand, OpenAI, Prompt SOV rose from about 80 to about 90 and Source Influence from about 77 to about 85, each moving from B to A, and none of 48 ChatGPT answers was cut off, against 21 before. Most of that rise came from the fixes: with the fixes on the old model, the two scores were already about 90 and 85. These are results for one test brand, not an adjustment applied to every score. Saved runs keep their original scores and are not regenerated, so runs from before and after this date are not directly comparable.

Schema Audit · v2

Schema Audit scoring methodology v2

Schema Audit now scores business identity, WebSite, navigation context, and a page type appropriate to the audited content. Article, FAQPage, and SpeakableSpecification are no longer universal requirements, and ProfessionalService, Place, and CreativeWork now have field-completeness rubrics.

Volume now counts typed schema entities rather than type memberships described as JSON-LD blocks, and volume and evaluated-type diversity build one point at a time instead of maxing out at five. If your score changed without a site update, compare runs by scoring-method version; version 1 and version 2 are not directly comparable.

Overall score

Withheld checks no longer count as zero

When a check cannot grade your site (usually because a firewall blocked it), we say so instead of inventing a number. That "withheld" result was still being averaged into your overall score as a zero, which pulled the total down for a check that had explicitly declined to score you.

Withheld checks are now left out of the average entirely. If your overall score went up, nothing on your site changed; the earlier number was unfairly low. We now also show how many checks the score is based on, so a score built on 12 checks is never mistaken for one built on 13.

AI Crawl Check

Scoring methodology updated

We fixed how the AI Crawl Check scores a site that returns a normal web page instead of a proper "404 not found" when a file (like llms.txt or robots.txt) is missing. We used to treat that as "couldn't check" and drop it from your score; it actually means the file simply isn't there, so it now counts as missing, the same as any other site without one.

If your score went down, nothing on your site changed for the worse. The old number was too generous, and the new one matches what any site with the same setup would get. The way to raise it is what it always was: add the missing file.

04 / Live queries vs snapshot databases

Fresh answers beat cached ones.

How Radar gathers AI response data, and why this matters for accuracy. Live querying beats snapshot databases when AI answers change between runs. Radar runs fresh queries against the ChatGPT, Claude, Gemini, and Perplexity provider APIs in every full audit of a domain. The results reflect what the measured API models returned at audit time, not what they said weeks ago.

What Radar queries
OpenAIChatGPTgpt-6-luna
AnthropicClaudeClaude Haiku
PerplexityPerplexitySonar
GoogleGeminiGemini 3.5 Flash-Lite
xAIGrokgrok-4.3Report-only · rollout

Radar measures responses from the provider APIs (OpenAI gpt-6-luna, Anthropic Claude Haiku, Perplexity Sonar, and Google Gemini 3.5 Flash-Lite). Consumer apps like chatgpt.com or gemini.google.com may differ: they can use different models, memory, personalization, and live web search. Results are a snapshot of the measured API responses at scan time; provider coverage and model versions are shown where available. Where shown in your report, Radar also measures xAI Grok (grok-4.3) as a report-only engine during rollout; report-only engines appear in per-engine results but do not affect scores.

Snapshot approach

A prompt library, run in cycles, served from cache.

Tools build a large prompt library, often hundreds of millions of search-derived prompts, run them in batched cycles, and serve the cached results. Refresh schedules vary by tool and plan, from daily to monthly.

StrengthScale of queries.
WeaknessStaleness, plus invisibility to AI sub-queries the platform never sees.
Radar live-query approach

Fresh queries to each measured model, every full audit.

Radar issues fresh queries to each measured API model in every full audit. Results reflect those models at audit time, including live search where the model uses it.

StrengthNo cached answers, captures current API behavior.
Trade-offSmaller per-audit query volume, addressed by repeat audits and explicit variance handling.
LLM variance handling

Non-determinism, handled in the open.

LLM responses are non-deterministic. The same query can produce different results on different runs. Radar addresses this openly.

Methodology

Citation scores query each LLM and display the result. When comparing across runs (LLM Answer Diff), Radar highlights changes explicitly so users can distinguish genuine shifts from model variance.

Why this matters

Most tools in the AI visibility space don't surface non-determinism. Radar acknowledges and handles LLM variance explicitly, turning a vulnerability into a trust signal.

The dark query blind spot

Most AI retrieval traffic is invisible to prompt-library tools.

When a user asks an AI assistant a question, the model often decomposes that question into multiple internal sub-queries before generating an answer. These sub-queries have no Google search volume, no public footprint, and never appear in keyword-research-based prompt libraries. Industry estimates put this dark-query share at roughly 88% of total AI retrieval traffic.

88% dark sub-queries · no search volume, no public footprint12% visible prompts

Radar handles this by querying LLMs directly with category and brand-specific prompts that mirror how AI assistants actually retrieve answers, not how Google users phrase searches.

When snapshots are useful

Live querying is not always the right answer.

Snapshot databases earn their keep when you need historical trend lines, fixed comparison surfaces across thousands of brands, or coverage of branded search-volume data that only traditional search engines can supply. Radar focuses on technical AI readiness and live citation behavior, and we recommend pairing live audits with traditional search-volume tools for the full picture. Use the right instrument for the question you are answering.

05 / Hallucination detection framework

Ground truth first, then the claims.

How Radar identifies and scores factual errors in AI-generated content about your brand.

01

Ground truth extraction

Radar extracts verifiable claims from your site (meta tags, schema markup, published content) and uses these as the baseline for accuracy comparison.

Meta tagsSchema markupPublished content
02

Claim verification

AI model responses are compared against ground truth. Each discrepancy is flagged with a severity tier: Critical (wrong facts that could cause harm), Major (significant misrepresentations), and Minor (imprecise but not harmful).

CriticalMajorMinor
03

Severity scoring

The hallucination score reflects both the number and severity of detected inaccuracies. A domain with zero hallucinations scores 100. Each critical flag reduces the score significantly; minor flags have smaller impact.

100 = zero hallucinations
CriticalWrong factsthat could cause harm · reduces the score significantly
MajorMisrepresentationssignificant, flagged for correction
MinorImprecisebut not harmful · smaller impact on the score
06 / Where the checks came from

Fixes on our own site, written down.

Radar's checks came out of fixes on our own site. That history explains why the checks exist. It is not a validation of the score, because we did not record what AI engines said before and after.

Oct 2025first fixes on our site
515 commits of every kind
Mar 2026Radar platform

Between October 2025 and March 2026 we fixed crawl access, robots.txt rules and structured data on our own site, and the git history records each change. We did not record AI answers before or after, so this is the origin of Radar's checks, not evidence that the score predicts citations.

Read the full origin story
Related standalone tool · outside the 13-dimension audit

YouTube Brand Monitor

Google and OpenAI have trained models on YouTube transcripts, but it is not part of Radar's 13-dimension audit. The standalone YouTube Brand Monitor tool scores your YouTube footprint across mention volume, channel diversity, sentiment, reach, and recency using live YouTube Data API queries. Use it alongside Radar for a fuller picture of off-site brand visibility.

  • Mention volume
  • Channel diversity
  • Sentiment
  • Reach
  • Recency
Run a YouTube audit
See it in action

Read a full audit scored by this methodology.

Read a full audit scored by this methodology, or run one on your own domain.