What is llms.txt and do I need it?
llms.txt is a proposed markdown file at /llms.txt that summarizes a site for language models and links its key pages. You do not need it for AI search visibility: Google says Google Search ignores it, and no major AI engine documents using it to choose citations. Some coding agents do fetch it.
llms.txt was proposed in 2024 at llmstxt.org as a markdown summary of a site for language models: a title, a short description, and sections of links. It is a proposal, not a standard, and unlike robots.txt it does not control crawling.
What llms.txt contains
- Brand identity block: name, tagline, location, founders.
- Product / service catalog with URLs.
- Key blog pillars and topic-cluster URLs.
- FAQ section with question + short answer pairs.
- Optional use policy (a Pixelmojo convention, not part of the proposal).
- Contact info for AI engineering teams to reach you.
- Disambiguation block if a similarly-named company exists.
What it does and does not do
Google says Google Search ignores llms.txt, so it neither helps nor harms visibility there. SE Ranking found no link between llms.txt and AI citations across about 300,000 domains, and Ahrefs, whose May 2026 server logs cover 137,210 domains, found that 97% of published llms.txt files received no requests at all. Of the few requests Ahrefs did see, SEO audit tools had the largest share (21.7%), and the coding agent Claude Code made more requests than any AI search bot. Chrome Lighthouse includes an optional llms.txt audit among its agentic browsing checks.
An llms-full.txt carries the expanded text alongside the short file. Like llms.txt, it has no documented effect on AI citations.
Static vs dynamic
Two implementation patterns: static (a hand-authored markdown file in /public) or dynamic (a route that generates the file from your CMS / content layer at build time). Dynamic is better: the file stays in sync as you publish blogs, ship products, or update positioning.
Do you need it
Not for visibility. Publish one if you want a clean summary for the coding agents and AI tools that fetch it; it takes an afternoon. For AI search visibility, spend the time on crawl access, indexable pages, and original content.
How to check your current llms.txt
Radar llms.txt Validator checks 6 categories: file presence, markdown spec compliance, content sections, link extraction, entity definitions, use policy. Outputs A-F grade with section-by-section fixes.
Sources
Want to take action on this?