llms.txt File
Checks for a /llms.txt file — an AI-specific guide to your site content.
What this check measures
We fetch `/llms.txt` at the domain root and validate it exists, returns `text/plain` or `text/markdown`, and follows the spec (title, description, H2 sections with links).
Why it matters
llms.txt is a community-driven standard (llmstxt.org) that major AI tools have adopted. It is to AI what sitemap.xml is to search engines. Early adopter advantage: most sites still do not have one.
How our audit detects it
GET /llms.txt. Validate response status, content-type, and structural markers (title line, at least one H2 section).
Typical findings
- error_outline/llms.txt returns 404.
- error_outlineFile exists but is a bare URL list — missing the H2+description structure.
- error_outlinellms.txt has not been updated since launch, references removed pages.
How to fix
Create `/llms.txt` with H1 title, 1-paragraph description, then H2 sections linking to key pages with 1-line summaries. Keep under 200 lines. See /prompts/add-llms-txt.
Copy-paste fix prompt for your stack
Lovable · Cursor · Bolt · v0 · Replit · Windsurf · Claude Code · Base44
Frequently asked questions
Is llms.txt an official standard?expand_more
Want this checked on your site?
Pantra runs the full audit (SEO, Security, GEO, Performance, Schema, Technical, Images) in 10 seconds and generates stack-specific fix prompts.
Scan my siteRelated checks
AI Crawlers Allowed
Checks that GPTBot, ClaudeBot, PerplexityBot, and Google-Extended are not blocked in robots.txt.
AI Search (GEO)JSON-LD Structured Data
Checks for JSON-LD structured data in the page <head> — essential for rich results and AI citations.
AI Search (GEO)Server-Side Rendering
Checks that main content renders in the initial HTML response, not only after JavaScript executes.
AI Search (GEO)Static Content Density
Checks how much meaningful text ships in the initial HTML without JS execution.