Structuring /llms.txt and /llms-full.txt for Perplexity & Claude AI Retrieval
AI agents read Markdown 5x cleaner than nested div wrappers. Deploying /llms.txt plus auto-generated /llms-full.txt eliminates retrieval guesswork.
Dmitry K., Technical SEO Lead · SEO Space
Indexation benchmark targets
- Summary index
- /llms.txt (< 10 KB)
- Full URL map
- /llms-full.txt build sync
- Token noise
- Zero nav/SVG boilerplate
- Update cadence
- Auto on npm run build
1. Separating Curated Entrypoints (/llms.txt) from Complete Catalogs (/llms-full.txt)
Use `/llms.txt` as a concise high-signal index pointing to core solution pillars, pricing currencies, and direct contacts, while generating `/llms-full.txt` automatically from your SSR build script so every newly published article or regional hub is immediately discoverable.
AI retrieval bots operate under tight token and latency windows per fetch. Providing cleanly structured markdown manifests alongside deterministic HTML lets Perplexity, Claude, and ChatGPT Search ingest pricing, technical scope, and canonical URLs without guesswork.
- Keep `/llms.txt` under concise index size listing core solutions, pricing, and deep engineering guides.
- Publish `/llms-full.txt` or clean text abstracts strictly for verified public commercial facts—never stale drafts.
- Ensure every URL listed inside AI manifests returns 200 OK and matches canonical paths 1:1.
2. Structuring /llms.txt vs. /llms-full.txt for Deterministic Parsing
Use `/llms.txt` as a lightweight routing directory organized by H2 categories (`Solutions`, `Pricing`, `Technical Guides`) with one-line scope summaries, and use `/llms-full.txt` to expose unambiguous plain-text matrices, SLA metrics, and canonical links for deeper grounding.
# SEO Space — Canonical AI Index
> Technical SEO, AEO & GEO Engineering Agency
## Core Commercial Solutions
- [Technical SEO Audit](https://seo-space.online/solutions/technical-seo/): Crawl logs, rendering, CWV
- [Transparent Pricing](https://seo-space.online/pricing/): Fixed-scope tiers in USD & EUR 3. Synchronizing AI Manifests With Build-Time Route Truth
Generate or validate `/llms.txt` against your production route registry during CI builds so deleted articles, renamed pricing tiers, or regional restrictions never fall out of sync with live HTML.
Need this indexation setup audited on your domain?
Send your website URL. We check raw HTML parity, log crawl hits, canonical discipline, and sitemap architecture manually within 24 hours.