mediumBest Practices

AI Search: No /llms.txt File Found

No llms.txt file found at /llms.txt; this file guides AI search engines on which content to ingest and cite.

By Seoxpert Editorial · Published May 1, 2026

Why it matters

Without llms.txt, AI search engines may crawl and summarize outdated, irrelevant, or duplicate pages, reducing your control over how your site is represented in AI-driven results. Providing this file helps ensure only your most important and up-to-date content is cited and summarized by AI tools.

Impact

AI search engines may index and cite non-canonical or outdated pages, diminishing content accuracy and authority.

How it's detected

Automated crawlers check for the presence of /llms.txt and report an issue if a 404 or missing file is detected.

Common causes

•Site owner is unaware of the llms.txt convention.
•No process in place to curate AI-accessible content.
•File was not deployed to the site root directory.
•Incorrect file naming or path (e.g., /LLMS.txt or /llms/llms.txt).

How to fix it

Create a plain-text llms.txt file at your site's root. Follow the emerging specification: start with a # H1 for the site name, a > blockquote for a one-sentence positioning statement, an optional summary, then ## section headings with bullet lists of canonical URLs and brief descriptions. Reference https://llmstxt.org for details. Include only your most important, canonical pages.

Code examples

Example llms.txt file

# ExampleSite
> The go-to resource for modern web development tutorials.

Our mission is to provide clear, actionable guides for developers of all levels.

## Documentation
- https://examplesite.com/docs/getting-started: Quickstart guide for new users.
- https://examplesite.com/docs/api: Complete API reference.

## Blog
- https://examplesite.com/blog/ai-search-best-practices: Best practices for optimizing sites for AI search.

FAQ

What is llms.txt and why do I need it?

llms.txt is a new convention that lets you specify which pages AI search engines should ingest and cite, giving you more control over your site's representation in AI results.

Where should I place the llms.txt file?

Place it at the root of your domain, so it is accessible at https://yourdomain.com/llms.txt.

What should I include in llms.txt?

Include your site's name, a brief positioning statement, an optional summary, and curated lists of canonical URLs with short descriptions.

Is llms.txt required for traditional search engines?

No, it is currently intended for AI search engines and LLMs, not traditional search crawlers like Googlebot.

Found this issue on your site?

Run a scan to see if AI Search: No /llms.txt File Found affects your pages.

Scan my website →