Should I add an llms.txt file to my website?

What it is

llms.txt is a Markdown file, usually at a site’s root, that summarizes the site and links key pages for AI agents. The proposal’s second version (August 2026) also allows files at sub-paths and suggests Markdown copies of key pages.

How it works

1. Decide whether you have content that tools would benefit from, such as product docs or a large knowledge base.
2. If yes, write a short summary and a curated link list following llmstxt.org. Some documentation platforms generate one automatically.
3. Spend more effort on fundamentals first: crawlability, clear pages and accessible HTML.
4. Revisit if major engines document support.

Benefits

• Low cost, low risk.
• A useful map for developer and agent tools. The proposal says that’s where it’s used most.
• Forces a clear inventory of important pages.

Limits and risks

• No confirmed support. We found no major engine documenting that it reads llms.txt to rank or cite sites (checked 2026-10-17). The proposal notes that AI labs publish llms.txt files for their own docs, which isn’t the same thing.
• Not needed for Google. Google explicitly says it isn’t needed for its AI features.
• Upkeep. It must be kept in sync with the site.