llms.txt: What It Is, Who Reads It, and Whether You Need One


llms.txt is a plain Markdown file at the root of your site, next to robots.txt, that gives an AI agent a curated map of what your site is and where the important pages are. Proposed in late 2024, it was meant to solve a real problem: an agent landing on a site full of navigation, cookie banners, and marketing chrome has to spend a lot of tokens figuring out which three pages matter. The file says "here are the three pages."

Then the hype cycle did what hype cycles do, and by 2025 you could buy llms.txt generators, llms.txt audits, and llms.txt "optimization." So let's separate what's true from what's sold.

Who Actually Reads It

Google does not. Its AI optimization guidance published in May 2026 says the file is unnecessary for AI Overviews and AI Mode, and John Mueller has compared it to the keywords meta tag: nobody's bots request it. If your only goal is Google's AI surfaces, you can stop reading.

Anthropic recommends it in its guidance for making sites usable by agents, on the reasoning that it helps an agent find canonical pages without crawling everything. OpenAI publishes llms.txt files for its own developer documentation, which tells you it considers the format legitimate for agent workflows even though it has never said ChatGPT search uses it. Perplexity has been observed pulling llms.txt content directly. Adoption sits somewhere in the tens of thousands of sites globally, which is real but small.

The honest summary: no evidence that it improves citations in mainstream AI search today, some evidence that agents doing tasks on your behalf (not answering questions about you, but acting for a user who is on your site) use it.

Whether You Need One

If you run developer documentation, an API, or a product that agents will interact with directly, yes, and make it thorough.

If you run a service business with a site under a few hundred pages, it costs ten minutes and does no harm, so ship a small one. The value isn't a ranking lift. It's that the act of writing it forces you to answer, in one paragraph, what your business is and which pages matter most. If you struggle to write that paragraph, you have found a bigger problem than llms.txt.

What you should not do is pay for it, buy a plugin for it, or let anyone tell you it's why you're not being recommended.

The Ten-Minute Version

# Get Me Automated

> Custom PHP development, business automation, and AI search
> optimization agency in Winter Springs, Florida, serving small
> businesses across Central Florida and remote clients nationwide.

## Services
- [AI Search Optimization](https://getmeautomated.com/ai-search-optimization/): get cited by ChatGPT, Gemini, Perplexity
- [AI Agents & Automation](https://getmeautomated.com/ai-agents/): custom agents and workflow automation
- [Web Development](https://getmeautomated.com/web-development/): hand-coded sites that load in under a second

## About
- [About](https://getmeautomated.com/about/)
- [Contact](https://getmeautomated.com/contact-us/)

That's the whole thing. Save it as llms.txt in your web root, make sure it returns as text/plain or text/markdown, and move on to the things that actually move citations: structured data, consistent entity facts, and content specific enough to be quoted.

Have a project in mind?

15-minute call. No sales pitch. We'll tell you straight what's worth building.

Book the call →