Short definition
llms.txt — a Markdown file at the /llms.txt address that gives language models and AI agents a short overview of a website, with links to the most important pages and a brief note for each link.
Also known as: llms txt, llms.txt file.
llms.txt is a text file in Markdown that you place at the /llms.txt address of your website. It gives language models and AI agents a short overview of your site: who you are, which pages matter, and what they cover. An agent can then find the right page quickly, without digging through menus, scripts, and layout first.
Where does llms.txt come from?
Jeremy Howard proposed the file in September 2024 on llmstxt.org. The site now hosts version 2 of the proposal. His reasoning: web pages are built for people. Navigation, ads, and JavaScript make it hard for an agent to extract the actual content. A short file in a fixed location partly solves that.
llms.txt is a proposal, not an official web standard. It is used mostly for technical documentation, where coding agents use it to find API references and tutorials. According to llmstxt.org, it can also work for a business, for example to summarize how the site is organized and its key policies.
What does an llms.txt file look like?
The file uses plain Markdown in a fixed order:
- A heading with the name of the site or project. This is the only required part.
- A blockquote with a short summary.
- Optionally, a few paragraphs of extra context, without headings.
- Sections with a subheading and a list of links, each in the form
[name](url): short note.
A section named “Optional” holds secondary links an agent can skip when space is tight. A simple example for a business website:
# Example Bakery
> Artisan bakery in Ghent with two stores and delivery to businesses.
## Services
- [Custom cakes](https://example.com/cakes): order up to two days in advance
- [Business delivery](https://example.com/business): delivery area and terms
## Optional
- [About us](https://example.com/about): history of the bakeryThe proposal goes one step further: pages can offer a clean Markdown version at the same address with .md added, and a link in the HTML can point to the llms.txt file. That part is optional.
What does llms.txt not do?
- It does not control access. Which crawlers may visit your site is set in robots.txt.
- It does not replace the sitemap. A sitemap lists every page for search engines. An llms.txt file is a short, curated selection.
- It is not a requirement for Google. According to Google’s documentation on AI features, AI Overviews and AI Mode have no additional technical requirements. A page must be indexed and eligible to appear in Google with a snippet.
- It does not guarantee a mention. Each AI system decides for itself whether to read the file and which sources to cite.
Does a small business website need llms.txt?
It is not a must, but it costs little. The file is small and does no harm as long as its content matches your pages. Some systems create it automatically: according to llmstxt.org, Yoast SEO, AIOSEO, and Wix do. Do read a generated file, though. A list of every page without any notes does little for an agent.
The basics come first. An AI assistant can only use your site if the pages are reachable, the key information is on the page as text, and your details are the same everywhere. Only then does an llms.txt file add something.
straffesites.com has its own llms.txt file. It points to our key pages, articles, and glossary terms by topic, with one sentence per link, and has a separate English section. At the top, it states that the regular pages, the structured data, and the sitemap remain the primary source. Before every release, a test checks that all articles and terms are listed, so the file does not go stale.
How it relates to other terms
llms.txt is part of generative engine optimization (GEO): building your content so AI assistants can find it and use it as a source. Where llms.txt gives an overview of the whole site, structured data describes what is on each page in a form machines can read. To see how we combine the two, read more about generative engine optimization for your website.
Reliable source and further reading
Read the full proposal at llmstxt.org.