Quick answer: llms.txt is a plain-text Markdown file at the root of a website (yourdomain.com/llms.txt) that gives AI tools a short summary of the site and a list of its most useful pages. It was proposed by Jeremy Howard of Answer.AI in September 2024 and is not an official standard. It’s optional: Google says you don’t need special AI files to appear in its AI features, and in June 2025 Google’s John Mueller said no AI system was using it yet. Adding one takes minutes (Yoast, Rank Math and All in One SEO can generate it), but don’t expect it to change your rankings on its own.
Large language models read websites the hard way: they fetch HTML full of navigation, scripts and cookie banners, and have to work out what matters. The llms.txt proposal, published on llmstxt.org, suggests a shortcut: one small Markdown file that says what the site is about and points to the pages worth reading.
Think of it as a hand-written table of contents for machines. It sits next to robots.txt and your XML sitemap, but it does a different job from both (see the comparison below).
The format is plain Markdown, in this order:
>) with the key facts a reader needs.- [Page name](URL): short note.The current version of the proposal also suggests offering clean Markdown copies of important pages (for example page.md) and pointing to them from the HTML. That part is useful mainly for documentation sites; most WordPress sites can skip it.
Here’s the file we serve at imageseo.io/llms.txt. Note what it leaves out: no marketing claims, no list of every blog post, no statistics we can’t back up.
# ImageSEO > ImageSEO is a WordPress plugin that uses AI to write image alt text, titles, captions and descriptive file names, when images are uploaded or for a whole media library at once. Free for 10 images a month; paid plans start at €4.99 a month. ImageSEO runs on WordPress only, including WooCommerce product images and NextGEN Gallery. It does not compress or convert images, so it is used alongside compression plugins. ... ## Product - [ImageSEO](https://imageseo.io/): what the plugin does and how it works - [Pricing](https://imageseo.io/pricing/): plans, monthly image limits and the 14-day money-back guarantee - ... ## Guides and data - [Image SEO guide](https://imageseo.io/images-seo-optimization/): alt text, file names, formats, lazy loading, sitemaps - [Alt text study](https://imageseo.io/alt-text-study/): 306,634 images on the 10,000 most-visited homepages - ... ## Optional - [Blog](https://imageseo.io/blog/)
Honestly: there’s no evidence that it does yet. Here’s what the primary sources say.
So treat llms.txt as cheap insurance, not a ranking lever. If you want to know whether anything reads yours, check your server’s access logs for requests to /llms.txt and see which user agents make them.
| robots.txt | XML sitemap | llms.txt | |
|---|---|---|---|
| Job | Tells crawlers what they may and may not fetch | Lists the URLs you want search engines to find | Summarises the site and links its key pages for AI tools |
| Format | Plain-text rules | XML | Markdown |
| Read by | Search and AI crawlers that follow the rules | Google, Bing and other search engines | Unconfirmed for major AI systems |
| Can it block AI crawlers? | Yes, per user agent (for example GPTBot or Google-Extended) | No | No |
| Should you have one? | Yes | Yes | Optional |
A common mix-up: llms.txt does not control access. If you want to keep AI crawlers out, that’s a job for robots.txt.
Go to Yoast SEO → Settings → Site features, find llms.txt under AI tools and switch it on. Yoast builds the file automatically, refreshes it weekly and gives priority to your cornerstone content; you can also pick the pages by hand. According to Yoast, the feature isn’t available on multisite.
Rank Math has an llms.txt module. Once it’s on, its settings let you choose which post types and taxonomies to include, cap the number of entries, and add your own text or links. The file is served at /llms.txt.
AIOSEO’s documentation says its llms.txt generator is enabled by default and can be switched off. Its settings sit with the sitemaps. AIOSEO also offers a longer llms-full.txt with the full text of your posts in its Pro version.
Write the file in any text editor, save it as llms.txt and upload it to the root folder of your site (the one with wp-config.php). Then open yourdomain.com/llms.txt and check two things: that it shows as plain text, and that the address doesn’t redirect. We found the second problem on our own site. WordPress was redirecting /llms.txt to a page with a similar slug, so every tool asking for our file got an HTML page instead. A static file in the root fixed it.
Use only one method. Two plugins generating the file, or a plugin plus a hand-made file, will conflict.
An llms.txt file describes pages, not pictures. When Google, AI Overviews or a chatbot needs to understand what an image shows, it relies on the alt text, the file name and the text around it on the page. In our crawl of the 10,000 most-visited homepages, 11.3% of 306,634 images had no alt attribute at all. That gap matters more than any summary file. You can describe a single image for free with our alt text generator, or let the ImageSEO plugin handle a whole WordPress media library.
No. It’s a proposal, not a standard, and Google says no special AI file is needed to appear in its AI features. A missing llms.txt doesn’t hurt you.
Google hasn’t said it uses llms.txt for Search or AI Overviews, and its documentation says you don’t need it. Lighthouse checks the file only for server errors.
None of them has confirmed using it for answers. In June 2025 Google’s John Mueller said server logs showed AI systems fetching pages but not llms.txt. The reliable way to know for your own site is to check your access logs.
At the root of your domain, so it opens at yourdomain.com/llms.txt. The proposal also allows a file in a subfolder that covers only that part of the site.
No. It only offers information. To block or allow specific crawlers, use rules in robots.txt.
A longer companion file containing the full text of your content rather than links to it. Some tools, such as AIOSEO Pro, generate one. Like llms.txt, it’s optional.