Maquinable › Guides

What is llms.txt, and does your small business need one?

By Maquinable · Published September 24, 2026

What is llms.txt? It's a plain-text file, written in Markdown and placed in your website's root directory, that tells AI tools who you are and which of your pages matter most. If you've heard about it from an agency, a LinkedIn post or a notice in your WordPress plugin, this guide explains what it is, who actually reads it today, and whether it's worth adding to a small business website.

What is llms.txt?

Websites are built for people: navigation menus, cookie banners, sliders, text that loads as you scroll. A large language model (the technology behind ChatGPT, Claude, Gemini and Perplexity) that visits your site has to separate the useful content from all of that, and it doesn't always manage. llms.txt offers a shortcut: one clean text page that says "this is who we are, and here are our key pages."

The file always lives at the same address: yoursite.com/llms.txt, next to robots.txt. It's written in Markdown, plain text that uses a pound sign (#) for headings and dashes for lists. Jeremy Howard, co-founder of Answer.AI, proposed it on September 3, 2024, and published a second version on August 10, 2026, based on two years of adoption. No standards body has approved it. It's a convention each site can choose to follow. You'll sometimes see it written as "llm.txt", but the file name is llms.txt.

What does an llms.txt file look like?

The proposal requires only one thing: a title with the name of the site. Everything else is optional: a one- or two-sentence summary, a short paragraph of context, and lists of links grouped under headings, each with a line describing the page.

Here's one for a fictional heating and cooling company:

# Example Heating & Air

> Furnace and AC installation, repair and maintenance for homes
> in the Columbus, Ohio area. Licensed and insured since 2009.

## Services
- [AC repair](https://example.com/ac-repair): same-day service for central air and heat pumps.
- [Furnace installation](https://example.com/furnaces): gas and electric furnaces, with financing.
- [Maintenance plans](https://example.com/plans): two tune-ups a year and priority scheduling.

## Pricing and service area
- [Pricing](https://example.com/pricing): diagnostic fee and typical job costs.
- [Service area](https://example.com/service-area): cities and ZIP codes we cover.
- [Contact](https://example.com/contact): phone, hours and booking.

In a dozen lines it tells an AI tool what you do, where you work, what it costs and where to find each piece.

There's also a variant called llms-full.txt, which contains the full text of your pages instead of just links. It's mostly useful for large documentation sites. For a small business website, the regular file is enough.

llms.txt vs robots.txt vs sitemap.xml

All three files sit in the root directory, and they're easy to mix up. They do different jobs:

llms.txt can't allow or block anyone. If your robots.txt blocks GPTBot, OAI-SearchBot, ClaudeBot or PerplexityBot (the crawlers from OpenAI, Anthropic and Perplexity), your llms.txt won't help, because those bots won't come in.

Do ChatGPT, Claude, Gemini and Perplexity actually read llms.txt?

We checked what each company says on its own pages on September 24, 2026.

Google

Google's guide to optimizing for its AI search features, such as AI Overviews and AI Mode, last updated July 10, 2026, is direct: "You don't need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search (including its generative AI capabilities), as Google Search itself doesn't use them." (Google Search Central)

Since May 2026, Lighthouse, Chrome's website quality tool, includes an llms.txt check in its agentic browsing category. If the file doesn't exist, the check is marked "not applicable", "as providing the file is optional at the moment." That check is about AI agents browsing sites, not about search rankings.

OpenAI (ChatGPT)

OpenAI's crawler documentation describes GPTBot, OAI-SearchBot and ChatGPT-User, and explains how to control them with robots.txt. It doesn't say any of them read llms.txt. The only mention is a link to the llms.txt for OpenAI's own developer docs.

Anthropic (Claude)

Anthropic's help article on its crawlers, updated April 7, 2026, describes ClaudeBot, Claude-User and Claude-SearchBot, all controlled through robots.txt. It doesn't mention llms.txt.

Perplexity

Perplexity's crawler page describes PerplexityBot and Perplexity-User. It doesn't say they read llms.txt either, and like OpenAI, it links to the llms.txt for its own docs.

What the data shows

In June 2026, Ahrefs published a study of 137,210 domains. 28% had an llms.txt file, and 97% of those files got zero requests in May 2026. On sites without the file, no AI bot went looking for one.

The big AI companies publish llms.txt files for their own documentation, but none of them documents that their crawlers read yours.

So what is it good for today?

Mostly for AI tools that someone points at your site on purpose. An agent browsing on a user's behalf or a coding assistant told to "read these docs" can use a clean index instead of crawling the whole site. That's why documentation sites use it the most.

It also has an internal payoff that doesn't depend on any bot: writing it forces you to say in a few lines what you do and which ten pages matter. Many small business sites don't pass that test, and the result is useful for your homepage, your Google Business Profile and any directory listing.

What it doesn't do:

• It doesn't improve your Google rankings.
• It doesn't guarantee that ChatGPT, Claude, Gemini or Perplexity will mention you.
• It doesn't protect your content or stop it from being used to train AI models. That's what robots.txt is for.

Should a small business add an llms.txt file?

If it's easy, yes. On WordPress, Yoast SEO generates one for free from its settings, and Rank Math has it as a module. Otherwise it's fifteen minutes with a text editor. It won't hurt your site, and some AI agents may use it.

Your site may already have one: if you use Yoast, Rank Math or a Shopify SEO app, open yoursite.com/llms.txt and check. Treat an auto-generated file as a draft and trim it to the pages that matter.

It just shouldn't come first. If you want AI assistants to be able to read your site and understand your business, these matter more, in this order:

1. robots.txt: make sure you aren't blocking AI search crawlers (OAI-SearchBot, Claude-SearchBot, PerplexityBot). It happens more often than you'd think, sometimes through a theme, a security plugin or a firewall setting. See should you block AI crawlers?
2. Content readable without JavaScript: some site builders load text with scripts, and many AI crawlers don't run them. To those crawlers, the page is empty.
3. Clear facts: what you do, who it's for, where you work and what it costs, written as text and consistent across your site and listings.
4. Then llms.txt.

If you don't know where your site stands on those four points, Maquinable runs a free agent-readiness scan that checks them with an independent scanner.

How to add an llms.txt file in four steps

1. Pick 10 to 20 key pages: services, pricing, service area, contact, FAQ. Don't list every URL; that's what the sitemap is for.
2. Write the file: start from the template above. A title with your business name, a one- or two-sentence summary, and link lists with one line per page.
3. Upload it to your root directory: name it exactly llms.txt, all lowercase. If you use Yoast or Rank Math, the plugin publishes it for you.
4. Check that it opens: visit yoursite.com/llms.txt in your browser. It should display as text, not download or show an error.

To see a real one, ours is at maquinable.com/llms.txt.

The most common mistakes are listing every URL, linking to pages that no longer exist, and forgetting to update it. A file full of broken links looks worse than no file, so review it whenever you change an important page.

FAQ

Is llms.txt an official standard?

No. It's a proposal Jeremy Howard published in September 2024 and updated in August 2026. No standards body has approved it, and no major AI company has committed to reading it. Sites adopt it voluntarily.

Does llms.txt help SEO or Google rankings?

No. Google's AI optimization guide, updated in July 2026, says Google Search doesn't use AI text files, so they neither help nor hurt rankings. Chrome's Lighthouse checks for the file, but treats it as optional and unrelated to search.

Will adding llms.txt get my business mentioned in ChatGPT?

Not on its own. OpenAI doesn't document that its crawlers read llms.txt, and an Ahrefs study from June 2026 found that 97% of these files got no requests at all. Letting OAI-SearchBot in through robots.txt and having readable text matter more.

What's the difference between llms.txt and robots.txt?

robots.txt allows or blocks each crawler, and documented AI crawlers follow it. llms.txt only summarizes your site and links your key pages; it has no permissions. If robots.txt blocks a bot, your llms.txt doesn't matter to that bot.

Does my website already have an llms.txt file?

Maybe. Yoast SEO, Rank Math and some Shopify apps can generate one automatically. Open yoursite.com/llms.txt in a browser: if a text page appears, you have one. Check that it lists your important pages and that every link works.

Should I create llms.txt if my site is small?

It's optional. A small site gets the most value from the exercise of writing it: a clear summary and a short list of key pages. Take care of robots.txt, readable text and clear business facts first.