llms.txt: What It Is and Whether Your Business Needs One

Every so often a new file appears that the internet decides you urgently need. Usually the honest answer is “probably not yet”. llms.txt is a rare case where the answer is closer to “yes, and it takes about ten minutes”.

It is also widely misunderstood. It is not a magic switch that gets you into ChatGPT, and it will not rescue a site that has nothing worth citing. What it does is much narrower and much more useful than the hype suggests.

What llms.txt Actually Is

It is a plain text file, written in markdown, that sits at the root of your domain. Yours would live at yoursite.co.uk/llms.txt. Anyone can open it, including you.

Inside, it does something simple: it names your business, says what you do in a sentence or two, and lists the pages that genuinely matter with a short description of each. Services, key articles, contact details, the answers you want quoted.

The idea, set out at llmstxt.org, is that a language model arriving at your site has a limited budget for reading and no reliable way to tell your cornerstone service page from a 2019 post about your office move. An llms.txt file is you doing that sorting yourself rather than hoping the machine guesses correctly.

That is genuinely the whole concept. It is a curated table of contents, written for machines, maintained by you.

How It Differs From robots.txt

People conflate these two constantly and they do close to opposite jobs.

robots.txt is a bouncer. It says who may not come in. It is about restriction, and it has been a web standard for decades, respected by well-behaved crawlers.

llms.txt is a concierge. It says, for those who are coming in anyway, here is what is worth your time. It is about direction rather than permission.

They are not alternatives. If you want to control whether AI crawlers can access your site at all, that remains a robots.txt job. If you want to shape what they understand once they are there, that is what llms.txt is for. Adding one does not grant access to anything that was previously blocked, and it does not block anything either.

Does Anything Actually Read It?

Here is where I will be straight with you, because a lot of writing on this subject will not be.

llms.txt is a proposed convention, not an enforced standard. No major AI company has committed publicly to honouring it in the way search engines committed to robots.txt or to sitemaps. Anybody telling you that adding one guarantees inclusion in AI answers is selling something.

What is true is that it costs very little, it cannot hurt you, and adoption is growing on the publishing side. The asymmetry is the argument: a ten minute job with a small chance of a real payoff and essentially no downside is worth doing, provided you understand which of those you are buying.

I would not reorder your priorities for it. If your opening hours are inconsistent across the web, or your services page does not answer the questions customers actually ask, fix those first. Those affect what machines say about you today, regardless of any file.

How to Add One in Ten Minutes

If you are on WordPress with Rank Math, there is a module for it. Rank Math, then Dashboard, find LLMS Txt in the module list and switch it on. It builds the file from your existing pages and posts, descriptions included. If it returns a 404 immediately afterwards, save your permalinks once and it will appear.

Yoast and several other plugins have equivalents. If you are not on WordPress, or you would rather control it precisely, write it yourself. It is a text file, and the format is deliberately forgiving:

• Start with your name and one line on what you do. Plainly. This is the sentence you would want quoted back at a customer.
• List your genuinely important pages. Services, pricing if it is public, contact, your best three or four articles. Each with a short description of what it contains, not a marketing line.
• Link your sitemap. One line, so anything reading the file can find everything else.
• Leave out the noise. Tag archives, thin pages, old announcements. The value of an llms.txt file is entirely in what you choose to exclude.

Then check it loads at yoursite.co.uk/llms.txt and read it as if you were a stranger. If the descriptions are vague, so is the impression it gives.

Set a reminder to revisit it twice a year. A file listing services you stopped offering is worse than not having one, which is the same maintenance problem that catches people out with schema markup.

Whether It Is Worth Your Time

My honest position, having added one to this site: yes, but not for the reason usually given.

The direct benefit is speculative, because adoption is not guaranteed. The indirect benefit is not speculative at all. Writing an llms.txt file forces you to sit down and answer a question most owners have never answered explicitly: which ten pages on my site actually matter, and what does each one say?

Most people find that exercise uncomfortable, because it surfaces that half their site is filler and their most important page has a description nobody would quote. That discovery is worth more than the file.

So treat it as ten minutes of cheap insurance that also doubles as a content audit. Do it after your facts are consistent and your key questions are answered, not instead of those, and revisit it when your business changes rather than when somebody writes another article about it.

The Takeaway

llms.txt is a small, cheap, sensible thing to add, and an unreliable thing to depend on. Both of those are true at once, and most writing on the subject picks one and ignores the other.

Add one. Keep it short and honest. Revisit it twice a year. Then go and spend your actual effort on the things that demonstrably move AI visibility today: consistent facts, detailed reviews, and pages that answer the questions your customers really ask.

If you would rather have all of that audited and tracked properly rather than guessed at, that is the kind of thing The GEO Agency handles, and you can book a dashboard demo to see how it is measured month to month.

Ayse Durmush

AI Visibility Expert & Global Business Consultant

Ayse has spent three decades transforming strategy, lead generation and operations for businesses of every size, and has consulted for high profile global brands. She writes about AI visibility, mindset and building a business that can survive its founder.

More about AyseWork with Ayse one to oneAll articles

Keep reading

BusinessWhat to Review Before September StartsBusinessThe Trust Signals AI Looks For Before Recommending YouBusinessWhy AI Assistants Disagree About Your Business