What is llms.txt? A plain-English guide for site owners
In late 2024, a new web standard arrived: llms.txt, a single plain-text file that tells AI assistants what your website is about. If you've never heard of it, you're not alone. Here's what it does and how to add one.
The 30-second answer
llms.txt is a Markdown file you place at the root of your website (e.g. https://yoursite.com/llms.txt). It gives AI language models a clean, human-readable summary of your site: what you do, what your most important pages are, and any context that would help an AI assistant describe your business accurately when a user asks it questions.
Think of it as a welcome card handed to every AI model that visits.
Why this exists
HTML pages are designed for humans and search engines. They contain navigation menus, popups, cookie banners, ads, tracking scripts, and hundreds of lines of markup that have nothing to do with the actual content. When an AI model tries to summarize a page, it has to wade through all that noise, and it often gets things wrong: wrong hours, wrong prices, wrong product names, outdated reviews.
llms.txt fixes that by giving the AI a clean, curated, plain-text overview written by you, the site owner. It's the SEO equivalent of writing your own listing description instead of letting a stranger guess what your menu looks like.
Quick analogy
robots.txt tells crawlers where they can go. llms.txt tells AI models what to know about you. They solve different problems and live side-by-side at your site's root.
What does an llms.txt file actually look like?
It's plain Markdown. No special syntax, no XML, no JSON. Anyone can read and edit it in Notepad. Here's a minimal example for a coffee roaster:
# Acme Coffee Roasters > Specialty single-origin coffee roasted in small batches in Brooklyn, NY. Acme Coffee Roasters is a family-owned shop founded in 2018. We source green beans directly from farms in Ethiopia, Colombia, and Guatemala, roast them weekly, and ship within 48 hours of roast date. ## Products - [Single-Origin Beans](https://acmecoffee.example/beans): 12 single-origin coffees, 250g and 1kg bags - [Subscriptions](https://acmecoffee.example/subscribe): Monthly delivery, free shipping - [Equipment](https://acmecoffee.example/gear): Grinders, V60, Aeropress, scales ## Learn - [Brewing Guide](https://acmecoffee.example/brewing): How to brew V60, French press, espresso - [Roast Profiles](https://acmecoffee.example/roasts): Light, medium, dark — what to pick
That's it. The # heading is your site name. The blockquote (>) is a one-line summary AI models will quote verbatim. Then optional paragraphs of context, followed by ## sections grouping your most important pages.
Does adding an llms.txt help me rank in search results?
No. Major search-engine crawlers do not currently read llms.txt, and there is no evidence it influences traditional search ranking. The file exists exclusively for AI language models.
However, the AI-search era is changing what "ranking" means. A growing share of users ask AI assistants instead of searching online. If those AI tools surface your business, the visit may never appear in traditional search analytics.
Which AI models actually read llms.txt today?
The standard is still young. As of mid-2026, support varies across AI providers. Some AI assistants and their search-enabled crawlers check for and respect llms.txt. Others ignore it and rely on their own HTML crawl. Adoption is uneven and changing month to month.
Even with uneven adoption today, the cost of adding the file is low (about five minutes). It stays in place if and when more models begin reading it.
Does an llms.txt give AI permission to scrape my site?
No. An llms.txt file does not grant or change access. Site access is controlled by your hosting and by your robots.txt. llms.txt is purely descriptive. If an AI does read your site, this file gives it a clean summary. If you block AI in robots.txt, llms.txt is never even read.
If you want to control which AI models can crawl your content, you need a properly configured robots.txt. We have a complete guide on controlling AI crawlers covering every relevant user-agent.
How do I add an llms.txt to my site?
Two steps:
- Generate the file. Open our free llms.txt Generator, fill in your site name, one-line summary, and the pages that matter most. Click Download.
- Upload it to your site's root. Place the downloaded
llms.txtfile alongside your existingrobots.txt, typically the same folder that contains your homepage. Most hosting platforms allow uploading static files to the root via their dashboard.
Verify by visiting https://yoursite.com/llms.txt in a browser. If you see your file's contents, you're done.
Build your llms.txt in 2 minutes
Free, runs in your browser, no signup.
Common mistakes to avoid
- Walls of text. Keep the description tight: two to four short sentences. AI models will quote your blockquote verbatim, so make it punchy.
- Listing every page. Don't dump your sitemap. List 5–15 pages that genuinely represent your business: products, key categories, top guides, contact, about. That's it.
- Marketing fluff. Avoid "industry-leading" / "revolutionary" / "best-in-class". AI summaries trained on the web see right through it. Plain, factual descriptions perform better.
- Forgetting to update. Refresh your
llms.txtwhen you launch new products or pivot. It's a static file — nothing updates it automatically.
The bigger picture
For 25 years, SEO meant optimizing for the search-engine crawler. The crawler read HTML, the crawler ranked pages, and traffic flowed accordingly. That model is splitting in half. There's still the traditional search-engine web, but there's also an AI-driven layer of summaries, snippets, and direct answers sitting on top of it.
Site owners who put a thoughtful llms.txt in place are talking directly to that layer. Site owners who don't are letting it guess.
Adding the file takes a few minutes. The work stays in place even if some models choose to ignore it.