llms.txt

Guiding AI Models Through Your Website

Summary

llms.txt is a proposed standard for a Markdown file, placed at the root of a website, that gives large language models a concise, curated map of the site’s most important content. It was proposed in 2024 by Jeremy Howard of Answer.AI. The file helps AI tools find and understand key pages without parsing cluttered HTML, navigation and scripts.

Back

llms.txt is a plain-text Markdown file served at /llms.txt that summarizes what a website is about and links to its most useful resources. Jeremy Howard of Answer.AI proposed it in 2024 to solve a practical problem: large language models work within a limited context window, and full web pages are cluttered with navigation, cookie banners, ads and JavaScript. A short, curated file lets an AI tool grasp the essentials of a site quickly, especially when a user or agent asks about it in real time.

The proposed format is simple and human-readable:

  • An H1 heading with the name of the project or company. This is the only required section.
  • A blockquote summary with a short description containing the key information needed to understand the rest of the file.
  • Optional detail in paragraphs or lists explaining how to interpret the content.
  • Sections under H2 headings containing lists of Markdown links in the form [name](url): description, pointing to important pages or documentation.
  • An "Optional" section for secondary links that a tool can skip when it needs a shorter context.

Why llms.txt Matters

  1. Cleaner inputs for AI: Curated Markdown is easier for models to parse than complex page layouts, which can reduce misreadings and AI hallucination about your offer.
  2. Editorial control: You decide which pages represent your brand, products and pricing most accurately.
  3. Agent readiness: AI agents and coding assistants that browse on a user’s behalf can use the file as a starting point.
  4. Low cost: Creating and maintaining the file takes little effort compared with most technical SEO work.

Real-World Example of llms.txt

A B2B software company might publish an llms.txt file that opens with "# Acme Analytics", followed by a one-line blockquote describing the platform and who it serves. An H2 called "Product" lists links to the features overview, integrations and pricing pages, each with a short description. A "Docs" section links to the API reference and getting-started guide, and an "Optional" section points to the blog and case study archive. When an AI tool fetches the file, it immediately sees which pages matter and what each one covers.

How to Create an llms.txt File

Begin by choosing the pages that best explain your business: core service or product pages, pricing, documentation, key guides and contact information. Write a factual summary for the blockquote, group links under clear H2 sections and keep each description to one sentence. Serve the file as plain text at your root domain; depending on your CMS or hosting, this may require a direct file upload or a redirect to a hosted file. Some sites also publish Markdown versions of key pages.

Keep expectations realistic. llms.txt is a community proposal rather than an official web standard, AI providers decide individually whether to read it, and it is not a ranking signal in traditional search. Treat it as one inexpensive part of a broader answer engine optimization strategy, alongside structured data, crawlable content and strong pages,.

Conclusion

llms.txt gives AI systems a clean, curated summary of what your website offers and where the most important information lives. It is quick to create, easy to maintain and a sensible step for any brand that wants to be represented accurately in AI-driven discovery.

Need Help With llms.txt?

Artifact helps teams prepare their websites for AI search, from selecting and structuring the right content to publishing llms.txt files and supporting technical SEO on Webflow and custom builds. If you want AI tools to understand your brand the way you intend, we can help. Tell us about your project