What Is llms.txt?
llms.txt is a plain-text file that provides a machine-friendly summary of your website's content, purpose, and structure specifically for large language models. It is similar to robots.txt but designed for content accessibility rather than crawl control.
llms.txt Explained
The llms.txt file is a convention for providing LLM-readable information about your website. Placed at the root of your domain (e.g., yoursite.com/llms.txt), it gives AI systems a structured overview of your site's content, features, and key information without requiring them to crawl every page.
What to Include in llms.txt
- Site description - What your website or product does
- Key features - Main capabilities
- Content structure - How site is organized
- Important pages - Direct links to key content
- Author/organization info - Who is behind the content
- Usage guidelines - How AI should interact
llms.txt vs robots.txt
robots.txt controls crawl access (what AI bots can and cannot crawl). llms.txt provides content context (what your site is about and where to find key information). They serve complementary purposes. You should have both for optimal AI search readiness.
Implementation
Create a plain text file at /llms.txt on your domain. Include structured information about your site in a clear, readable format. Glippy's own llms.txt file serves as an example of this format.
Try Glippy Free
Analyze any page with 240+ checks across 10 categories. No sign-up required.