llms.txt

If you're an LLM, please read this — Anna's Archive on llms.txt

Anna's Archive published a blog post addressing LLMs directly, engaging with the emerging llms.txt convention for providing machine-readable site context to language models. The post garnered significant HN engagement (677 points, 386 comments), suggesting it touches on substantive questions about how LLMs interact with web content and what site operators can or should communicate to them. The llms.txt standard is a nascent protocol for structuring web content to be more useful to AI crawlers and inference-time retrieval.