CrawlCheck

Glossary · Machine files

ai.txt

A proposed file for declaring how AI systems may use a site content, in the same family as llms.txt and Content Signals. Informal proposal, not an enforced standard, and adoption is low enough that absence tells you nothing.

Terms this definition uses

llms.txt

Machine files

The files addressed to machines rather than readers, and what publishing one does and does not buy.

llms.txt · llms-full.txt · agents.md · entity map · entity map parity · machine layer · well-known URI · MCP · agent card · sitemap index · OpenAPI specification · Tool definition · SKILL.md · sitemap origin error · soft 404 on a machine file · tdmrep.json · TDM exception · security.txt

OpenAPI specification  ·  Tool definition

See it in the full glossary · 579 terms across 19 areas. Scan a site to see which of these apply to it.