Glossary · Machine files

machine layer

Everything a site serves to non-human clients: robots.txt, sitemaps, llms.txt, agents.md, entity maps, structured data and response headers. A site can look finished to a visitor and be nearly empty at this layer.

Terms this definition uses

robots.txt · Sitemap · llms.txt · agents.md · entity map · structured data

Machine files

The files addressed to machines rather than readers, and what publishing one does and does not buy.

llms.txt · llms-full.txt · agents.md · entity map · entity map parity · well-known URI · MCP · agent card · sitemap index · OpenAPI specification · ai.txt · Tool definition · SKILL.md · sitemap origin error · soft 404 on a machine file · tdmrep.json · TDM exception · security.txt

← entity map parity  ·  well-known URI →

See it in the full glossary · 579 terms across 19 areas. Scan a site to see which of these apply to it.