CrawlCheck
Glossary · Machine files

agents.md

A markdown instruction file addressed to autonomous agents rather than crawlers, stating what a site does, what an agent may collect, and what it must never assert.

What agents.md does not show

Most files served at this path are platform defaults rather than anything the site owner wrote.

Where agents.md comes up on this site

Definitions that name agents.md

machine layer · security.txt

Related terms in Machine files

The files addressed to machines rather than readers, and what publishing one does and does not buy.

llms.txt · llms-full.txt · entity map · entity map parity · machine layer · well-known URI · MCP · agent card · sitemap index · OpenAPI specification · ai.txt · Tool definition · SKILL.md · sitemap origin error · soft 404 on a machine file · tdmrep.json · TDM exception · security.txt · Content Signals · HTTP Message Signatures · changefreq and priority · staging leak · host duplicate

Questions about agents.md

What is agents.md?

A markdown instruction file addressed to autonomous agents rather than crawlers, stating what a site does, what an agent may collect, and what it must never assert.

What does agents.md not show or guarantee?

A markdown instruction file addressed to autonomous agents rather than crawlers, stating what a site does, what an agent may collect, and what it must never assert. Most files served at this path are platform defaults rather than anything the site owner wrote.

Which area of the glossary does agents.md belong to?

Machine files: The files addressed to machines rather than readers, and what publishing one does and does not buy.

← llms-full.txt  ·  entity map →

See it in the full glossary · 731 terms across 19 areas.