CrawlCheck Skip to content

Menu

For agents

The door: what an agent should know before it acts on a site

Quickstart: ask before you act

MCP, curl, Python, OpenAI Agents, Claude tool use, LangChain

The signed answer about any domain, laid out for a person

How each named agent behaves on sites, from verified requests

Capability registry

What sites declare agents can do, and what was verified

Verify a record

Check any answer or bundle on your own machine

Before you act

One signed answer, no key.

Read, cite, connect or transact: ask first, verify the receipt offline, keep it with the action.

Start in a minute

For sites

The door: scan free, have it fixed, keep it fixed

The checks behind the audit, one at a time

Is your business record right where agents look?

Compare two sites

Two domains, side by side, same measurement

What search and answer engines read from a video

Browser extension

The second vantage point: from your own address, after JavaScript

The record on your phone, with receipts

Your site

Measured as agents see it.

A free A–F audit with every defect named, no account. Fix it, then prove it held.

Developers

The door: the API by lane, the specs, SDKs, keys and quotas

Every endpoint, with a worked example from production

Resolve protocol

The signed answer: what it holds, how to verify it

SDKs: npm and PyPI

Typed clients, the offline verifier, conformance fixtures

The Ed25519 keys every answer is signed with

Every finding the measurement can raise, with its revision

Run the suite against your own implementation

Data

The door: census, conduct, proof and datasets, each with a denominator

Signed decisions, scans and crawler visits, counted

Proof and timestamps

How every record is sealed and anchored

CC BY 4.0 snapshots and the archive

SEO and AI tools, measured

The vendors that measure sites, measured by the same rules

Registry: media kits, llms.txt, entity graphs

Verified machine-readable profiles of real organisations

Learn

The door: guides, findings and the glossary, from measurements

The scan, stage by stage, and what each grade means

How to check one thing, with the rate at which it fails

Dated cases from real scans, with the bytes behind them

Every term the product uses, defined

Who sends each agent, what it reads, how to verify it

Pricing Sign in

Glossary · Machine files

tdmrep.json

A JSON file at /.well-known/tdmrep.json, defined by the TDM Reservation Protocol from a W3C community group, not a W3C standard. It carries tdm-reservation, a flag stating that text-and-data-mining rights are reserved, and tdm-policy, a link to an ODRL document describing terms.

What tdmrep.json means

It communicates a legal position under the EU text-and-data-mining exception to operators who read it.

What tdmrep.json does not show

By itself it enforces nothing, and CrawlCheck records its presence without treating it as a block, for the same reason it does not treat ai.txt or Content-Signal as one.

Terms this definition uses

ai.txt · Content-Signal

Definitions that name tdmrep.json

Related terms in Machine files

The files addressed to machines rather than readers, and what publishing one does and does not buy.

llms.txt · llms-full.txt · agents.md · entity map · entity map parity · machine layer · well-known URI · MCP · agent card · sitemap index · OpenAPI specification · ai.txt · Tool definition · SKILL.md · sitemap origin error · soft 404 on a machine file · TDM exception · security.txt · Content Signals · HTTP Message Signatures · changefreq and priority · staging leak · host duplicate

Questions about tdmrep.json

What is tdmrep.json?

A JSON file at /.well-known/tdmrep.json, defined by the TDM Reservation Protocol from a W3C community group, not a W3C standard. It carries tdm-reservation, a flag stating that text-and-data-mining rights are reserved, and tdm-policy, a link to an ODRL document describing terms.

What does tdmrep.json not show or guarantee?

A JSON file at /.well-known/tdmrep.json, defined by the TDM Reservation Protocol from a W3C community group, not a W3C standard. By itself it enforces nothing, and CrawlCheck records its presence without treating it as a block, for the same reason it does not treat ai.txt or Content-Signal as one.

Which area of the glossary does tdmrep.json belong to?

Machine files: The files addressed to machines rather than readers, and what publishing one does and does not buy.

← soft 404 on a machine file · TDM exception →

See it in the full glossary · 731 terms across 19 areas.