Content type
The declared media type describing how a response body should be interpreted.
What Content type means
A correct header can accompany invalid content, and an incorrect header can hide a valid payload from parsers.
Where Content type comes up on this site
- Is Cloudflare blocking AI crawlers on your site?How do you check your own zone? curl -sI https://yoursite.com/robots.txt | grep -i 'content-type\|cf-cache-status\|age' The content type must be text/plain ; anything else means something is answering in place of your file.
- How to check if AI crawlers can read your siteRead the content type, not the status code.
- How to rank in ChatGPT: the part that is in your controlCheck it: fetch your robots.txt at the bare URL and read the content type, not just the status.
- Do AI crawlers and agents respect robots.txt?Check the content type, not the status: it must be text/plain .
- How to write an llms.txt and check it is actually servedFetch it from outside on both the apex and www , and read the status, content type and first line.
Definitions that name Content type
Related terms in HTTP, edge and rendering
The delivery layer between an origin and a client: proxies, caches, redirects, status codes and the headers that decide what a crawler actually received.
Content-Language header · HTTP/3 · Alt-Svc · HTTPS DNS record · Link header · content negotiation · Markdown negotiation · Retry-After · Server-Timing · WWW-Authenticate · Allow header · Content-Digest · Origin server · Reverse proxy · CDN · Edge node · WAF · Bot score · TLS handshake · DNS resolution · DNS timeout · Connection timeout · Read timeout · Redirect chain · Redirect loop · 301 redirect · 302 redirect · 307 redirect · 308 redirect · 304 response · 404 response · 410 response · 429 response · 500 response · 502 response · 503 response · 504 response · HEAD request · GET request · MIME sniffing · Content encoding · Compression · Brotli · ETag · Last-Modified · If-None-Match · Cache hit · Cache miss · Cache key · Vary header · Stale response · Stale-while-revalidate · Edge redirect · Origin bypass · Response parity · Header parity · hreflang · canonical URL · HSTS · HSTS preload list · Content-Security-Policy · CSP nonce · edge cache · cache split · cache-buster · Cache-Control · Age header · render-blocking resource · payload text share · lazy loading · 404 and 410 status codes
Questions about Content type
What is Content type?
The declared media type describing how a response body should be interpreted.
Which area of the glossary does Content type belong to?
HTTP, edge and rendering: The delivery layer between an origin and a client: proxies, caches, redirects, status codes and the headers that decide what a crawler actually received.
← GET request · MIME sniffing →
See it in the full glossary · 772 terms across 19 areas.
Free browser extension
See this on any site you visit, in one click.
CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.