Author · VSNARY

# VSNARY | Emmanuel Orta

In one sentence

CrawlCheck is built by Emmanuel Orta (creator name VSNARY) for VSNARY as the verification layer AI agents read before they act on a website; the local service sites he runs are measured by the same layer, every guide and findings post on this site is written by him from measurements that can be repeated, the pieces that document his own mistakes are listed on purpose, and this page lists all of them with the dates they were published and updated.

I build CrawlCheck, the verification layer for the agentic web, and I write everything published here. VSNARY is my creator name; Emmanuel Orta is my birth name. The sites I run are measured by the same layer every agent reads before it acts on them.

Outside this site I keep a reptile and invertebrate collection and publish photographs of it to Wikimedia Commons under [User:Vsnary](https://commons.wikimedia.org/wiki/User:Vsnary), each under its own free licence: CC BY 4.0, CC BY-SA 4.0 or CC0. On 9 September 2026 I published [the first photograph of a Gonatodes daudini hatchling](https://commons.wikimedia.org/wiki/File:Gonatodes_daudini_hatchling_(captive-bred,_Terrarium_Station).jpg) recorded on Wikimedia Commons, Wikidata, iNaturalist or GBIF — a Critically Endangered gecko. It is now the species’ juvenile image on Wikidata and in the English and Cebuano Wikipedia articles.
One Person `@id`, declared on emmanuelorta.com and reused here rather than re-declared. The profiles on the left are the node’s sameAs; the entities on the right each carry their own identifier on their own site; the files underneath publish the same node. The graph is drawn from the same constants as the page’s JSON-LD, so it cannot disagree with it.

**108**findings published

**67**guides

**792**glossary terms

**162,878**words, all from measurements

First piece 2026-08-13 · latest 2026-11-21 · every figure on this page is recomputed from the post registry when the page is opened. Where I got it wrong → · Guides → · Findings → · What I operate →

Method

## How the writing is done

Three rules, applied to every piece on this page. The two figures are computed from the post registry on every load.

1
Measure

Every piece starts as a measurement the verification layer took: access logs, crawler identities, machine files, structured data, signed answers. Nothing is published that cannot be measured again.

2
Date it or compute it

A number is either recomputed from the record when the page is opened, or dated to the day it was read. The figures on this page are the first kind.

3
Correct in place

Where a piece got something wrong, the correction is published in the piece, dated, rather than edited out. The 22 pieces about our own mistakes are listed below on purpose.

Pieces published per week, 2026-08-13 to today — computed from the post registry on every load

What the writing keeps coming back to — glossary terms named by the most pieces

Newest

## Latest

The six most recent pieces, whatever kind they are.

- 2026-11-21 · Finding [A staff login could read visitor IP addresses. We closed it.](/blog/a-staff-login-could-read-full-visitor-addresses-we-closed-it)
A CrawlCheck staff login could read full visitor IP addresses in three admin views. Staff now see the network only; here is the fix and what audits caught.

- 2026-11-20 · Guide [How to tell a real AI crawler from one borrowing its name](/guides/how-to-tell-a-real-ai-crawler-from-one-borrowing-its-name)
Any request can call itself an AI crawler. Here is how to check the name against the source: reverse DNS, published address lists and signed requests.

- 2026-11-19 · Correction [Who reads llms.txt? Our check called 8 of 10 unverified](/blog/our-llms-txt-reader-check-called-8-of-10-readers-unverified)
Our llms.txt reader check called 8 of 10 readers 'unverified' and counted our own fetches. Now every reader shows its kind of network and country.

- 2026-11-18 · Finding ["20 years of experience": the site's own records said 13](/blog/a-site-said-20-years-of-experience-its-own-records-said-13)
A contractor site claimed 20 years of experience; its Google profile opening date made it 13. The claim was on 6 pages in 3 different forms.

- 2026-11-18 · Finding [The quote form was the slow part: 980 ms cut to 50 ms](/blog/the-quote-form-was-the-slow-part-980-ms-to-50)
A home page froze for 980 ms on load. 16 of the 18 slow tasks were the quote form and its captcha. Loading the form on first touch cut it to 50 ms.

- 2026-11-15 · Guide [People-search opt-outs: 7 sites tested, every step](/guides/people-search-opt-out-seven-sites-tested)
We tried to remove one person from seven people-search sites. All seven listed them, and every opt-out needed a captcha, a phone call or an email link.

Portfolio

## What I operate

The 4 entities on the right of the graph above, each with the identifier it answers to. CrawlCheck is one of them; my own sites are the test subjects in the guides, so every number can be reproduced by anyone who asks for the domain’s [signed answer](/docs/api#act) or runs the free audit. No post names a scanned third-party domain before its owner has been contacted. The full register, re-checked hourly, is at [emmanuelorta.com](https://emmanuelorta.com).

Kind Entity Canonical @id

Software [CrawlCheck](https://crawlcheck.io/)`crawlcheck.io/#org`

Register [The Credential Record](https://credentialrecord.com/)`credentialrecord.com/#org`

Commerce [Terrarium Station](https://terrariumstation.com/)`terrariumstation.com/#organization`

Registry [SpeciesVault](https://terrariumstation.com/nature-database)`terrariumstation.com/nature-database#speciesvault`

Corrections

## Where I got it wrong

22 pieces document a mistake of ours, what it cost, and the rule that stops it recurring. A layer that signs verdicts about other people’s sites owes its readers the same standard.

- 2026-11-19 [Who reads llms.txt? Our check called 8 of 10 unverified](/blog/our-llms-txt-reader-check-called-8-of-10-readers-unverified)
- 2026-11-13 [Both our SDKs cut a tool list at 300 with no warning](/blog/our-sdks-cut-a-tool-list-at-300-with-no-warning)
- 2026-11-13 [Our mirror relayed real crawlers and inflated forgery counts](/blog/our-mirror-relayed-real-crawlers-and-inflated-our-forgery-counts)
- 2026-11-06 [Our AI accuracy check ran for six days and measured nothing](/blog/our-ai-accuracy-check-ran-for-six-days-and-measured-nothing)
- 2026-11-06 [Our crawler counts missed about 45% of hits](/blog/our-crawler-counts-missed-45-percent-of-hits)
- 2026-10-22 · updated 2026-11-02 [Our receipt checker would have rejected our own receipts](/blog/our-receipt-checker-would-have-rejected-our-own-receipts)
- 2026-09-30 · updated 2026-11-02 [Our security headers skipped every signed-in session](/blog/our-security-headers-skipped-every-signed-in-session)
- 2026-09-23 · updated 2026-11-02 [Sites measured is not people: what our own logs showed](/blog/our-homepage-says-6557-sites-measured-six-people-ran-a-scan-this-week)
- 2026-09-20 · updated 2026-11-02 [Linked from every page, our llms.txt was fetched 8 times](/blog/our-llms-txt-is-linked-from-every-page-crawlers-fetch-it-like-a-blog-post)
- 2026-09-09 · updated 2026-11-02 [Lazy-load placeholders: why image checks miss your photos](/blog/our-scanner-counted-placeholders-not-photographs)
- 2026-09-08 · updated 2026-11-02 [OpenTimestamps proof says pending? Upgrade the receipt](/blog/our-proofs-said-pending-for-26-days)
- 2026-09-01 · updated 2026-11-02 [Seven site types, and the report checks we corrected](/blog/we-read-every-scored-row-against-seven-sites-here-is-what-we-unscored)
- 2026-09-01 · updated 2026-11-02 [A placeholder check flagged NaN. It was inside a URL](/blog/nan-inside-a-url-slug-a-placeholder-check-that-accused-a-newspaper)
- 2026-09-01 · updated 2026-11-02 [Dead link or blind spot? When a checker's failure is its own](/blog/the-scanner-that-cannot-fetch-its-own-host)
- 2026-08-29 · updated 2026-11-02 [www and non-www both return 200? A canonical won't fix it](/blog/our-canonical-was-right-and-the-site-was-still-served-twice)
- 2026-08-27 · updated 2026-11-02 [Google's /goto redirect: why referrer data can't show it](/blog/we-clicked-a-real-google-result-to-test-the-goto-redirect)
- 2026-08-26 · updated 2026-11-02 [Our audit labelled one page and measured another for weeks](/blog/our-audit-labelled-one-page-and-measured-another)
- 2026-08-21 · updated 2026-11-02 [Analytics added 650 ms to every request: how we found it](/blog/our-analytics-was-adding-650ms-to-every-request)
- 2026-08-21 · updated 2026-11-02 [A save that returned success rewrote every newline](/blog/a-write-that-returned-success-and-corrupted-every-newline)
- 2026-08-19 · updated 2026-11-02 [AI visibility vendors audited: 11 of 23 have llms.txt](/blog/we-scanned-the-tools-that-audit-your-site)
- 2026-08-19 · updated 2026-11-02 [Is your host blocking ClaudeBot? Group the 403s by IP first](/blog/we-almost-published-that-our-host-was-blocking-claude)
- 2026-08-18 · updated 2026-11-02 [When an LLM summarises your audit report and gets it wrong](/blog/the-grade-that-could-not-explain-itself)

Guides

## 67 guides

Long-form, each one built around a measurement you can repeat. Newest first, by month.

- November 2026
- 2026-11-20 [How to tell a real AI crawler from one borrowing its name](/guides/how-to-tell-a-real-ai-crawler-from-one-borrowing-its-name)
- 2026-11-15 [People-search opt-outs: 7 sites tested, every step](/guides/people-search-opt-out-seven-sites-tested)
- 2026-11-13 [Why a robots.txt allow list cancels your Disallow rules](/guides/robots-txt-allow-list-cancels-your-disallow-rules)
- 2026-11-13 [Block AI crawlers in nginx, Apache and Caddy (tested)](/guides/block-ai-crawlers-nginx-apache-caddy)
- 2026-11-13 [robots.txt and AI fetchers: what seven operators say](/guides/robots-txt-does-not-stop-user-triggered-ai-fetchers)
- October 2026
- 2026-10-26 · updated 2026-11-02 [Google-Extended and Applebot-Extended: block AI training](/guides/google-extended-and-applebot-extended-opt-out-of-ai-training-keep-search)
- 2026-10-22 · updated 2026-11-02 [Did your SEO fix work? Compare fixed and untouched pages](/guides/how-to-tell-if-a-website-fix-moved-traffic-fixed-vs-untouched-pages)
- 2026-10-18 · updated 2026-11-02 [How to check if your website supports HTTP/3](/guides/http-3-how-to-check-whether-your-site-offers-it)
- 2026-10-18 · updated 2026-11-02 [How to verify Amazonbot and Amzn-SearchBot by IP address](/guides/how-to-verify-amazonbot-and-amzn-searchbot)
- 2026-10-18 · updated 2026-11-02 [Crawl budget: measure what a crawler reads in 50 fetches](/guides/crawl-budget-how-much-of-your-site-a-crawler-reads-in-50-fetches)
- 2026-10-15 · updated 2026-11-02 [How to get your local business recommended by AI](/guides/how-to-get-your-local-business-recommended-by-ai-assistants)
- 2026-10-09 · updated 2026-11-02 [How an AI agent should verify a website before it acts](/guides/how-an-ai-agent-verifies-a-website-before-it-acts)
- 2026-10-08 · updated 2026-11-02 [Can an AI agent use your contact form? A two-minute test](/guides/can-an-ai-agent-use-your-contact-form)
- 2026-10-08 · updated 2026-11-02 [How to check an MCP server is safe before an agent connects](/guides/how-to-check-an-mcp-server-before-an-agent-connects)
- 2026-10-08 · updated 2026-11-02 [What is the agentic web? What it means for your website](/guides/what-the-agentic-web-means-for-a-site-owner)
- 2026-10-03 [AI crawler monitoring vs uptime monitors: what each one catches](/guides/monitoring-ai-crawler-access-vs-uptime-and-change-monitors)
- 2026-10-03 · updated 2026-11-18 [Web scraping APIs compared: the real cost per page](/guides/best-web-scraping-apis-compared)
- 2026-10-03 · updated 2026-11-02 [Rich Results Test vs Schema Markup Validator vs CrawlCheck](/guides/schema-validators-compared-rich-results-test-vs-schema-markup-validator)
- 2026-10-03 · updated 2026-11-02 [Agent readiness checkers: Is It Agent Ready? vs CrawlCheck](/guides/agent-readiness-checkers-compared-isitagentready-vs-crawlcheck)
- 2026-10-03 · updated 2026-11-02 [Verify GPTBot, ClaudeBot and PerplexityBot: tools compared](/guides/how-to-verify-gptbot-claudebot-and-perplexitybot-tools-compared)
- 2026-10-03 · updated 2026-11-02 [Best llms.txt generators and validators compared](/guides/best-llms-txt-generators-and-validators-compared)
- 2026-10-03 · updated 2026-11-02 [Screaming Frog vs Sitebulb vs CrawlCheck: AI crawler audits](/guides/screaming-frog-vs-sitebulb-vs-crawlcheck-ai-crawler-audit)
- 2026-10-03 · updated 2026-11-02 [How to test robots.txt for GPTBot and ClaudeBot: 5 tools compared](/guides/how-to-test-robots-txt-for-gptbot-and-claudebot)
- 2026-10-03 · updated 2026-11-02 [Cloudflare AI Crawl Control vs CrawlCheck: block vs measure](/guides/cloudflare-ai-crawl-control-vs-crawlcheck)
- 2026-10-02 · updated 2026-11-02 [Hreflang audit: fixing return-link and x-default errors](/guides/hreflang-audit-return-links-x-default-and-the-common-errors)
- 2026-10-02 · updated 2026-11-02 [Core Web Vitals without CrUX: field data for small sites](/guides/core-web-vitals-field-data-for-low-traffic-sites-without-crux)
- 2026-10-02 · updated 2026-11-02 [security.txt (RFC 9116): fields, location and expiry rule](/guides/security-txt-rfc-9116-fields-expiry-and-where-to-serve-it)
- 2026-10-02 · updated 2026-11-06 [IndexNow: which engines use it and how to check it worked](/guides/indexnow-what-it-does-who-reads-it-and-how-to-check-it-worked)
- 2026-10-02 · updated 2026-11-02 [Markdown for AI agents: serve text/markdown by negotiation](/guides/markdown-for-agents-serving-text-markdown-by-content-negotiation)
- 2026-10-02 · updated 2026-11-02 [Web Bot Auth: how signed bot requests work, and who signs](/guides/web-bot-auth-how-signed-crawler-requests-work)
- 2026-10-02 · updated 2026-11-02 [Content-Signal in robots.txt: search, ai-input, ai-train](/guides/content-signals-in-robots-txt-search-ai-input-ai-train)
- 2026-10-02 · updated 2026-11-02 [How to verify Googlebot, GPTBot and other crawlers by IP](/guides/how-to-verify-googlebot-bingbot-and-ai-crawlers)
- 2026-10-02 · updated 2026-11-02 [Text-to-HTML ratio: does it matter, and how to check it](/guides/text-to-html-ratio-when-a-page-is-mostly-code)
- 2026-10-02 · updated 2026-11-02 [LocalBusiness schema for service-area businesses: example](/guides/localbusiness-schema-for-service-area-businesses)
- 2026-10-02 · updated 2026-11-02 [Naming a crawler in robots.txt drops your Disallow rules](/guides/robots-txt-user-agent-groups-why-naming-a-crawler-drops-your-disallow-rules)
- September 2026
- 2026-09-30 · updated 2026-11-02 [Staging site leak: how to find a staging URL in your live pages and close it](/guides/staging-site-leak-how-a-staging-host-ends-up-in-your-live-pages)
- 2026-09-30 · updated 2026-11-02 [AI crawlers refused, redirected or served less: how to check](/guides/crawler-delivery-comparison-refused-redirected-or-served-less)
- 2026-09-30 · updated 2026-11-02 [NAP consistency: how to check your name, address and phone](/guides/nap-consistency-audit-phone-address-and-coordinates)
- 2026-09-30 · updated 2026-11-02 [Stale cached robots.txt or llms.txt? Two fetches tell you](/guides/machine-file-caching-stale-split-and-blocked-behind-the-edge)
- 2026-09-30 · updated 2026-11-02 [JSON-LD @id errors: what breaks and how to fix it](/guides/json-ld-id-and-iri-errors-what-breaks-and-how-to-fix-them)
- 2026-09-30 · updated 2026-11-02 [How to move DMARC from p=none to p=quarantine without losing email](/guides/how-to-move-dmarc-from-none-to-quarantine-without-losing-mail)
- 2026-09-30 · updated 2026-11-02 [CSP report-only: how to roll out a Content-Security-Policy without breaking your site](/guides/content-security-policy-rollout-report-only-to-enforced)
- 2026-09-30 · updated 2026-11-02 [HSTS check: missing header, bad preload, removed entries](/guides/hsts-audit-missing-header-preload-ineligible-and-removed-entries)
- 2026-09-25 · updated 2026-11-02 [How to find websites using your brand name, and prove you were first](/guides/how-to-check-who-else-uses-your-brand-name-online)
- 2026-09-25 · updated 2026-11-02 [How to test text color contrast on hover and keyboard focus](/guides/how-to-test-color-contrast-in-hover-and-focus-states)
- 2026-09-23 · updated 2026-11-02 [How to find broken internal links and dead anchor links on your site](/guides/how-to-audit-internal-links-and-dead-anchors)
- 2026-09-23 · updated 2026-11-02 [robots.txt status codes: what a 404, 403, 429 or 503 tells Google and AI crawlers](/guides/robots-txt-status-codes-what-404-403-and-503-tell-a-crawler)
- 2026-09-16 · updated 2026-11-02 [Meta robots vs X-Robots-Tag vs robots.txt: which one controls indexing](/guides/meta-robots-and-x-robots-tag-the-three-layers-of-crawler-permission)
- 2026-09-16 · updated 2026-11-02 [Canonical URL audit: do tags, redirects and sitemap agree?](/guides/canonical-url-audit-one-page-one-address)
- 2026-09-16 · updated 2026-11-02 [HTTP status codes for crawlers: what a 200 can hide](/guides/http-status-codes-what-a-crawler-actually-gets)
- 2026-09-16 · updated 2026-11-02 [XML sitemap audit: check the file and every URL in it](/guides/xml-sitemap-audit)
- 2026-09-05 · updated 2026-11-02 [YouTube SEO case study: 81 videos rewritten, measured](/guides/youtube-seo-case-study-81-videos-rewritten-measured-before-and-after)
- 2026-09-02 · updated 2026-11-02 [How to read a CrawlCheck report: grade, fixes, evidence](/guides/how-to-read-a-crawlcheck-report)
- August 2026
- 2026-08-28 · updated 2026-11-02 [How to block AI crawlers like GPTBot and ClaudeBot](/guides/how-to-block-ai-crawlers)
- 2026-08-28 · updated 2026-11-02 [How to measure AI visibility yourself: three checks](/guides/how-to-measure-ai-visibility)
- 2026-08-28 · updated 2026-11-02 [What is entity SEO? What machines must resolve to cite you](/guides/what-is-entity-seo)
- 2026-08-28 · updated 2026-11-02 [Free AI visibility checkers: how to tell if one is any good](/guides/free-ai-visibility-checkers-what-they-measure)
- 2026-08-28 · updated 2026-11-02 [How to write an llms.txt and check it is actually served](/guides/how-to-write-an-llms-txt-and-verify-it)
- 2026-08-28 · updated 2026-11-02 [GEO vs AEO vs LLM SEO: the terms, and what is measurable](/guides/geo-aeo-llm-seo-what-the-terms-mean)
- 2026-08-28 · updated 2026-11-02 [AI crawler list: what each bot does and how to verify it](/guides/ai-crawler-list-what-each-one-does)
- 2026-08-28 · updated 2026-11-02 [Do AI crawlers render JavaScript? Check what they see](/guides/do-ai-crawlers-render-javascript)
- 2026-08-28 · updated 2026-11-02 [Does llms.txt work? What is known and how to test it](/guides/does-llms-txt-actually-work)
- 2026-08-28 · updated 2026-11-02 [Do AI crawlers and agents respect robots.txt?](/guides/do-ai-crawlers-respect-robots-txt)
- 2026-08-28 · updated 2026-11-02 [How to rank in ChatGPT: the part that is in your control](/guides/how-to-rank-in-chatgpt)
- 2026-08-28 · updated 2026-11-02 [AI visibility tools compared: what each one measures](/guides/ai-visibility-tools-what-each-one-measures)
- 2026-08-28 · updated 2026-11-02 [How to check if AI crawlers can read your site](/guides/how-to-check-if-ai-crawlers-can-read-your-site)
- 2026-08-28 · updated 2026-11-02 [Is Cloudflare blocking AI crawlers on your site?](/guides/is-cloudflare-blocking-ai-crawlers-on-your-site)

Findings

## 108 findings

Newest first, by month. Corrections are included here as well as above.

- November 2026
- 2026-11-21 [A staff login could read visitor IP addresses. We closed it.](/blog/a-staff-login-could-read-full-visitor-addresses-we-closed-it)
- 2026-11-19 [Who reads llms.txt? Our check called 8 of 10 unverified](/blog/our-llms-txt-reader-check-called-8-of-10-readers-unverified)
- 2026-11-18 ["20 years of experience": the site's own records said 13](/blog/a-site-said-20-years-of-experience-its-own-records-said-13)
- 2026-11-18 [The quote form was the slow part: 980 ms cut to 50 ms](/blog/the-quote-form-was-the-slow-part-980-ms-to-50)
- 2026-11-15 [Top 1,000 websites: every outside tracker we logged](/blog/top-1000-websites-third-party-trackers-november-2026)
- 2026-11-14 [One in four MCP hosts changed its tools in four days. Nothing told the agent.](/blog/one-in-four-mcp-hosts-changed-its-tools-in-four-days)
- 2026-11-13 [Release notes: 7 to 13 November 2026](/blog/release-notes-7-to-13-november-2026)
- 2026-11-13 [Booking links counted as missing sitemap pages](/blog/booking-links-counted-as-missing-sitemap-pages)
- 2026-11-13 [A slider that took 8.8 seconds: three 328 KB PNGs](/blog/a-slider-that-took-8-seconds-three-328-kb-pngs)
- 2026-11-13 [A newsletter form that lost every sign-up](/blog/a-newsletter-form-that-lost-every-sign-up)
- 2026-11-13 [Both our SDKs cut a tool list at 300 with no warning](/blog/our-sdks-cut-a-tool-list-at-300-with-no-warning)
- 2026-11-13 [Claude-User uses two published address lists. We checked one](/blog/claude-user-comes-from-two-published-address-lists-we-checked-one)
- 2026-11-13 [AI crawler IP ranges from 18 operator lists, in one file](/blog/ai-crawler-ip-ranges-from-18-operator-lists-in-one-file)
- 2026-11-13 [Our mirror relayed real crawlers and inflated forgery counts](/blog/our-mirror-relayed-real-crawlers-and-inflated-our-forgery-counts)
- 2026-11-13 [14 of 43 crawlers in our catalogue were classed wrong](/blog/fourteen-of-43-crawlers-in-our-catalogue-were-classed-wrong)
- 2026-11-06 [18 DMARC reports, 7 domains: every failure was a spoofer](/blog/eighteen-dmarc-reports-every-failure-was-spoofing)
- 2026-11-06 [Our AI accuracy check ran for six days and measured nothing](/blog/our-ai-accuracy-check-ran-for-six-days-and-measured-nothing)
- 2026-11-06 [Most of our 'referring pages' were forged Referer headers](/blog/most-of-our-referring-pages-were-forged-referer-headers)
- 2026-11-06 [Our crawler counts missed about 45% of hits](/blog/our-crawler-counts-missed-45-percent-of-hits)
- 2026-11-03 [Six in ten websites already use post-quantum encryption. Whether yours does mostly depends on one thing](/blog/post-quantum-key-exchange-six-in-ten-websites-november-2026)
- 2026-11-03 [One Cloudflare setting is behind most of the new AI training blocks on top sites](/blog/one-cloudflare-setting-behind-most-new-ai-training-blocks-november-2026)
- October 2026
- 2026-10-30 · updated 2026-11-02 [AI answer corrections: three clocks, not one update time](/blog/ai-business-corrections-three-clocks-not-one)
- 2026-10-30 · updated 2026-11-02 [AI citations on two dates: seven matched questions](/blog/seven-matched-questions-ai-citations-october-2026)
- 2026-10-30 · updated 2026-11-02 [Unblocking AI crawlers: what an access repair proves](/blog/unblocking-ai-crawlers-access-is-not-a-citation-result)
- 2026-10-29 · updated 2026-11-02 [Google's Googlebot check passes 198 of 200 rented servers](/blog/googles-googlebot-verification-rule-passes-any-google-cloud-server)
- 2026-10-26 · updated 2026-11-02 [Which AI crawlers the top 10,000 sites block most, October 2026](/blog/which-ai-crawlers-top-sites-block-most-october-2026)
- 2026-10-22 · updated 2026-11-02 [Our receipt checker would have rejected our own receipts](/blog/our-receipt-checker-would-have-rejected-our-own-receipts)
- 2026-10-22 · updated 2026-11-02 [One 503 is not a blocked site: refusal or hiccup?](/blog/one-503-is-not-a-blocked-site-how-to-tell-a-refusal-from-a-hiccup)
- 2026-10-22 · updated 2026-11-02 [Three sections said “not scored”. Our grade counted them.](/blog/three-report-sections-said-not-scored-the-grade-counted-them)
- 2026-10-21 · updated 2026-11-02 [Google AI Overview sources for Denver tree removal cost](/blog/google-ai-overview-tree-removal-cost-denver-six-sources)
- 2026-10-21 · updated 2026-11-02 [For a week, CrawlCheck told AI agents not to pay us](/blog/for-a-week-crawlcheck-told-agents-not-to-pay-us)
- 2026-10-17 · updated 2026-11-02 [AI picked a local contractor 422 times: rating decided it](/blog/ai-picked-a-local-contractor-422-times-the-rating-decided-it)
- 2026-10-17 · updated 2026-11-02 [AI agents cannot refuse what they cannot see: 27 traps](/blog/ai-agents-cannot-refuse-what-they-cannot-see)
- 2026-10-15 · updated 2026-11-02 [Robots.txt allows it, the server refuses: 57 top sites](/blog/robots-txt-allows-server-refuses-ai-crawlers-october-2026)
- 2026-10-15 · updated 2026-11-02 [Share of preflight, October 2026: 0 of 5,643 requests](/blog/share-of-preflight-october-2026)
- 2026-10-15 · updated 2026-11-02 [MCP reliability, October 2026: 39,484 handshakes measured](/blog/mcp-reliability-october-2026)
- 2026-10-15 · updated 2026-11-02 [Agent conduct, October 2026: 34,676 verified requests](/blog/agent-conduct-october-2026)
- 2026-10-14 · updated 2026-11-02 [An access rule on one path locked our customers out](/blog/an-access-rule-on-one-path-locked-our-customers-out-of-sign-in)
- 2026-10-14 · updated 2026-11-02 [Our directory froze for 20 hours and logged no error](/blog/a-cron-job-ran-one-minute-late-and-our-directory-froze-for-20-hours)
- 2026-10-14 · updated 2026-11-02 [Sitemap lastmod: 103 pages, one date, why engines skip it](/blog/sitemap-lastmod-103-pages-one-date-why-engines-ignore-it)
- 2026-10-14 · updated 2026-11-02 [Release notes 14 Oct 2026: doors, weekly figures, trial](/blog/release-notes-14-october-2026-doors-signed-weekly-figures-watch-trial)
- 2026-10-09 · updated 2026-11-02 [Does Data Axle feed Google? Where business data comes from](/blog/where-google-and-ai-assistants-get-business-data)
- 2026-10-09 · updated 2026-11-02 [Do AI agents stop before acting on a lookalike? We tested 4](/blog/do-ai-agents-stop-before-acting-on-a-lookalike-site)
- 2026-10-09 · updated 2026-11-02 [MCP servers that ask for a login: what 1,366 request first](/blog/mcp-servers-that-ask-for-a-login-what-they-request-by-default)
- 2026-10-09 · updated 2026-11-02 [Four AI models, three local businesses: who got it right](/blog/what-four-ai-models-told-customers-about-our-three-businesses)
- 2026-10-09 · updated 2026-11-02 [AI crawlers on Wix, Shopify, Squarespace, Webflow: 980 sites](/blog/what-ai-crawlers-get-from-wix-shopify-squarespace-webflow-sites)
- 2026-10-08 · updated 2026-11-02 [AI agents acting for people: 613 visits, one read robots.txt](/blog/agents-acting-for-people-613-verified-visits-one-read-robots-txt)
- 2026-10-07 · updated 2026-11-02 [MCP Registry census: what 25,983 endpoints answered](/blog/mcp-registry-census-1851-servers-what-they-answer)
- 2026-10-07 · updated 2026-11-02 [Eight weeks of AI crawlers on one site: who was really who](/blog/eight-weeks-of-agent-conduct-who-was-really-who)
- 2026-10-06 · updated 2026-11-02 [Only 6% of websites block an AI crawler: the full breakdown](/blog/only-six-percent-of-websites-block-an-ai-crawler)
- 2026-10-06 · updated 2026-11-02 [State of AI visibility, October 2026: 139,788 homepages](/blog/state-of-ai-visibility-october-2026-139788-homepages)
- 2026-10-04 · updated 2026-11-02 [402 Payment Required: what top sites send AI crawlers](/blog/ai-crawlers-get-402-payment-required-from-top-sites-none-quote-a-price)
- 2026-10-03 · updated 2026-11-02 [Release notes 3 Oct 2026: Resolve, census, rulebook](/blog/release-notes-3-october-2026-resolve-protocol-census-rulebook)
- September 2026
- 2026-09-30 · updated 2026-11-02 [Eight contradictions in our own copy, rechecked](/blog/eight-contradictions-in-our-own-copy-rechecked)
- 2026-09-30 · updated 2026-11-02 [Our extension read a page as 36.5% JavaScript. It was zero.](/blog/the-page-our-extension-read-as-36-percent-javascript-was-zero)
- 2026-09-30 · updated 2026-11-02 [CrawlCheck in German, French, Spanish and Portuguese](/blog/crawlcheck-in-german-french-spanish-and-portuguese)
- 2026-09-30 · updated 2026-11-02 [Our security headers skipped every signed-in session](/blog/our-security-headers-skipped-every-signed-in-session)
- 2026-09-30 · updated 2026-11-02 [Five days of our alerts went to an address with no mailbox](/blog/five-days-of-our-alerts-went-to-an-address-with-no-mailbox)
- 2026-09-29 · updated 2026-11-02 [Release notes 29 Sep 2026: finding states, sitemap, trust](/blog/release-notes-29-september-2026-finding-states-sitemap-index-trust-center)
- 2026-09-25 · updated 2026-11-02 [Google Places API vs Google Maps rankings: why they don't match (tested in 4 cities)](/blog/google-places-api-ranking-is-not-google-maps-ranking)
- 2026-09-23 · updated 2026-11-02 [Correction: the owner's own scans came back locked](/blog/the-owner-could-not-read-his-own-scans)
- 2026-09-23 · updated 2026-11-02 [Sites measured is not people: what our own logs showed](/blog/our-homepage-says-6557-sites-measured-six-people-ran-a-scan-this-week)
- 2026-09-20 · updated 2026-11-02 [Linked from every page, our llms.txt was fetched 8 times](/blog/our-llms-txt-is-linked-from-every-page-crawlers-fetch-it-like-a-blog-post)
- 2026-09-17 · updated 2026-11-02 [A 200 status hid an empty page for weeks](/blog/the-control-panel-that-answered-200-with-nothing-in-it)
- 2026-09-17 · updated 2026-11-02 [Correction: our paywall said sites with findings were clean](/blog/the-paywall-that-said-your-site-was-clean)
- 2026-09-16 · updated 2026-11-02 [Brand schema for multi-location businesses: link both ways](/blog/the-parent-declared-the-chain-none-of-the-locations-declared-it-back)
- 2026-09-16 · updated 2026-11-02 [Google's Maps provider list: 793 names, no Yelp](/blog/googles-maps-provider-list-has-no-yelp-in-it)
- 2026-09-12 · updated 2026-11-02 [Three of our own checks passed because we measured nothing](/blog/three-of-our-own-rows-passed-because-we-measured-nothing)
- 2026-09-12 · updated 2026-11-02 [Google-Extended has no user agent. 1,582 requests used it](/blog/a-name-google-says-it-never-sends)
- 2026-09-12 · updated 2026-11-02 [Naming a crawler cancels your * rules: Semrush's robots.txt](/blog/fifty-four-rules-that-do-not-apply-to-bingbot)
- 2026-09-10 · updated 2026-11-02 [A newspaper’s schema coordinates put it in China](/blog/the-newsroom-that-published-coordinates-in-china)
- 2026-09-09 · updated 2026-11-02 [Lazy-load placeholders: why image checks miss your photos](/blog/our-scanner-counted-placeholders-not-photographs)
- 2026-09-08 · updated 2026-11-02 [Unquoted HTML attributes: why we said a viewport was missing](/blog/the-viewport-was-there-all-along)
- 2026-09-08 · updated 2026-11-02 [OpenTimestamps proof says pending? Upgrade the receipt](/blog/our-proofs-said-pending-for-26-days)
- 2026-09-05 · updated 2026-11-02 [areaServed vs service area pages: 20 towns declared, 1 page](/blog/your-schema-lists-service-areas-your-sitemap-has-pages-for-a-fraction-of-them)
- 2026-09-02 · updated 2026-11-02 [utm_source=chatgpt.com in a lead: what it proves](/blog/a-tree-service-lead-arrived-with-utm-source-chatgpt-com)
- 2026-09-01 · updated 2026-11-02 [Seven site types, and the report checks we corrected](/blog/we-read-every-scored-row-against-seven-sites-here-is-what-we-unscored)
- 2026-09-01 · updated 2026-11-02 [Page builders drop the main landmark: nine HTML checks](/blog/accessibility-structure-nine-things-a-screen-reader-needs-before-contrast-matters)
- 2026-09-01 · updated 2026-11-02 [A placeholder check flagged NaN. It was inside a URL](/blog/nan-inside-a-url-slug-a-placeholder-check-that-accused-a-newspaper)
- 2026-09-01 · updated 2026-11-02 [Dead link or blind spot? When a checker's failure is its own](/blog/the-scanner-that-cannot-fetch-its-own-host)
- August 2026
- 2026-08-29 · updated 2026-11-02 [Missing referrer is not direct traffic: 93% of our arrivals sent none](/blog/ninety-three-percent-of-our-arrivals-sent-no-referrer)
- 2026-08-29 · updated 2026-11-02 [www and non-www both return 200? A canonical won't fix it](/blog/our-canonical-was-right-and-the-site-was-still-served-twice)
- 2026-08-28 · updated 2026-11-02 [Why a web server can gain and lose 43 million sites](/blog/the-web-server-that-gained-and-lost-43-million-sites)
- 2026-08-27 · updated 2026-11-02 [Google's /goto redirect: why referrer data can't show it](/blog/we-clicked-a-real-google-result-to-test-the-goto-redirect)
- 2026-08-26 · updated 2026-11-02 [AI text watermarks only work if the provider opted in](/blog/ai-text-watermarks-only-work-if-the-provider-opted-in)
- 2026-08-26 · updated 2026-11-02 [Our audit labelled one page and measured another for weeks](/blog/our-audit-labelled-one-page-and-measured-another)
- 2026-08-26 · updated 2026-11-02 [Lighthouse scores vary between runs: two runs, 225% apart](/blog/one-lighthouse-run-cannot-support-a-finding-225-percent-variance)
- 2026-08-21 · updated 2026-11-02 [Text extractors dropped our schema and still got us right](/blog/a-pipeline-threw-away-our-schema-and-got-us-right-anyway)
- 2026-08-21 · updated 2026-11-02 [Analytics added 650 ms to every request: how we found it](/blog/our-analytics-was-adding-650ms-to-every-request)
- 2026-08-21 · updated 2026-11-02 [Why word count cannot spot a parked domain: 783 words](/blog/a-783-word-parking-page-defeats-every-thin-content-check)
- 2026-08-21 · updated 2026-11-02 [A save that returned success rewrote every newline](/blog/a-write-that-returned-success-and-corrupted-every-newline)
- 2026-08-20 · updated 2026-11-02 [Why caching only successes kept our scans slow](/blog/cache-your-misses-a-lookup-that-only-caches-on-success)
- 2026-08-20 · updated 2026-11-02 [AI visibility scores measure an API, not ChatGPT](/blog/ai-visibility-scores-measure-an-api-not-chatgpt)
- 2026-08-19 · updated 2026-11-02 [Is your auditor grading your firewall? A two-request test](/blog/the-site-that-scored-15-because-it-refused-us)
- 2026-08-19 · updated 2026-11-02 [AI visibility vendors audited: 11 of 23 have llms.txt](/blog/we-scanned-the-tools-that-audit-your-site)
- 2026-08-19 · updated 2026-11-02 [Is your host blocking ClaudeBot? Group the 403s by IP first](/blog/we-almost-published-that-our-host-was-blocking-claude)
- 2026-08-18 · updated 2026-11-02 [Fake GPTBot and ClaudeBot requests scan for .env files](/blog/the-ai-crawler-that-wanted-your-env-file)
- 2026-08-18 · updated 2026-11-02 [Which AI crawlers can't be verified by IP range?](/blog/the-crawlers-nobody-can-check)
- 2026-08-18 · updated 2026-11-02 [When an LLM summarises your audit report and gets it wrong](/blog/the-grade-that-could-not-explain-itself)
- 2026-08-15 · updated 2026-11-02 [Site audits go stale: why one clean scan proves little](/blog/your-site-was-clean-the-day-you-audited-it)
- 2026-08-15 · updated 2026-11-02 [How much AI crawler traffic is forged? We check the IPs](/blog/how-much-ai-crawler-traffic-is-forged)
- 2026-08-14 · updated 2026-11-02 [Opening hours and prices: the facts sites don’t publish](/blog/the-two-facts-almost-nobody-publishes)
- 2026-08-14 · updated 2026-11-02 [agents.md: AI agent instructions you may not have written](/blog/the-instructions-on-your-domain-you-did-not-write)
- 2026-08-14 · updated 2026-11-02 [MobileOptimized tag: on 1.65M sites, none in the top 10,000](/blog/the-meta-tag-a-million-sites-have-and-the-top-ten-thousand-do-not)
- 2026-08-13 · updated 2026-11-02 [Email bounce case study: one typo, every address dead](/blog/one-character-of-undeliverable-email)
- 2026-08-13 · updated 2026-11-02 [robots.txt returns 200 but no crawler can read it](/blog/a-file-that-answered-200-and-could-not-be-read)
- 2026-08-13 · updated 2026-11-02 [Your cache purge returned 200 and evicted nothing](/blog/the-purge-returned-200-and-evicted-nothing)
- 2026-08-13 · updated 2026-11-02 [What AI crawlers receive from local business sites](/blog/what-a-crawler-actually-receives)

Elsewhere

## The same person, on other sites

These 17 profiles are the left side of the graph above: the Person node’s sameAs on this site and on emmanuelorta.com, which share one @id. If they ever disagree, the one on emmanuelorta.com is canonical.

[emmanuelorta.com](https://emmanuelorta.com)[GitHub](https://github.com/emmanuelorta)[LinkedIn](https://www.linkedin.com/in/emmanuelorta)[Wikimedia Commons](https://commons.wikimedia.org/wiki/User:Vsnary)[Facebook](https://www.facebook.com/VSNARY)[Instagram](https://www.instagram.com/emmanuel_orta/)[TikTok](https://www.tiktok.com/@vsnaryemmanuelorta)[coldblooded.com](https://coldblooded.com/VSNARY)[Substack](https://substack.com/@vsnary)[Quora](https://www.quora.com/profile/VSNARY)[Product Hunt](https://www.producthunt.com/@emmanuel_orta)[Crunchbase](https://www.crunchbase.com/person/emmanuel-orta-aff6)[ORCID](https://orcid.org/0009-0001-5269-1515)[Threads](https://www.threads.com/@emmanuel_orta)[YouTube](https://www.youtube.com/@emmanuelorta)[Medium](https://medium.com/@crawlcheck)[Gravatar](https://gravatar.com/emmanuelorta)

Corrections and questions: [hello@crawlcheck.io](mailto:hello@crawlcheck.io).

## Questions about this page

#### Q Who writes the findings and guides on CrawlCheck?

Emmanuel Orta (creator name VSNARY), from measurements taken on sites he runs and on the public corpus. A business found with a defect is named only after its owner has been contacted; public vendors and AI operators measured on their own sites and published endpoints are named.

#### Q Is the demo report a real site?

Yes. It is one of the author’s own client sites, named with the owner’s consent, and it regenerates on every visit.

We read your site the way crawlers do, from our own network, and every report says exactly what was asked for and what came back. [Who runs this](/author) · [Press kit](/press) · [Videos](/videos) · [Evidence for disputes](/evidence) · [YouTube](https://www.youtube.com/@crawlcheck) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io)

#### How we measure, and our own machine files

CrawlCheck reads every site as itself. Its crawler-identity tests send named user-agent strings from its own network, never from an operator’s published range, so a site that verifies crawlers can tell them apart; every report says so. Results reflect what an anonymous non-browser client receives. [What we collect and how to opt out](/policy) · [how every report is timestamped](/proof) · [who runs this](/author) · [press kit](/press) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io).

**Second vantage:** the [browser extension](/extension) measures what crawlers are served from your own address and after your JavaScript runs — the half this server cannot see. From 1.0.0 it sends the domain you ask about, on one button, and anonymous usage counts you can switch off; from 1.0.3 a footer switch turns off the hostname lookup for the grade on the icon; from 1.0.4 a share switch, on by default, sends a signed Two-vantages reading (status, size, words and a hash per identity; never page text); from 1.0.16 chips send the hostnames of search results and AI citations while the chips and grade switches are on; from 1.0.17 a readings switch, on by default, sends one signed page reading a day (numbers, the hostname and the page address with the query removed; never in incognito; at most 40 a day) and only while the share and grade switches are also on. Earlier versions send nothing.

**Our own machine layer for the agentic web:** [llms.txt](/llms.txt) · [llms-full.txt](/llms-full.txt) · [agents.md](/agents.md) · [SKILL.md](/SKILL.md) · [entitymap.json](/entitymap.json) · [media kit](/.well-known/media-kit.json) · [MCP server card](/.well-known/mcp/server-card.json) · [API catalog](/.well-known/api-catalog) · [OpenAPI](/openapi.json) · [robots.txt](/robots.txt) · [sitemap.xml](/sitemap.xml) · [security.txt](/.well-known/security.txt) — every one named in robots.txt, which is exactly what we check for on yours.

**Pages:** [Keys](/keys) · [/](/) · [Listing check](/listing-check) · [SDK](/sdk) | **Glossary:** [RDF dataset](/glossary/rdf-dataset) · [Human-in-the-loop](/glossary/human-in-the-loop) · [verdict over DNS](/glossary/verdict-over-dns) · [Permissions-Policy](/glossary/permissions-policy) | **Registry:** [arti-box.fr](/registry/arti-box.fr) · [dayoneapp.com](/registry/dayoneapp.com) · [heckenlau-immobilien.de](/registry/heckenlau-immobilien.de) · [minisplitreef.com](/registry/minisplitreef.com)

[Contact](/contact) · [Partnerships](/partnerships) · [Terms of service](/terms) · [Refund policy](/refunds) · [Trust center](/trust) · [Subprocessors](/subprocessors) · [Changelog](/changelog) · [Report an error](/report-error)
