{"kind":"crawlcheck-corrections","v":1,"source":"https://crawlcheck.io/corrections","corrections":[{"area":"site","at":"2026-10-26","cls":"method_text","scope":"Research method page","wrong":"It said every read “never pretends to be another company’s crawler”. The census and scanner do send other crawlers’ user-agent strings, from CrawlCheck’s own addresses, to measure what those crawlers are served.","fix":"The page now says so, and how a firewall can tell those requests from the real crawler.","values_affected":false,"url":"/research#identities"},{"area":"site","at":"2026-10-21","cls":"disclosure","scope":"Agent decisions about crawlcheck.io","wrong":"From 14 to 21 October, agents asking whether to pay crawlcheck.io were told “block” after an endpoint nobody had confirmed appeared on our own registry listing.","fix":"The change was ours and was confirmed; the block was the correct answer for an unconfirmed change. Written up in full.","values_affected":false,"url":"/blog/for-a-week-crawlcheck-told-agents-not-to-pay-us"},{"area":"site","at":"2026-10-14","cls":"data_publication_error","scope":"Page sitemap","wrong":"Every standing page in the page sitemap carried the same last-modified date, 103 entries in all.","fix":"Each page now carries the date it last changed.","values_affected":false,"url":"/blog/sitemap-lastmod-103-pages-one-date-why-engines-ignore-it"},{"area":"vendor benchmark","at":"2026-09-18","cls":"measurement_error","scope":"5 directory rows (and 6 registry rows)","wrong":"Grades were published for sites the scanner never reached - the homepage timed out or redirected in a loop on the apex and on www: fauna.com D/40, hippocratic.ai D/40, profound.dev D/40, robustintelligence.com D/40, milvus.io C/60 (plus blueheronrestaurant.com, registry only, since 2026-09-10).","fix":"An unreachable homepage is now recorded as no grade, with the reason (build 570). The six records were removed; the rows are re-measured by the directory job.","values_affected":true,"url":"/directory/corrections"},{"area":"vendor benchmark","at":"2026-09-16","cls":"method_text","scope":"Dataset descriptions on /directory, /data and the snapshot metadata","wrong":"The measurement technique text said each site is fetched by \"fifteen named crawler identities and one unnamed client\".","fix":"The scanner sends twelve named crawler identities plus an unnamed client and two mobile-browser controls; the text now says so in all three places.","values_affected":false,"url":"/directory/corrections"}],"disputes":{"filed":1,"decided":1,"changed":0,"stood":1,"open":0},"report":"hello@crawlcheck.io"}