{"ok":true,"kind":"crawlcheck-rulebook","v":1,"generated_at":"2026-11-22T01:33:54.292Z","score_version":43,"schema":"https://crawlcheck.io/schemas/rulebook.json","counts":{"rules":111,"by_kind":{"scan":86,"answer_correlation":5,"capability_mismatch":6,"self_audit":12,"mcp_server":2},"by_family":{"site":18,"headers":4,"mostly_code":3,"machine_files":12,"other":9,"ard":4,"webmcp":2,"trust_path":2,"nap":3,"robots":17,"delivery":9,"jsonld":3,"answers":5,"capabilities":6,"self_audit":12,"mcp":1,"watch":1},"revised":10,"scored":82},"scans_counted":9304,"severity_scale":[{"level":"info"},{"level":"low"},{"level":"medium"},{"level":"high"},{"level":"critical"}],"method":{"revisions":"A rule that changes what it reports gets a new revision; a record keeps the revision that decided it, and a replay uses that revision, never today's.","share":"Share of counted scans that carried the code at least once, the same numbers /data publishes. Self-scans and opted-out sites are never counted.","grade":"Each finding has a level from info to critical. Every graded finding lowers the score of its section; an open finding at medium or above also caps the letter grade, so fix those first."},"rules":[{"code":"SCANNER_REFUSED_BROWSER_READ","kind":"scan","family":{"id":"other","label":"Other"},"title":"The site refuses plain automated requests; it was measured through a real browser","meaning":"The site’s security layer refused CrawlCheck’s plain HTTP request but served the page to a real browser. Most AI crawlers (GPTBot, ClaudeBot, PerplexityBot and others) make plain HTTP requests and do not run JavaScript, so a shield that tells the two apart this way may be refusing them too. This scan cannot verify that: it measured its own request from its own network, not a verified crawler. Confirm with your server logs or the crawler operators' own diagnostics before treating the site as blocked. The rest of this report was measured through the browser, so its findings describe the site, not the wall.","severity":{"level":"low"},"scored":true,"measured_on":"every scan","revision":{"current":1,"revised_at":null},"fix":{"advice":"Decide which automated readers you want. If AI and search crawlers should reach the site, allow verified bots in the bot-protection settings (Cloudflare, Akamai and others have a verified-bot or signed-agent allow list) instead of challenging every client that does not run JavaScript.","effort":"config","endpoint":null},"share_of_scans":{"pct":0.8,"scans":77,"of_scans":9304,"basis":"share of counted scans that carried it; the same numbers /data publishes"},"links":{"self":"https://crawlcheck.io/rules#SCANNER_REFUSED_BROWSER_READ","api":"https://crawlcheck.io/api/rules?code=SCANNER_REFUSED_BROWSER_READ","glossary":[],"workflow":null,"lineage":"https://crawlcheck.io/docs/lineage-coverage","explain_template":"https://crawlcheck.io/api/explain?id={report_id}&code=SCANNER_REFUSED_BROWSER_READ"}}],"filter":{"code":"SCANNER_REFUSED_BROWSER_READ"}}