{"kind":"crawlcheck-decision-accuracy","v":1,"window_days":90,"since":"2026-10-22","computed_at":"2026-11-22T01:19:55.739Z","outcomes_scored":1,"decisions":{"require_confirmation":{"outcomes":1,"ok":0,"not_ok":1,"blocked":1,"challenged":0,"error":0,"hit_rate":1}},"rules":{"resolve.actions.transact":{"require_confirmation":{"outcomes":1,"ok":0,"not_ok":1,"blocked":1,"challenged":0,"error":0,"hit_rate":1}}},"method":"Every outcome report that carries the decision_sha256 of a receipt CrawlCheck issued is scored against that receipt: the decision it gave and every rule that fired in it (steps with an effect). not_ok = blocked, challenged or error as the agent reported it. hit_rate, for warn / require_confirmation / block / doubt: the share of acted-on decisions where acting went wrong - the rule was right to caution. held_rate, for allow: the share where acting went fine.","limits":"Only outcomes tied to a real receipt count; bare self-reports do not. A block or confirmation that stopped the agent produces no outcome, so a cautionary rule's hit rate covers the cases where an agent acted anyway, and allow's held rate covers the agents that bothered to report. Outcomes are the agent's own report. A rule with no outcomes shows null, never 100%."}