{"kind":"crawlcheck-conduct","v":1,"generated_at":"2026-11-22T01:34:59.415Z","population":"verifiable agents observed on crawlcheck.io, and on the other sites that report through their edge code (portfolio)","reading":"A census of one property, not a sample of the web: what each agent did HERE, verified by source address against the operator's own published ranges. conduct is no_violations_observed when at least 50 verified requests show no fetch of a path robots.txt disallows; violations_observed when a disallowed path was fetched; insufficient_data below 50. The busiest minute is reported, not judged: this site publishes no crawl rate. site_checks_14d are counts from Visitor Resolve calls other sites made about this agent.","thresholds":{"min_verified_requests":50,"published_rate_limit":null,"disallowed_rules":["/r/","/backup/","/admin-old/"]},"agents":[{"agent":"PerplexityBot","operator":"Perplexity","purpose":"indexing","user_triggered":false,"conduct":"violations_observed","window":{"first_seen":"2026-08-13T02:14:50.805Z","last_seen":"2026-11-22T01:27:40.391Z"},"identity":{"verified_requests":35927,"forged_claims":101,"forgery_share":0.003,"signed_requests":0,"failed_signatures":0,"signed_share":0,"strongest_proof":"address","reading":"verified_requests came from the ranges Perplexity publishes; forged_claims used this agent's name from outside them (impersonators, not the agent)"},"robots_txt":{"verdict":"disallowed_paths_fetched","robots_txt_fetches":267,"disallowed_fetches":74,"disallowed_rules":["/r/","/backup/","/admin-old/"],"disallowed_fetch_records":[{"at":"2026-10-22T08:38:56.498Z","path":"/r/hsem60u0pb","net":"18.97.9.0/24"},{"at":"2026-10-22T15:59:08.322Z","path":"/r/hsem60u0pb","net":"18.97.9.0/24"},{"at":"2026-10-22T15:59:20.457Z","path":"/r/uazt7utoub","net":"18.97.9.0/24"},{"at":"2026-10-24T07:38:31.838Z","path":"/r/hsem60u0pb","net":"18.97.9.0/24"},{"at":"2026-10-24T07:38:34.319Z","path":"/r/phuaa0zazw","net":"18.97.9.0/24"},{"at":"2026-10-25T14:17:44.938Z","path":"/r/cz9abl7ob3","net":"18.97.9.0/24"},{"at":"2026-10-25T14:17:45.149Z","path":"/r/phuaa0zazw","net":"18.97.9.0/24"},{"at":"2026-10-25T14:17:45.922Z","path":"/r/phuaa0zazw","net":"18.97.9.0/24"},{"at":"2026-10-25T14:17:46.331Z","path":"/r/phuaa0zazw","net":"18.97.9.0/24"},{"at":"2026-10-25T14:17:47.936Z","path":"/r/cz9abl7ob3","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:02.461Z","path":"/r/cz9abl7ob3","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:04.413Z","path":"/r/cz9abl7ob3","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:07.938Z","path":"/r/up0rftpp5z","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:08.999Z","path":"/r/1fb80ss94n","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:09.428Z","path":"/r/up0rftpp5z","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:11.912Z","path":"/r/1fb80ss94n","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:18.485Z","path":"/r/up0rftpp5z","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:18.928Z","path":"/r/up0rftpp5z","net":"18.97.9.0/24"},{"at":"2026-10-27T06:50:46.518Z","path":"/r/cz9abl7ob3","net":"18.97.9.0/24"},{"at":"2026-10-28T20:49:42.689Z","path":"/r/khlmjzqasm","net":"18.97.9.0/24"}],"counted_since":"2026-10-07T04:51:16.683Z","reason":null,"robots_txt_own_fetches":267,"robots_txt_sibling_fetches":0,"robots_txt_shared_from_google":0,"reading":"verified requests to paths this site's robots.txt disallows for every agent, including a group that names this one; a lower bound before 7 Oct 2026 (per-path map capped at 40 paths)"},"rate":{"verdict":"measured","peak_requests_per_minute":120,"peak_at":"2026-11-20T06:12","published_limit":null,"measured_since":"2026-10-07T04:51:16.683Z","reading":"the busiest minute of verified requests observed here since the counter started, all of the operator's addresses combined; a lower bound. This site publishes no crawl rate (its robots.txt has no Crawl-delay), so the rate is reported, never judged"},"revalidation":{"conditional_requests":0,"share_of_verified_since_measured":0,"measured_since":"2026-10-07T04:51:16.683Z","reading":"requests carrying If-None-Match or If-Modified-Since: an agent that revalidates instead of refetching"},"site_checks_14d":{"checked":209,"verified":107,"spoofed":102},"daily_verified":{"2026-11-09":814,"2026-11-10":722,"2026-11-11":604,"2026-11-12":568,"2026-11-13":692,"2026-11-14":880,"2026-11-15":1250,"2026-11-16":821,"2026-11-17":1286,"2026-11-18":346,"2026-11-19":804,"2026-11-20":737,"2026-11-21":441,"2026-11-22":25},"portfolio":{"agent":"PerplexityBot","sites":["supremefencingdenver.com","supremefencinglakewood.com","supremearvadafencing.com","arvadatreeservicellc.com","terrariumstation.com","treeservicedenverllc.com","emmanuelorta.com"],"verified_fetches_judged":172,"verified_fetches_not_judged":0,"disallowed_fetches":0,"disallowed_fetch_records":[]},"grade":"D","grade_reasons":["74 recorded fetches of disallowed paths, 0.21% of its 35,927 verified requests"]}],"census":"https://crawlcheck.io/api/telemetry","visitor_checks":"https://crawlcheck.io/api/v1/visitor/stats","code":{"build_id":"9219fb519ff0eaf2","script_sha16":"b00e794a299c5a1b","state":"attested","deployed":{"at":"2026-11-21T18:41:28.011Z"},"build_log_entry":2899,"score_version":43,"scoring_policy_sha256":"3e08fccfbbce356dc82ecd302b32a226a36fc0fb3150a4ab72248fb5795372af","decision_rules_sha256":"18dd5636e0896692ab518050cb401744edea2e6f1086dff94fead314959bdc3e","check":"https://crawlcheck.io/api/v1/builds/9219fb519ff0eaf2"},"sha256":"6d5c79fb908bf3a946877586d5d1fed9a0c217c7145a105cdc777d5330b40a91","signature":{"v":1,"alg":"Ed25519","kid":"1hHmE3fo1rg5Ig70wuFtJ5wBc7G-sUTgUJkxyPWFRps","over":"sha256","message":"crawlcheck-data-v1\n6d5c79fb908bf3a946877586d5d1fed9a0c217c7145a105cdc777d5330b40a91","sig":"DoBP6bv3cNfA1_l7BZLQg2iQd2GlmRe5XBhPwa935Z5wYWhFyY8_Nq8WSFXsqMGh3VTjGRx1f7gRciaA9DJdCw","signed_at":"2026-11-22T01:37:56.168Z","key":{"kid":"1hHmE3fo1rg5Ig70wuFtJ5wBc7G-sUTgUJkxyPWFRps","jwk":{"kty":"OKP","crv":"Ed25519","x":"5TmKCOx0TTHepq7HwyXBHvGQpVCSBd2lV8cLzYVqFxQ"},"published_in":"https://crawlcheck.io/.well-known/http-message-signatures-directory"},"canonical":"sha256 over canonical JSON of every field except sha256 and signature"}}