CrawlCheck

Timestamp proof

Every report is fingerprinted, and each day is anchored to Bitcoin

In one sentence

Every CrawlCheck report is reduced to its measurements — host, timestamp, section scores, every path and status fetched, every crawler identity and what it received, the citation state — canonicalised and hashed with SHA-256, and each day’s digests are anchored to the Bitcoin blockchain with OpenTimestamps. That proves a report existed in exactly that form at that time and has not been altered since; it does not prove the measurement was correct, and this page says which claim is which.

A report is a claim about what a server did at a moment in time. Until it is anchored, the only evidence that it said so — and that nobody edited it afterwards — is our own database, which we control.

The citation state is inside this digest too. The names, the phone numbers, the address, and every profile the site claims — with what each one answered when it was checked — are part of the fingerprint. It does not mean a directory indexed anything: no timestamp can do that. It means the state of those listings on that date can be proved rather than remembered.

What this proves: that a report existed in exactly this form at that time, and has not been altered since. What it does not prove: that the measurement was correct. Those are two different claims and only the first can be settled by mathematics.

How it works

  1. Each report is reduced to its measurements — host, timestamp, section scores, every path and status fetched, every crawler identity and what it received — canonicalised with sorted keys and hashed with SHA-256. Wording, layout and section copy are excluded, so an editorial change never invalidates an existing proof.
  2. The day’s digests are sorted and folded into a Merkle tree: parent = SHA256(left || right), an odd node paired with itself. Sorting means the order scans arrived cannot change the root.
  3. The root is submitted to the OpenTimestamps calendars, which aggregate it into a Bitcoin transaction. No wallet, no fee, no key held by us — the proof is a file, not a coin.
  4. Anyone verifies it with the reference client and no permission from us: ots verify -d <root> crawlcheck-2026-09-10.ots

2026-09-10

Merkle rootb70be949fdd8762d8b4a3aa03c643a8c1e84d7d2ff3011ed0edd56797819e44d
Reports covered153
Sealed2026-09-11T01:17:51.748Z
Bitcoin anchorsubmitted to https://a.pool.opentimestamps.orgdownload the .ots proof

Every sealed day

29 days anchored. Each links to its own root and proof file.

A fresh submission reports pending confirmation until the calendar’s next Bitcoin transaction confirms, usually within a few hours. Run ots upgrade on the file after that and it carries a block header attestation permanently.

The 153 digests sealed under this root

0138a8b0d39aadfba4b473f93adaab693f83fa1a85a488571ac524af55f0a964
02b2f50a4819018293ec1a500646d54ac1a89055f9ac9e8ce94499dd7ebf3ee8
036013e1980f0dcf87ae3d88bd7d6fec3027cf76d5076d5499b778dc2286a3a5
0417fc890114913a319a9cfd43612693bd129907f5665c257819758a577493f8
0467b05e53186c0f4a44e01c7fb5c3622352b38f530d7f609db85bb2f124bb69
07e590de4357f57c2418bcbb44d9002d6b1b028d501d9a82c5e989562331c2d4
0a871168e5c2e337bf7ffba26153324a433317e73ad88ebf10694485d3a69606
0bb0323047561739f1f9843232ece715bdf75facc154270ea51d387cd86aec2b
0d01e3cabc2784cd35cc6afb03e92fd94fef7904c08cebab32e35c750da906db
11f167449834f639684d2020ce0c253c1657047e21d621f8afd60cb37854a44d
1274e876eddfc24eeac2afa9fec71ac44904e37277250e2f5339445436bfade1
16e2992b8b9e6b90d84840be5af13409b7b43ca23ae7f5cd6e57b7f6ca5657ac
17ca7b1ca83a60840a40e01934fa47f7a4d7b058e4f9ec66f2e160a4fa49f835
1cd3e26b359b56348633b1d8d61e826fb6d6433f1ff96752ba09b543314f9dd7
2041fe627650c5095473eb7d1dd3bfcfd04b70714ae376209df462c0032dc330
23fb81187333c684de3fcb18d5f9305827cd33ef991810bfb70045fabb880e39
260b75470eb781bee274efffd0e40d743cce3af601387e1bf5bf91085bfeecaf
28ff6e36d046f1ecd87ac21a09bcb538a84217f8a52f250d33e770be113bdb18
2bff6744340390685518e1c70efe80b7c82771381575681e494b8350843bcc3e
2c2f1d34f48f901634ee1993ddc5645d6af79e662d27822fd63673aa2a4d7035
2da263a19187687c7ae710127006a83adb0cfc50954e378f0fc018868d2c15ce
2e699edfd34670725f62a794ff19c4914498b5ad9adf76824298c36f906aa01b
2f49d9601a45adbbba50127fd1105a54ae531f37f11e70814e475a871b63fe11
32f6b4afc7e9ba4fc69141ffbc3f8ff69ff092a55d1da3f3d2920af8d3975328
3313b7a64eec5a6cf59e0d74fe6a88980a36ff5da1ff33f588adda0c278cbe07
331cc83b99a0a7d5fdf4abf57538f0612c457b2866fae43706c343ffdec1b019
34325835253909ecf5c217c88e080c159ee38ab64eb00c0feaddc0435e4fc58e
34c7cd2c932b0afdd60a5031e9b380f9205fce93423f6be8331e524946181ede
352a75ce5aa9bdd6a83720b55b59c380a394f8b825445212ab53efca1209e155
353b4f0acf42f94ee9cdabac2ac5c65ac85ac1a506f2ba53e3719f3bac52c319
393ad3d87ce1d8a48031b3e112a9da0121a8ebf74f8ce5ca030e2735bf73261d
3b81b1a9856860be34bf60b387121bcef21b3231d8c604d8d2cb1790518496ad
3c28f35921e8cf733faeb9c5307e2eb3aaa1cbca0ad0b06c242b1a634b2ffaa0
3c62cf80e64a22fb0c1a1cf1c8335b8dac6b820bc410b97f2644fa603b7efa6b
3f33ec9a008bfba03fc6b80fea5deca83adc94f884d46665b9000cb420fdd851
4014433dcd5308c9e332b469faf7cf02d5cb5d75f610035850c30f56ee05932a
41bdd740a8b39db853654c8e94f2d1a11205e19075f3f548a3b7d6b1fa7547f2
429abb054183af4bb8f2a2598a48ba50c110f513b15baf8d4ff1b272e5dae59c
435327a38a12d67874ba390425ea42b564e10efcf6ea4a0739ea20991bd1e9a2
43ec73b2562134fad9e18d9481fc00b116d810dc0a7c8f220a9a19a89926071b
44ba9cddcd32312b1f2598aecdb528a844094b908f4d8bf088fcb4fc92efc7c4
4508530c46f3e07010b20704468750a6189d1f8666a91b311c0ffaa95e6ef670
456f303dd21d0f75b842844ec3d1c9cd6c9d4d8a0c8218de1d80bf24c8c2fbd9
458ac275e619ae590767fb9dfb714dd1bc79ffbc6531774c7c7da55fb4ab7d4d
46b638290005ae0c0b9dcb1b3f8c434c77cb82bf102e9d682b03f1a03a87d713
46bc741510175fddbbe96c2165078d264358e7719567dc1045f6caeb69a70705
473025ecca07133627fa1c6c6167d71d4da83642a4f28cf9446f35ed980884ce
4ceda3b1f0b44542ecd47145914c0f647ca4e0262dfd49612cf4c26d6f8bb803
4dd3f2da4aadd93cda2515f7d4f1cc27447a2620803b6115e151b56042842800
4ffd4b44fdd2cd464cbdafc6b552bf6f80640ce911631c44240394adc6c38101
50224b45aa9e91bd21d67cbee821520fd995b3447fe2bcd42e77ad313b934544
50444ef4c54eae96449c2154d8c94abdc312dad5e72c436286dd3122c199ae94
515fe6a2ea1d758e33a7c8e535331f65569646bb5115f7e598a992dcb224d293
5a4a5ea845f493656276e7ffd06679a4a926cb03cd180d8e80af08a4d6cfe745
5b498aa0c4e7a22b2e2b3f449913b2aec9f6e028d1bd974c94b608db609933dd
5b4bd1d1abb04eb40c9d61153fef60bc9557dcbd1e9e980227c24b960d715f7e
5bba6645b680d9c3e19aa8f11d685948c356e4b949ecaaac041ea7d9384b4586
603dd21868f67ee9efa6b87684e7f72a9f0b78fe785e021a49d35f04b604d6a9
60db49531feb187255e21b1a584ea4ae527a9abe1cb9306bdc5a8a8b57b04d7f
61942453c2a56b6fd3d94b84a24757e0415984bb4a5a06c0bd987bea91e8d45b
62dcccc4a194eb4b167d46c1f0096961b6947cfa7b9e3cfdc1aa807840881ddf
69afb38fa70dd13fd367f454ad72fdab61a1a9d4522e7c985fbed586b574ebb9
6ac17730287ad76876c95b9fdade4c92fd08e9a9348b75b17fb27d116bb6de50
6bec91ba27e089ec34cc82d5de78ac9c7eb99c20ba890dcb312496ec705e8a7d
6d54e472d65ebcc51063ed51ff926b832f73e83660d527756e126c03eb5ac9d6
6e06b4d28ed5bb5d1f6768bd06547d0ff411c525354a09321a1423b05ed080ba
70c55420128cddf86780f755e3eb1ba8e566e6d257337f19b97f173c4da258dc
7491ac33e46ccc1692cba7b0045fa3652063106b8cfb1643fb107a69fba52688
76447838b929d4bdcb99287bc664827eab476914bd082f17166b5858092c0ba2
788220b4d497de171daa2f47bf51373378ea38b19a031952af0b7a88485f3f8f
78f6912c321423938cb407ecdf665d8587cafd503cd351e662047793152b4657
7995d932b15a00992f34992c0e4385bd4542eec63b15d862e82241dfe7ef7b05
7c8cdd5e150fa50fdf5943a6e7c0967f18c15d77892e5a9f857a101a778d0e18
7ce1e25799dc62c17a481aa8940a5159a0ada21c4c2ff35418b24ffcb8c3133d
7d68f73cc5ba1463b53f0c76290d7ff1456e290bd9a29c75f0e299f735d12103
7d7f78a178dd63fe4840dd317dd43ca96d75c8e7167ad486c505bc4fd9c0b3dc
7e009cb2a142b25413d92c391c9342e253138030f5070d3037937be8399f4cc0
8234f23bf668965624c770b2468d8179e87a70655841e79a09f42bc5faef26b2
82a883e959c67085e29d53f254ede634178b5fbaf3bdcfd1a279cd0f6032599a
82abe46dc8e5b05d2cd7481bfcffd575b0a890825d81f409586b760bff393bb2
831a8dfadd137f21d77a8043eb764bf7b192959dc1176a4af53a9a4839ea9834
8594b06f37f0b26b2b738a9e8713610c97d00aeea651c90a17ee4417eac71f03
86233a7c6d254cd7092fcd96f2d6c36b04b51f44647bd649b5423aa209f43e15
86e00f359ad1484fca741c2529d1c18ec728b009d552b9bf3f475e9a430c7c9b
870cf223d17f461d71a435dc906b7a1c9afe95098decb112a7a6fb41d0190b81
88a7b53635c2dfb51fdeca9876f0b009287aab1b959460eb6df1ce9cb2aa491e
89e0fc80aadefaf3c4ea4f083edd747b29c4612cdee7b55e7c90e8ffc57b988c
8ab7c3f110d3200e51d01e111aa693779681d7af4ecf7af07e2fcfacf3dadc9f
8af9749d14d401b7c473ac67f96c178b8ed941449bf0bc5763d7099e372d417b
8d6d671ccbfe8b2254d048caa958a14c93d3fc25d499686259153fb61419f0bd
8f72b5944c84d174201c80b3e22e0bf919220b374e1aced70b0bfca10d871eea
8ff30c4b0756f72d6b97b2099cd882d2ef5f096dac1f20c2813748f818e25dbd
907ee3757f1d300250250fa60cdfc9f503c561cf6c0be8a71a4ad8a0ca0317bf
916782908a65a3bcbb3d68998dd1930001558a089232d2f5e136c9ca1be9b038
94df5de411374ba5d4659031e6224dac75978a288547d38c931c8fdcbfa10def
975e93299ae9af0e21094d53e69eee2b7b3ea27c82cc67545052986019082c5a
9a3dc43dffc5af0d43f96cf388d06f1b2a1dd1b58d555a3f5380720d0bdef55c
9c2dcbf25acca79b11394c9e9073bf3a26e1a09abdb237dd24257864fe3e4d80
9eb3f3d53ee1893d2be7c996f8c86b332322778194f4095be1421fdebd092728
a0a61ba4ec26a30f6ed41e9755c99d2391b4a401d8005d1f8fa645fac52cdb88
a208a210aa03aabefecc882a46c652923a4e44e2e895c0ef8c5d6ccf193e4dfb
a282372659f183a09e2440b9bc1267c332670ad2562f42dd39c270dff413eac6
a3fc87a5821c03c5846f307b5802c9036c601869eaea90e3584db4e4ed3fc688
a4d6c1cfa9b724a28c4b5e16b4e202d225ec42f3d4098a01300e5c472c864517
a8170a7cd0dc1e8f2923639467262c70f75972a4cc6ed41607aaa4481e38ce41
a9d8e4b20f17ee09a40281b338f6513ca19a45d1521692c4ce1bb5e0cd42edfe
acc139df6c44c826e424aafe9a64b3ab8043dc7389c7cf5102a36f517ce68862
acd670bb7d211a277401d17399bdd7179cacfd1eda9ae08419d72bdfc83a568a
ae6542ad17d727a7f412280f7aec34912ced5d2c54cb71f7ce75f6c722f1d160
b01a3b89aa8138ee697e9239f0af9b5779b4f9a929b0d6bc449b098c2daa62c9
b07a5580ba90d1ff4ce73a15ffb60ddd6b36c39b860a17e2842ee16f0054a47d
b0835f2d28d7d9c24b7af80631c9c93595a4aa4443c7b04a3e80953ff1f5654f
b2ac695e8a115c435aec59f82ee462044cf8264d1cd0e7dd3674451ddb5e9883
b4ba1e11cf1125d81e73271878558ca227488c9b624b2c8aaa07b984d7fb0551
b6f784cbbd55df2a3d889b06901a9c2255a915c229bfa30d2ae5aaf159eaeb79
b7e0bcd3e8361d20348b3ddf263805338d4714a8f2f8d561cffbbeea3a9ec22b
b98ec96365f435c1dd36f259ed17ddc1f73dea66612f0391b52dc04afcf8c305
bc3c71a3cd2a4966fb0e03b21d3cfc329f086448bf15fe0717c1f15947c529c9
bda5d7171ff40bd72856deb5253100df1be47f0fda9632a35e4fa58580f9630a
bdd03cb59e992daf3aa211a6bbae845bb476aa3fa1499568f2ee29d3ea8dacdd
bf62331c0065f781692dd2c664e6bb92ee56272118889e27540406fef7edd328
c29ade00a183a7863f4cfa6c9aad245c543d5c6830d97fe6208a91d39c821129
c3583810dc5fe9c0c594f38e6aa55e6de4a71af19276974fdd56f8ceb0451004
c35bc4cf1215f5081803d97bb00ca4e0428c1998ab8fd7e23b4361e7d7068dde
c54f4e12c7aa0a5f3d9dc79206192c29e9262caa9f3da1ee110a5d66bc23562c
c64c49f232e5a92aa29a812b8101a632ef6863cf9189ea0b50ca0fc0bc6cd4d8
c73280e847827dd0633c6c43c6298220c2f23dfbd0ac4a1b3da6222a8c16f8c2
cd7029c27669f1b62abaa4e23097af67c3430513b4e2266874c40611c4152d02
d65e5720e0b12c5bd4a1606160c68373cfd78d323a5904da38d61b8993b12334
d7282110759da7ea2232fcc2fd8968b709fc87274b6bb20c162c20d206033de7
dc4c134d1268aabfe1bdded6de1aa0e2c24213ad4b6054f33937309a061c4884
dc77322bc05e90a376aa15d8b13456bd39aa397ba98b0ff07a1e9a8c1dfddbf3
dd00968303159731881a9e1dff46a69cd116a874e49c39fd2d2258c593d0e3ee
deb5bc07544e55016c6d1b9b2f254603df1daeff0798cf14522aa8afa8d1a897
deefcaa126755449508448f7f9bf2fd55c2f3104dc7b06a191104cba1631c059
e169cc53c5ca6c32ef7974bf7f3d9b25de4980619565a610286f8e7152dda138
e544c856186d87a43d21a4f0c182f1937face07d6b12ff8a1dd6df421c3c710b
e5953c210ee69516854488e55d0f64305602f37eb7937a13a3f0d60c4760ef64
e60af4b8e2710f2eaf4a9530f27c21db62bfb799820a9b3ca46371c874ee6c1d
e61c322026d243a75ccccaf5ab06dc44fd5c4b3074aecd04d2ee2dceb5bb1f93
e645dfe64858679b79b11306a76ab2fd7ede2ad621f2d1499b207ae0ebcff17b
e6d1f7a2df60c1890e9918408eec7a019aca5838ebaca98044e7686a69f397a5
e90f104d58f6ca5f17d33e2ef925e5a939ab805021523b79f5c4da818db7e6bc
eb0bd4f8c4f15cdc6dbe6189feed4b597f74ac1c3fbec4141095badb0e0bf26c
eb5d09978791847e87a5665a83f6f25eae77a13aef18868c0f0888544188a3f0
ec177269e8c4996b496077973f77ccc306f092ac58d7477a2ff2645cfd26211d
ec96bcbb9326bfdb2563bbff1bf3914962c42536f43e6b9879a787fe60b18609
eeea7470be1c781b8ca35f76c4f7ba50329114947e632dce76d739f04f42c1b3
f0f69670f0d7437cb5bcc779c4f00ad42e1837ac66418c4ff97544285c74240d
f3c51c760e5511a82f7230117d26faeba1768de1dc05a69a7947622ca0d2051e
f41ae069e1cc204ab5cd1e5f13e45c7cfb061f1ec21fbcf1b8dee657a4d7e81f
f9e1744ab9315fc0ef50f381a6643cc16927eb4b0cea0927a88ca47abd802666
fcdc11fe1651e44937dac989bcf54a657100aacab506cd8327f226649513d0ef

Questions about this page

QWhat does the Bitcoin anchor prove?
That a report with exactly this digest existed no later than the anchored block, and that it has not been edited since. It is a proof about time and integrity, not about correctness.
QHow do I verify a report myself?
Download the day’s .ots proof from this page, recompute the report digest from its JSON record, and verify the proof with the OpenTimestamps client against a Bitcoin node or public calendar. No CrawlCheck server is needed for the check.
QWhy exclude wording and layout from the hash?
So an editorial change never invalidates a measurement. Only the measured fields are hashed; the words around them can be improved without the proof breaking.
QWhich days are anchored?
Every sealed day is listed on this page with its digest and proof file. Days are sealed once, after they end, and never recomputed. A day sealed within the last day or so reads as pending in the reference client: the calendar holds the commitment, and the Bitcoin block confirming it is usually mined within 24 hours. The proof file here is upgraded to carry that block header once it exists, so a pending file is a proof waiting on a block, not a missing seal.

Keep reading