Agent view · Findings · 2026-09-29
Release notes 29 Sep 2026: finding states, sitemap, trust
This is the response this server returns to a client that asks for Accept: text/markdown at https://crawlcheck.io/blog/release-notes-29-september-2026-finding-states-sitemap-index-trust-center: fetched when you opened this page, shown byte for byte. An assistant, a crawler that negotiates markdown, or anything reading our feed gets exactly this. The markdown leaves signed (RFC 9421, key in our key directory), so a crawler can prove the page it read is the page this server sent; the check is shown below.
| status | 200 |
|---|---|
| content-type | text/markdown; charset=utf-8 |
| vary | Accept |
| link | <https://crawlcheck.io/llms.txt>; rel="describedby"; type="text/plain", <https://crawlcheck.io/.well-known/api-catalog>; rel="service-desc"; type="application/linkset+json", <https://crawlcheck.io/blog/release-notes-29-september-2026-finding-states-sitemap-index-trust-center>; rel="cite-as", <https://crawlcheck.io/.well-known/http-message-signatures-directory>; rel="http-message-signatures-directo |
| cache-control | public, max-age=900, stale-while-revalidate=2400 |
| bytes | 12,173 |
| words | 1,654 |
| sha-256 | eb4dfe26f455879cfb19ce7769dc5d78392f7d1177a5fdf9728e16aecad5c5a8 |
| repr-digest | sha-256=:603+JvRVh5z7Gc53adxdeDkvfRF3pf35co4WrsrVxag=: ← matches the body shown |
| signature-input | sig1=("@authority";req "@path";req "repr-digest" "content-type");created=1795182067;expires=1795185667;keyid="1hHmE3fo1rg5Ig70wuFtJ5wBc7G-sUTgUJkxyPWFRps";alg="ed25519";nonce="JHluwT8lRVHsYZtzs_Hehg";tag="crawlcheck-page" |
| signature | sig1=:PikZE7ArmOvQuf1mxfJLTqkHlZNvaYKIgVFdZhvTWO8ceEGTC8G4Gamz2XcA0VLqn6T3DcAYaf5KPov8QoeLCg==: |
| verified | yes — signature by key 1hHmE3fo1rg5Ig70… from https://crawlcheck.io/.well-known/http-message-signatures-directory (directory valid), valid for 3599 more s. Checked here exactly as a crawler would; redo it yourself: https://crawlcheck.io/api/tool/wba |
Findings · 2026-09-29 · By [VSNARY | Emmanuel Orta](/author) # Release notes 29 Sep 2026: finding states, sitemap, trust What changed on crawlcheck.io on 29 September 2026, and where each change can be seen on the live site. On 29 September 2026 CrawlCheck made findings trackable across scans, so a report says whether a finding is new, persisted, improved, worsened, regressed or resolved, and whether it disappeared only because a rule changed. Every finding card now names its rule and says how to verify the fix. The sitemap became an index of five files. Reports in German, French, Spanish and Portuguese lost their last English strings. A trust center, terms of service and a refund policy went up, and paying customers can manage billing themselves. On this page - What changed in reports? - What changed on the site? - Trust, terms and billing What changed in every report Finding history What you see Each finding is marked new, persisted, improved, worsened, regressed, resolved or rule-changed Where any report Rule-changed state What you see A finding that vanished because a rule changed is not shown as fixed Where any report Rule and verify lines What you see Each finding names its rule and says what a re-scan should show once fixed Where any finding card Translated figures What you see Tooltips in German, French, Spanish and Portuguese reports no longer carry English Where any translated report The first entry in the releases series. Every line names something you can see on the live site. Everything below went live on 29 September 2026. ## What changed in reports? # | Change | What you see | Where | | --- | --- | --- | | Finding history | Each finding is marked new, persisted, improved, worsened, regressed, resolved or rule-changed | any report | | Rule-changed state | A finding that vanished because a rule changed is not shown as fixed | any report | | Rule and verify lines | Each finding names its rule and says what a re-scan should show once fixed | any finding card | | Translated figures | Tooltips in German, French, Spanish and Portuguese reports no longer carry English | any translated report | The rule-changed state matters most: you can tell a finding that went away because your site changed from one that went away because our rules did. The [report guide](/guides/how-to-read-a-crawlcheck-report) explains each part of a report. ## What changed on the site? # | Change | Why | Where | | --- | --- | --- | | [Sitemap](/glossary/sitemap) split into an index of five | The single file had passed 1,700 URLs and earned a finding we report on other sites; the split cleared it | [/sitemap.xml](/sitemap.xml) | | Certificate pages listed | They were indexable but listed nowhere | the certificates sitemap | | Lighter pages | Homepage HTML went from 61.7 KB to 38.7 KB by moving inline styles into one stylesheet | [the homepage](/) | | Links check | No longer counts non-links, or account and checkout pages, against a site | any report | | Blog kinds | Posts filed as research, corrections, case studies and releases | the blog filters | If your own sitemap has grown large, our [sitemap audit guide](/guides/xml-sitemap-audit) covers when and how to split it. ## Trust, terms and billing # A [trust center](/glossary/trust-center) went up at [/trust](/trust), covering data retention, the security headers the site sends and the domain's mail authentication. Terms of service and a refund policy went up the same afternoon; the refund window is seven days and both are linked from every page footer in every language. Paying customers on monthly or annual plans can now update a card, download an invoice or cancel from their own dashboard without emailing anyone. CrawlCheck's own report of crawlcheck.io at the end of the day: grade A, 99, zero findings. **Live, as you read this:** the corpus now holds 570,959 domains across 9,163 scans. The figures in this piece were measured on the date above; this line is not. CrawlCheck’s dataset when this page loaded: 570,959 sites measured. Written by [Emmanuel Orta](/author) · VSNARY I build CrawlCheck and write everything published here, from measurements the verification layer took. Where a post got something wrong, the correction stays in the post. [Every post, and where I got it wrong →](/author) · [Follow on LinkedIn →](https://www.linkedin.com/in/emmanuelorta) Share this finding: [LinkedIn](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fcrawlcheck.io%2Fblog%2Frelease-notes-29-september-2026-finding-states-sitemap-index-trust-center%3Futm_source%3Dlinkedin%26utm_medium%3Dsocial%26utm_campaign%3Dshare)[X](https://twitter.com/intent/tweet?url=https%3A%2F%2Fcrawlcheck.io%2Fblog%2Frelease-notes-29-september-2026-finding-states-sitemap-index-trust-center%3Futm_source%3Dx%26utm_medium%3Dsocial%26utm_campaign%3Dshare&text=Release%20notes%2029%20Sep%202026%3A%20finding%20states%2C%20sitemap%2C%20trust)[Email](mailto:?subject=Release%20notes%2029%20Sep%202026%3A%20finding%20states%2C%20sitemap%2C%20trust&body=https%3A%2F%2Fcrawlcheck.io%2Fblog%2Frelease-notes-29-september-2026-finding-states-sitemap-index-trust-center)[Follow Emmanuel on LinkedIn](https://www.linkedin.com/in/emmanuelorta) ## Questions this post answers ### What does rule-changed mean on a CrawlCheck finding? The finding stopped being reported because a CrawlCheck rule changed, not because the site changed. It is never shown as resolved. ### Does a resolved finding mean the site was fixed? Resolved means the finding was present on the previous scan and absent on this one, on a scan that could see it. ### Why is the crawlcheck.io sitemap split into five files? The single file had grown large enough to trigger a finding CrawlCheck reports on other sites. Splitting it into an index cleared that finding. ### How long is the CrawlCheck refund window? Seven days from purchase, as stated on the refund policy page linked from every page footer. ### Can I cancel a CrawlCheck plan without emailing anyone? Yes. Paying customers on monthly or annual plans can update a card, download invoices or cancel from their dashboard. ## Related findings [2026-10-14 Release notes 14 Oct 2026: doors, weekly figures, trial 14 Oct 2026: crawlcheck.io reorganised into four audience doors, signed weekly editions for every live figure, a 30-day Watch tria](/blog/release-notes-14-october-2026-doors-signed-weekly-figures-watch-trial)[2026-10-03 Release notes 3 Oct 2026: Resolve, census, rulebook 3 Oct 2026: a signed Resolve answer for AI agents, the first top-1,000 census and its correction, a public rulebook, signed receip](/blog/release-notes-3-october-2026-resolve-protocol-census-rulebook)[2026-10-14 Sitemap lastmod: 103 pages, one date, why engines skip it 103 pages in our sitemap shared one lastmod though most had been rebuilt. Why Google and Bing ignore dates like that, and how to d](/blog/sitemap-lastmod-103-pages-one-date-why-engines-ignore-it) The main product Found this on your own site? **We fix it for $100.** Scan free to see where you stand. The fix is one site, every finding implemented and re-measured, with a sealed before and after. [Fix it all — $100](https://buy.stripe.com/4gM00j7OjawhdLEdyR2VG0v) [What it covers](/pricing#fix) · [scan first, it is free](/) Free browser extension Check this on any site you open, **without leaving the page.** CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account. [Add to Chrome — free](https://chromewebstore.google.com/detail/plgjengobhbdmbgckiiaaflgiepdbcpi?utm_source=crawlcheck.io&utm_medium=post) [What it does](/extension) Write for the library Measured something yourself? **Submit an article.** Send your finding, the data and the method. A person reads every submission and replies by email; accepted articles are published under your name with a link to your study. Free to submit. Articles are accepted on merit; no one can pay to have one published. [Submit an article](/submit-finding#send) [How it works](/submit-finding) · a reply within about a week Spotted a mistake or a bug on this page? [Report an error](/report-error?k=article). Confirmed errors are fixed and logged on the [corrections page](/corrections). ## Comments Comments are read before they appear. Nothing is published automatically, and no account is needed. An AI agent with a published signing key can post without the queue: it signs the request and the signature is checked against its own domain ([how](/api/comment/signed)). Those appear at once, marked *verified*. Send for review Writing about this? [Facts, live figures and marks](/press) — every number on that page is dated and traceable to a scan. [All findings](/blog) · [The dataset](/data) · [How the dataset works](/policy) We read your site the way crawlers do, from our own network, and every report says exactly what was asked for and what came back. [Who runs this](/author) · [Press kit](/press) · [Videos](/videos) · [Evidence for disputes](/evidence) · [YouTube](https://www.youtube.com/@crawlcheck) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io) #### How we measure, and our own machine files CrawlCheck reads every site as itself. Its crawler-identity tests send named user-agent strings from its own network, never from an operator’s published range, so a site that verifies crawlers can tell them apart; every report says so. Results reflect what an anonymous non-browser client receives. [What we collect and how to opt out](/policy) · [how every report is timestamped](/proof) · [who runs this](/author) · [press kit](/press) · [hello@crawlcheck.io](mailto:hello@crawlcheck.io). **Second vantage:** the [browser extension](/extension) measures what crawlers are served from your own address and after your JavaScript runs — the half this server cannot see. From 1.0.0 it sends the domain you ask about, on one button, and anonymous usage counts you can switch off; from 1.0.3 a footer switch turns off the hostname lookup for the grade on the icon; from 1.0.4 a share switch, on by default, sends a signed Two-vantages reading (status, size, words and a hash per identity; never page text); from 1.0.16 chips send the hostnames of search results and AI citations while the chips and grade switches are on; from 1.0.17 a readings switch, on by default, sends one signed page reading a day (numbers, the hostname and the page address with the query removed; never in incognito; at most 40 a day) and only while the share and grade switches are also on. Earlier versions send nothing. **Our own machine layer for the agentic web:** [llms.txt](/llms.txt) · [llms-full.txt](/llms-full.txt) · [agents.md](/agents.md) · [SKILL.md](/SKILL.md) · [entitymap.json](/entitymap.json) · [media kit](/.well-known/media-kit.json) · [MCP server card](/.well-known/mcp/server-card.json) · [API catalog](/.well-known/api-catalog) · [OpenAPI](/openapi.json) · [robots.txt](/robots.txt) · [sitemap.xml](/sitemap.xml) · [security.txt](/.well-known/security.txt) — every one named in robots.txt, which is exactly what we check for on yours. **Pages:** [Listing check](/listing-check) · [SDK](/sdk) · [Certificates](/certificates) · [Removal](/removal) | **Registry:** [MCP: Operator](/registry/mcp/operator) · [woorank.com](/registry/woorank.com) · [agent-exec.448c.org](/registry/capabilities/agent-exec.448c.org) | **Datasets:** [West Virginia](/datasets/state/west-virginia) · [Technologies: Wp rocket](/datasets/technologies/wp-rocket) | **Guides:** [Localbusiness schema for service area businesses](/guides/localbusiness-schema-for-service-area-businesses) | **Glossary:** [AI classifiers: Answer justification](/glossary/ai-classifiers/answer-justification) · [OCR](/glossary/ocr) [Contact](/contact) · [Partnerships](/partnerships) · [Terms of service](/terms) · [Refund policy](/refunds) · [Trust center](/trust) · [Subprocessors](/subprocessors) · [Changelog](/changelog) · [Report an error](/report-error)
Same body as a file: /blog/release-notes-29-september-2026-finding-states-sitemap-index-trust-center.md · as data: /feed.json · what we tell agents site-wide: /llms.txt, /agents.md. To see any other site this way, from your own browser, after its JavaScript runs: the browser extension.