CrawlCheck

Datasets · by problem

Pages meant to be found hide their own search snippet

Pages that allow indexing also tell search engines to show little or nothing of them: nosnippet, a max-snippet under 50 characters, max-image-preview:none, or an unavailable_after date that has passed. The page can rank but appears as a bare title, with no description and no image, and answer engines that respect nosnippet will not quote it. It is usually a theme or SEO-plugin setting applied site-wide by mistake, or a header added at the server. No site in the newest files has it; the list fills as sites with it are measured.

  • 0 sites, last 7 days
  • 0 US local businesses
  • 0% also block an AI crawler
  • $99 once, 30 days of downloads

Who has it

A sample from the live files. Names and websites are withheld here; they are in the file you buy. A business found with a defect is never named publicly before its owner has been contacted.

Every field: what a row holds · 25 free rows · a problem, country or industry we do not list: order a custom dataset.