Datasets · credits
Credits: pay once, spend on any file
1 credit = $1. Spend credits on any list, any of the 86 technology lists, a state pack, or 30 days of a lane. They do not expire, the bigger packs add 10% and 20%, and custom orders are paid from the same balance.
Your file
Websites using Shopify
1,055 sites · 199 credits ($199) · 30 days of downloads · what is in it
Have credits? Paste your key to spend them; this browser stays signed in.
No credits yet? Pick a pack below. After payment you land back on this file with the key, one click from the download.
Buy credits
Starter
$250 once
250 credits
- $1.00 a credit
- One list, or a state and a technology
- Never expires
Pro
$1,000 once
1,100 credits — 100 free (10%)
- $0.91 a credit
- Every ready-made list, or six technology lists
- Never expires
Business
$5,000 once
6,000 credits — 1,000 free (20%)
- $0.83 a credit
- A year of lists, states and technologies for a team
- Never expires
Checkout is by Stripe. Buying again with the same email adds to the same key. Prices are per organisation.
Every file, priced in credits
| File | Price | |
|---|---|---|
| Online stores listEvery site that sells online, with its platform (Shopify, WooCommerce, BigCommerce), grade and AI-crawler policy. | 299credits | Spend |
| Publishers and news sites listNews and article sites with how each treats AI crawlers: licensing, ad tech and PR targets. | 199credits | Spend |
| Sites that block AI crawlers listSites whose robots.txt shuts out a named AI agent (GPTBot, ClaudeBot, CCBot), with which ones. | 149credits | Spend |
| Sites with an llms.txt listEvery site that publishes an llms.txt, by sector and platform — the early adopters. | 149credits | Spend |
| Trades and home services listPlumbers, electricians, roofers and trades, each with its city, platform, grade and the defect to open with. | 299credits | Spend |
| Domains open to email spoofing listDomains that take email but have no enforcing DMARC policy, each with its mail setup, SPF and the platform it runs. | 249credits | Spend |
| Sites missing basic security listSites missing basic protections: which headers are absent, exposed server versions, outdated jQuery, insecure content. | 199credits | Spend |
| Domains expiring in the next 45 days listDomains whose registration expires within 45 days, with registrar, expiry date, DNS provider and hosting network. | 149credits | Spend |
| Domains registered in the last 6 months listDomains registered in the last 6 months that already serve a live site, with registration date, registrar and stack. | 149credits | Spend |
| Sites running a marketing or support platform listWho runs HubSpot, Klaviyo, Intercom, Zendesk and 12 more — a displacement list for competing vendors. | 249credits | Spend |
| A technology listEvery site running one of 86 technologies, last 7 days. Priced by size: up to 1,000 sites, up to 10,000, above. | 99 / 199 / 299credits | Pick one |
| A US stateEvery measured local business in one state: city, category, platform, grade, technologies, AI-crawler policy. | 149credits | |
| SaaS and software, 30 daysDaily files and the whole history of the lane, for 30 days. | 349credits | Spend |
| Government and education, 30 daysDaily files and the whole history of the lane, for 30 days. | 349credits | Spend |
| US local businesses, 30 daysDaily files and the whole history of the lane, for 30 days. | 349credits | Spend |
| All lanes, 30 daysEverything: four lanes, every list and technology in full, all history. | 899credits | Spend |
| A custom datasetAn industry, a country, a technology or a field we do not list. Quoted first, then paid from your balance. | from 999credits | Order |
Each file opens for 30 days of downloads from the moment you spend; spending on a file you already have open costs nothing. Monthly plans by card stay on the datasets page.
How credits work
Do they expire? No. Spend them this week or next year.
Can a team share them? Credits sit on one key. Anyone holding the key can spend and download, so share it the way you would share a password.
How do I download? In this browser after you spend, or from a script with the key in the x-crawlcheck-key header. API docs.
An invoice instead of a card? Write to hello@crawlcheck.io and credits are added to your key when it is paid.