Directory · ML platforms and experiment tracking
Databricks — what a crawler receives from databricks.com
Website measurement, not a product review. This page records what machine clients received from databricks.com. It does not evaluate Databricks software, features, pricing or support.
AI assistants like ChatGPT can reach your site, but get very little they can use.
AI visibility 74/100, measured 2026-11-06 04:32 UTC from outside its network, as each named AI and search crawler and as a browser. An engine can technically reach this site and would struggle to get anything quotable out of it.
3
findings
✓
llms.txt on its host
✗
entity map on its host
10
scans on record since 2026-09-18
The three stages, in the order an engine hits a site
Each stage gates the next: an engine that cannot reach a page never reads it, and one that cannot read it never quotes it.
Stage 1 · 40% of the score
Reach
Can a named answer-engine crawler get your pages at all?
Every named crawler was served the same page a browser gets.
- What each crawler getsn/a
- Crawler permissions100
- Machine-file chainn/a
- Speed100
- Server & hosting75
- Internal linksn/a
- Mobilen/a
- Exposed files and secretsn/a
Stage 2 · 30% of the score
Read
Once it has the bytes, can it find the words?
The content is buried in markup, or the files that guide a crawler are missing.
- Page weight & textn/a
- Machine files50
- Sitemapn/a
- Crawl wasten/a
- Accessibility structuren/a
- Image signalsn/a
- Instructions for agentsn/a
- URL namingn/a
- Error pagesn/a
Stage 3 · 30% of the score
Quote
Is there a specific fact it can state and attribute?
Not measured on this scan; left out rather than counted as zero.
- Structured datan/a
- Local presence & NAPn/a
- Claim consistencyn/a
- Authors & trust signalsn/a
- Linked datan/a
- Quotable contentn/a
- Entity corroborationn/a
- Page subjectn/a
The stage to fix first is read, the lowest of the three.
What to fix
3 findings on this site. Every one is named below; the top one is shown in full, free. What we saw, why each matters, how to fix it and the bytes behind it are what a licence buys — or we implement the whole list for you.
1 Low 2 Note
1The sitemap does not say when anything changed17 child sitemaps listed, none carrying a lastmod date.LowContent
What we saw
17 child sitemaps listed, none carrying a lastmod date. /sitemap.xml
Why it matters
The sitemap lists URLs but carries no usable lastmod dates: either none at all, or one date copied onto every URL, which says everything changed at once and so says nothing. Either way it tells a crawler what exists and not what changed. A crawler with a budget uses lastmod to decide what to re-fetch; without it, the choice is made for you — usually by re-crawling little and late. This is the change signal every crawler already understands, and unlike a push protocol it needs no key, no account and no participation from the search engine.
How to fix it
Give each sitemap entry its own <lastmod>: the date that page last changed, not the date the sitemap was built. Then a crawler can prioritise the pages that changed.
Content: words, markup or images on a page — no deploy
On Drupal (detected)
- Install Simple XML Sitemap (or XML Sitemap); it serves /sitemap.xml with lastmod and can add itself to robots.txt.
Fix it with a coding agent
Paste into Claude Code, Cursor or Codex, opened on the code that serves this site.
Show prompt
You are working in the codebase (or server/CDN configuration) that serves databricks.com. A crawler audit found the problem below. Fix it at the source, keep the change as small as possible, and do not change anything a visitor sees unless the fix requires it. Finding: The sitemap does not say when anything changed (SITEMAP_NO_LASTMOD, low severity) Page: https://databricks.com/sitemap.xml What was measured: 17 child sitemaps listed, none carrying a lastmod date. Why it matters: The sitemap lists URLs but carries no usable lastmod dates: either none at all, or one date copied onto every URL, which says everything changed at once and so says nothing. Either way it tells a crawler what exists and not what changed. A crawler with a budget uses lastmod to decide what to re-fetch; without it, the choice is made for you — usually by re-crawling little and late. This is the change signal every crawler already understands, and unlike a push protocol it needs no key, no account and no participation from the search engine. How to fix it: Give each sitemap entry its own <lastmod>: the date that page last changed, not the date the sitemap was built. Then a crawler can prioritise the pages that changed. Detected platform: Drupal. Make the change where this platform controls it. Rule and examples: https://crawlcheck.io/rules/SITEMAP_NO_LASTMOD Full report (markdown): https://crawlcheck.io/r/gjr92ka1l5.md When you are done: 1. Tell me which files or settings you changed and why. 2. If the fix is a server, CDN or cache setting you cannot change from the code, say exactly where it is set. 3. After deploying, re-scan at https://crawlcheck.io/?url=databricks.com . The fix counts when SITEMAP_NO_LASTMOD is gone from the new report.
Why this was decided
| Rule | SITEMAP_NO_LASTMOD · rule pack sv34 · scope core |
|---|---|
| Evaluated | 2026-11-06 04:32:16 UTC |
| Decision | d1:98e107b41f5ce04b9360 · finding f1:66ed8943370a8b760e08 resolve either at /api/graph/<id> with a key |
| Observer | crawlcheck-worker build c699237f from LHR · audit v4 |
What it rests on
| Identity | Status | Bytes | sha256 | Kept |
|---|---|---|---|---|
| read: /sitemap.xml | 200 | 1,984 | 117b81a7c648 | already_held |
| read: /sitemap_index.xml | 200 | 1,984 | 117b81a7c648 | already_held |
| read: /wp-sitemap.xml | 404 | 746,622 | 92948ad39b3f | write_unconfirmed |
3 more in the manifest.
Artifacts: manifest:2ac6e67c8c241b9d5aaa85fe72aeec06882684afb596241a1a898988c99e6d4c
Grade effect Does not cap the letter: only medium, high and critical findings do. Moves no points either; the score is built from the measured rows.
Rule SITEMAP_NO_LASTMOD under scoring rules v34 · fingerprint SITEMAP_NO_LASTMOD|/sitemap.xml · persisting (seen in 12 of 12 readings)
Verify the fix Re-scan after the change. This finding is cleared when SITEMAP_NO_LASTMOD is no longer reported at /sitemap.xml; if it comes back after clearing, it is marked a regression, not a new finding.
SITEMAP_NO_LASTMOD · full transcript
Open the other 2
What we saw, why it matters, how to fix it, and the evidence bytes for every finding — on this report and every re-scan. From $29 a month.
Unlock the findingsOr have them fixed
We implement the list on your site and re-measure, with a sealed before and after. One site, $100 once.
Get this fixed — $100The main product
We fix the 3 findings on databricks.com. $100, once.
One site. You keep the grade for free — this is the part where the list stops being a list.
- Every eligible finding implemented on the site itself: machine files, schema, NAP, settings. Not included: new content, redesigns, plugin or theme replacement, custom integrations (the terms list them)
- An entity map authored for your business, not a template with the name swapped
- Measured again afterwards — the before and the after, sealed, so it is evidenced rather than claimed
- Thirty days of monitoring included
- Work starts within two business days
What it covers · one payment, nothing recurring
Sites like yours that fixed the same problem
Matched on Cloudflare + Vercel + Cloudflare Bot Management. A fix counts once two readings confirm it; sites are not named. Read from the technology record of 2026-10-31.
serves no /agents.md (optional)
9 sites on a stack like yours have made this fix (Published agents.md); 9 still hold it. 16 on any stack.
- similar site A (WordPress + Cloudflare + Cloudflare Bot Management; shares bot protection, CDN): fixed 2026-11-04, still fixed today
- similar site B (WordPress + Cloudflare + Cloudflare Bot Management; shares bot protection, CDN): fixed 2026-10-31, still fixed today
- similar site C (Cloudflare + Cloudflare Bot Management; shares bot protection, CDN): fixed 2026-10-22, still fixed today
serves no /entitymap.json (optional)
2 sites on a stack like yours have made this fix (Published an entity map); 2 still hold it.
- similar site A (WordPress + Cloudflare; shares CDN): fixed 2026-10-29, still fixed today
- similar site B (Cloudflare; shares CDN): fixed 2026-10-15, still fixed today
The signed answer lists every match.
What changed
- 2026-11-06score moved 76 → 79score-up
- 2026-10-22the homepage no longer read as mostly markupresolved
- 2026-10-22no answer engine was refusedresolved
- 2026-10-15the stale edge copy clearedresolved
- 2026-10-15the homepage began taking more than one redirect to reachappeared
- 2026-10-04score moved 67 → 64score-down
- 2026-10-02score moved 64 → 65score-up
10 scans on record, first 2026-09-18. Score movements are shown only between readings taken under the same score version; finding codes are comparable across all of them.
Is this your site?
This listing reads the public record. Claim it and Watch keeps that record on your terms: every list this page holds back, finding age, and twice-daily re-measurement. Free for 30 days, no card.
Claim the record for databricks.comIs this your company?
This listing came from a fetch, not a submission, so nobody was asked. If databricks.com is yours you can prove it in a minute and for nothing — a DNS TXT record or one meta tag on the home page, both checkable by anyone.
Claiming marks you as the verified owner and lets you correct the category and the company name. It moves no score, no rank and no position.
Claim this listing — free or ask about a verified profile
Dispute or re-scan
If a reading here is wrong, it is our instrument that is wrong, and we want to know. Tell us what is wrong and the site is re-measured; the result is published as measured. Nothing about a listing, a payment or a request changes a number.
By email instead: hello@crawlcheck.io. Category “ML platforms and experiment tracking” is our label for what the product is primarily sold as; it is not scored. Back to the directory.