CrawlCheck

Directory · ML platforms and experiment tracking

MosaicML — what a crawler receives from mosaicml.com

Website measurement, not a product review. This page records what machine clients received from mosaicml.com. It does not evaluate MosaicML software, features, pricing or support.

73
Cgrade

Answer engines can technically reach this site, but get little they can use.

AI visibility 73/100, measured 2026-10-04 05:18 UTC from outside its network, as each named AI and search crawler and as a browser. An engine can technically reach this site and would struggle to get anything quotable out of it.

Held at C A medium-severity finding sets the letter.

Open the full report mosaicml.com ↗

5

findings

✗

llms.txt on its host

✗

entity map on its host

4

scans on record since 2026-09-18

The three stages, in the order an engine hits a site

Each stage gates the next. An engine that cannot reach a page never reads it; one that cannot read it never quotes it. That is why reach is a ceiling and not just a weight.

83

Stage 1 · 40% of the score

Reach

Can a named answer-engine crawler get your pages at all?

At least one answer engine was refused, challenged or served less than a browser.

70

Stage 2 · 30% of the score

Read

Once it has the bytes, can it find the words?

The content is buried in markup, or the files that guide a crawler are missing.

61

Stage 3 · 30% of the score

Quote

Is there a specific fact it can state and attribute?

An assistant would have to paraphrase your page instead of quoting a fact.

The stage to fix first is quote, because the three run in order.

What to fix

5 findings on this site, 2 of them scored serious. Every one is named below; the top one is shown in full, free. What we saw, why each matters, how to fix it and the bytes behind it are what a licence buys — or we implement the whole list for you.

2 Medium 1 Low 2 Note

1robots.txt does not return 200HTTP 404.MediumSetting

What we saw

HTTP 404. /robots.txt

Why it matters

The response code on robots.txt determines how crawlers treat the whole site. Anything other than 200 or a clean 404 is risky.

How to fix it

Serve robots.txt with status 200 as text/plain. A 404 or 410 means no file: under RFC 9309 a crawler may then fetch everything, so any rule you meant to publish is not in force. A 429 is read by Google as a server error, which pauses crawling: exempt robots.txt from rate limits.

Setting: a setting on the server, CDN, DNS or a plugin — no code and no writing

Why this was decided
RuleROBOTS_NOT_200 · rule pack sv27 · scope core
Evaluated2026-10-04 05:18:47 UTC
Decisiond1:a822e42f7ade283f1467 · finding f1:93457fe80937294d9bd2 resolve either at /api/graph/<id> with a key
Observercrawlcheck-worker build a7b70d8a · audit v4

What it rests on

IdentityStatusBytessha256Kept
read: /robots.txt40490690c032f35272already_held

23 more in the manifest.

Artifacts: manifest:1b346d2db9e022d8efc93949d2762a747dbf6f049d01fecd2f8159718dcb9a0e

Grade effect Caps the letter at C together with 1 other medium-severity finding; the letter rises only when all of them are gone. Moves no points.

Rule ROBOTS_NOT_200 under scoring rules v31 · fingerprint ROBOTS_NOT_200|/robots.txt · persisting (4 scans)

Verify the fix Re-scan after the change. This finding is cleared when ROBOTS_NOT_200 is no longer reported at /robots.txt; if it comes back after clearing, it is marked a regression, not a new finding.

ROBOTS_NOT_200 · full transcript

2Almost nothing a machine receives from this page is readable text🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Medium
3The sitemap does not say when anything changed/sitemap.xml🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Low
4No llms.txt/llms.txt🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Note
5Visitors and crawlers are being served an old copy of this page🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Note

Open the other 4

What we saw, why it matters, how to fix it, and the evidence bytes for every finding — on this report and every re-scan. From $29 a month.

Unlock the findings

Or have them fixed

We implement the list on your site and re-measure, with a sealed before and after. One site, $749 once.

Get this fixed — $749

The chain a crawler follows

The chain breaks at robots.txt. Everything after that point is only reachable by a crawler guessing the conventional path.

✗robots.txtEvery crawler reads this first
✓sitemapNamed in robots.txt and resolves
✗llms.txtPoints onward, links stay on this host
✗entity graphParses as JSON and points home

A machine file that does not parse is worth less than one that is absent, because it looks present. Rows behind this.

Where the bytes go

Of the 732,563 decompressed bytes the homepage delivers, 1.1% is text a reader or a model can actually use. Most of what a crawler downloads here is not words.

  • Readable text 1.1% · 8,019 B
  • Markup & attributes 20.8% · 152,634 B
  • Inline CSS 65.2% · 477,568 B
  • Inline JavaScript 12.2% · 89,155 B
  • Inline SVG 0.7% · 5,006 B
  • HTML comments 0% · 181 B

The individual blocks that weigh the most, so the fix is a search rather than a hunt:

  • Inline CSS · 327,921 B (44.8%) — unnamedopens *,:after,:before{--tw-border-spacing-x:0;--tw-border-spacing-y:0;--tw-
  • Inline CSS · 124,913 B (17.1%) — unnamedopens *,:after,:before{--tw-translate-x:0;--tw-translate-y:0;--tw-rotate:0;-
  • Inline JavaScript · 61,341 B (8.4%) — unnamedopens undefined ;/*! For license information please see nr-loader-spa-1.290.
  • Inline CSS · 24,089 B (3.3%) — unnamedopens .mktoPrimary.mktoForm input[type=date],.mktoPrimary.mktoForm input[typ
  • Inline JavaScript · 12,306 B (1.7%) — unnamedopens function OptanonWrapper() { db_debug("OptanonWrapper():DB:v1.3") let o

What changed

  1. 2026-10-04resolved: a named crawler was sent somewhere the ordinary client was notresolved
  2. 2026-10-04no answer engine was refusedresolved

4 scans on record, first 2026-09-18. Score movements are shown only between readings taken under the same score version; finding codes are comparable across all of them.

Is this your site?

This listing reads the public record. Claim it and Watch keeps that record on your terms: every list this page holds back, finding age, and twice-daily re-measurement. Free for 30 days, no card.

Claim the record for mosaicml.com

Is this your company?

This listing came from a fetch, not a submission, so nobody was asked. If mosaicml.com is yours you can prove it in a minute and for nothing — a DNS TXT record or one meta tag on the home page, both checkable by anyone.

Claiming marks you as the verified owner and lets you correct the category and the company name. It moves no score, no rank and no position.

Claim this listing — free or ask about a verified profile

Dispute or re-scan

If a reading here is wrong, it is our instrument that is wrong, and we want to know. Tell us what is wrong and the site is re-measured; the result is published as measured. Nothing about a listing, a payment or a request changes a number.

By email instead: hello@crawlcheck.io. Category “ML platforms and experiment tracking” is our label for what the product is primarily sold as; it is not scored. Back to the directory.