Directory · Inference and GPU compute
Nebius — what a crawler receives from nebius.com
Website measurement, not a product review. This page records what machine clients received from nebius.com. It does not evaluate Nebius software, features, pricing or support.
Answer engines are being served something other than this site.
AI visibility 76/100, measured 2026-09-18 18:17 UTC from outside its network, as twelve named crawler identities plus an unnamed client and two mobile-browser controls. An engine can reach and read this site. What is left is giving it something specific to say.
Held at D A high-severity finding sets the letter.
4
findings
✗
llms.txt on its host
✗
entity map on its host
2
scans on record since 2026-09-18
The three stages, in the order an engine hits a site
Each stage gates the next. An engine that cannot reach a page never reads it; one that cannot read it never quotes it. That is why reach is a ceiling and not just a weight.
Stage 1 · 40% of the score
Reach
Can a named answer-engine crawler get your pages at all?
At least one answer engine was refused, challenged or served less than a browser.
Stage 2 · 30% of the score
Read
Once it has the bytes, can it find the words?
The content is buried in markup, or the files that guide a crawler are missing.
Stage 3 · 30% of the score
Quote
Is there a specific fact it can state and attribute?
An assistant would have to paraphrase your page instead of quoting a fact.
The stage to fix first is quote, because the three run in order.
What to fix
4 findings on this site, 1 of them scored serious. The top one is below in full, free. Which the other 3 are, what we saw, and the bytes behind each one are what a licence buys — or we implement the whole list for you.
1 High 2 Low 1 Note
1The sitemap is refusedHTTP 403, 1,484 bytes.HighSetting
What we saw
HTTP 403, 1,484 bytes. /wp-sitemap.xml
Why it matters
SAME LIMIT AS ABOVE: if a named application firewall appears in the response, this may be blocking the scanner's IP rather than crawlers. Confirm in server logs grouped by source IP. Otherwise: the server refuses this sitemap rather than returning it or a clean 404. Crawlers cannot enumerate the site and fall back to link-following, so deep and newly published pages go undiscovered.
How to fix it
Allow the sitemap URL through the security layer so crawlers can read it.
Setting: a setting on the server, CDN, DNS or a plugin — no code and no writing
Evidence bytes
<!DOCTYPE html PUBLIC '-//W3C//DTD XHTML 1.0 Transitional//EN' 'http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd'>
<html xmlns='http://www.w3.org/1999/xhtml'>
<head>
<meta content='text/html; charset=utf-8' http-equiv='content-type' />
<style type='text/css'>
body {
font-family: Arial;
margin-left: 40px;
}
img {
border: 0 none;
}
#content {
margin-left: auto;
margin-right: auto
}
#message h1 {
font-size: 24px;
font-weight: normal;
SITEMAP_BLOCKED · full transcript
See the other 3
Every finding, what we saw, why it matters, how to fix it, and the evidence bytes — on this report and every re-scan. From $29 a month.
Unlock the findingsOr have them fixed
We implement the list on your site and re-measure, with a sealed before and after. One site, $749 once.
Get this fixed — $749The main product
We fix the 4 findings on nebius.com. $749, once.
1 of them are scored serious. One site. You keep the grade for free — this is the part where the list stops being a list.
- Every finding implemented on the site itself: machine files, schema, NAP, the lot
- An entity map authored for your business, not a template with the name swapped
- Measured again afterwards — the before and the after, sealed, so it is evidenced rather than claimed
- Thirty days of monitoring included
- Work starts within two business days
What it covers · one payment, nothing recurring
The chain a crawler follows
The chain breaks at llms.txt. Everything after that point is only reachable by a crawler guessing the conventional path.
A machine file that does not parse is worth less than one that is absent, because it looks present. Rows behind this.
Where the bytes go
Of the 400,676 decompressed bytes the homepage delivers, 5.3% is text a reader or a model can actually use. Most of what a crawler downloads here is not words.
- Readable text 5.3% · 21,230 B
- Markup & attributes 38.9% · 156,059 B
- Structured data (JSON-LD) 0.9% · 3,789 B
- Inline JavaScript 49.9% · 199,774 B
- Inline SVG 4.8% · 19,048 B
- HTML comments 0.2% · 776 B
The individual blocks that weigh the most, so the fix is a search rather than a hunt:
- Inline JavaScript · 194,170 B (48.5%) — a framework state payloadopens
{"props":{"pageProps":{"tokenFactoryModels":null,"pageLink":{"collecti - Inline SVG · 7,881 B (2%) —
#__SVG_SPRITE_NODE__opens<symbol xmlns="http://www.w3.org/2000/svg" viewBox="0 0 10 10" id="ico
What changed
No change recorded between the readings on file yet.
2 scans on record, first 2026-09-18. Score movements are shown only between readings taken under the same score version; finding codes are comparable across all of them.
Is this your site?
This listing reads the public record. Claim it and Watch keeps that record on your terms: every list this page holds back, finding age, and twice-daily re-measurement. Free for 30 days, no card.
Claim the record for nebius.comIs this your company?
This listing came from a fetch, not a submission, so nobody was asked. If nebius.com is yours you can prove it in a minute and for nothing — a DNS TXT record or one meta tag on the home page, both checkable by anyone.
Claiming marks you as the verified owner and lets you correct the category and the company name. It moves no score, no rank and no position.
Claim this listing — free or ask about a verified profile
Dispute or re-scan
If a reading here is wrong, it is our instrument that is wrong, and we want to know. Tell us what is wrong and the site is re-measured; the result is published as measured. Nothing about a listing, a payment or a request changes a number.
By email instead: hello@crawlcheck.io. Category “Inference and GPU compute” is our label for what the product is primarily sold as; it is not scored. Back to the directory.