CrawlCheck

Directory · SEO suite

SE Ranking — what a crawler receives from seranking.com

Website measurement, not a product review. This page records what machine clients received from seranking.com. It does not evaluate SE Ranking software, features, pricing or support.

80
Cgrade

Answer engines can reach and read this site. It needs more it can quote.

AI visibility 80/100, measured 2026-10-18 16:09 UTC from outside its network, as each named AI and search crawler and as a browser. An engine can reach and read this site. What is left is giving it something specific to say.

Held at C A medium-severity finding sets the letter.

Open the full report seranking.com ↗

871. ReachCan a named answer-engine crawler get your pages at all?742. ReadOnce it has the bytes, can it find the words?753. QuoteIs there a specific fact it can state and attribute?

7

findings

✗

llms.txt on its host

✗

entity map on its host

24

scans on record since 2026-08-14

The three stages, in the order an engine hits a site

Each stage gates the next: an engine that cannot reach a page never reads it, and one that cannot read it never quotes it.

87

Stage 1 · 40% of the score

Reach

Can a named answer-engine crawler get your pages at all?

Every named crawler was served the same page a browser gets.

74

Stage 2 · 30% of the score

Read

Once it has the bytes, can it find the words?

The content is buried in markup, or the files that guide a crawler are missing.

75

Stage 3 · 30% of the score

Quote

Is there a specific fact it can state and attribute?

An assistant would have to paraphrase your page instead of quoting a fact.

The stage to fix first is read, because the three run in order.

What to fix

7 findings on this site, 2 of them scored serious. Every one is named below; the top one is shown in full, free. What we saw, why each matters, how to fix it and the bytes behind it are what a licence buys — or we implement the whole list for you.

2 Medium 1 Low 4 Note

1robots.txt rules do not apply to named agents10 named User-agent groups (10 agents) do not repeat 7 of the Disallow rules the `*` group carries. A crawler obeys only its own most-specific group and ignoresMediumSetting

What we saw

10 named User-agent groups (10 agents) do not repeat 7 of the Disallow rules the `*` group carries. A crawler obeys only its own most-specific group and ignores `*` entirely, so those rules do not apply to any of the named agents (some declare their own, different rules). Worst group: `oai-searchbot` bypasses /blog/static-tools/, */wp-, */wp/, *openstat=, */?hc_location=ufi, */trackback, */email-attachment/*. This includes a SEARCH crawler (applebot) — the bypassed paths are being crawled and can enter the index. /robots.txt

Why it matters

A crawler reads only the User-agent group that matches it best and ignores every other group, including `*`. Naming an agent and giving it only `Allow: /` therefore deletes all of your `*` Disallow rules for that agent. The file still parses and the agent still reaches your homepage, so this is invisible on inspection — but the paths you meant to keep out of search are open, and search engines will crawl and may index them.

How to fix it

Every User-agent group that names a crawler must repeat the Disallow rules you want applied. A named group with no rules means 'allow everything' for that crawler.

Setting: a setting on the server, CDN, DNS or a plugin — no code and no writing

On WordPress (detected)

  1. WordPress serves a virtual robots.txt. Edit it in your SEO plugin: Yoast SEO → Tools → File editor; Rank Math → General Settings → Edit robots.txt; All in One SEO → Tools → Robots.txt Editor.
  2. A real robots.txt file in the site root (the folder with wp-config.php) overrides every plugin. If one exists, edit that file instead, through your host's file manager or SFTP.
  3. Keep one group per crawler: a crawler that has its own User-agent group ignores the * group entirely, so repeat any Disallow lines it still needs.

In Cloudflare (this site is behind it)

  1. If Cloudflare's managed robots.txt is on (Security → Bots, or AI Crawl Control → robots.txt), Cloudflare adds its own lines above yours. Turn it off, or keep it knowing those lines are there.
  2. Robots.txt is cached at the edge: purge it (Caching → Configuration → Custom purge → the robots.txt URL) after you change it.

All WordPress fixes

Paste this

Each crawler obeys only its own group, so a named group must repeat the rules you want. The corrected file below copies them in for you.

The whole corrected robots.txt for seranking.com · built from the live file, every change listed at the top.

Fix it with a coding agent

Paste into Claude Code, Cursor or Codex, opened on the code that serves this site.

Show prompt
You are working in the codebase (or server/CDN configuration) that serves seranking.com. A crawler audit found the problem below. Fix it at the source, keep the change as small as possible, and do not change anything a visitor sees unless the fix requires it.

Finding: robots.txt rules do not apply to named agents (ROBOTS_RULES_SHADOWED, medium severity)
Page: https://seranking.com/robots.txt
What was measured: 10 named User-agent groups (10 agents) do not repeat 7 of the Disallow rules the `*` group carries. A crawler obeys only its own most-specific group and ignores `*` entirely, so those rules do not apply to any of the named agents (some declare their own, different rules). Worst group: `oai-searchbot` bypasses /blog/static-tools/, */wp-, */wp/, *openstat=, */?hc_location=ufi, */trackback, */email-attachment/*. This includes a SEARCH crawler (applebot) — the bypassed paths are being crawled and can enter the index.
Why it matters: A crawler reads only the User-agent group that matches it best and ignores every other group, including `*`. Naming an agent and giving it only `Allow: /` therefore deletes all of your `*` Disallow rules for that agent. The file still parses and the agent still reaches your homepage, so this is invisible on inspection — but the paths you meant to keep out of search are open, and search engines will crawl and may index them.
How to fix it: Every User-agent group that names a crawler must repeat the Disallow rules you want applied. A named group with no rules means 'allow everything' for that crawler.
Detected platform: WordPress. Make the change where this platform controls it.
Rule and examples: https://crawlcheck.io/rules/ROBOTS_RULES_SHADOWED
Full report (markdown): https://crawlcheck.io/r/vy29ylaw8b.md

When you are done:
1. Tell me which files or settings you changed and why.
2. If the fix is a server, CDN or cache setting you cannot change from the code, say exactly where it is set.
3. After deploying, re-scan at https://crawlcheck.io/?url=seranking.com . The fix counts when ROBOTS_RULES_SHADOWED is gone from the new report.
Why this was decided
RuleROBOTS_RULES_SHADOWED · rule pack sv32 · scope core
Evaluated2026-10-18 16:09:36 UTC
Decisiond1:6f2946ce99f1749e3279 · finding f1:5fed8c860e0bbb5d09f5 resolve either at /api/graph/<id> with a key
Observercrawlcheck-worker build b3cf8c17 · audit v4

What it rests on

IdentityStatusBytessha256Kept
read: /robots.txt2002,3856a836ad82057already_held

21 more in the manifest.

Artifacts: manifest:9f8ff3e252c039c3746bc8871d5340cfb0d9408b01ca4131494e2d9b89884798

Grade effect Caps the letter at C together with 1 other medium-severity finding; the letter rises only when all of them are gone. Moves no points.

Rule ROBOTS_RULES_SHADOWED under scoring rules v32 · fingerprint ROBOTS_RULES_SHADOWED|/robots.txt · persisting (28 scans)

Verify the fix Re-scan after the change. This finding is cleared when ROBOTS_RULES_SHADOWED is no longer reported at /robots.txt; if it comes back after clearing, it is marked a regression, not a new finding.

ROBOTS_RULES_SHADOWED · full transcript

2Almost nothing a machine receives from this page is readable text🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Medium
3The HSTS header asks for browser preloading but does not qualify for it🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Low
4The homepage is reached through a chain of redirects🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Note
5No llms.txt/llms.txt🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Note
6A missing agent file answers with a full page🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Note
7A business record gives an address but no coordinates🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Note

Open the other 6

What we saw, why it matters, how to fix it, and the evidence bytes for every finding — on this report and every re-scan. From $29 a month.

Unlock the findings

Or have them fixed

We implement the list on your site and re-measure, with a sealed before and after. One site, $749 once.

Get this fixed — $749

The chain a crawler follows

The chain breaks at llms.txt. Everything after that point is only reachable by a crawler guessing the conventional path.

✓robots.txtEvery crawler reads this first
✓sitemapNamed in robots.txt and resolves
✗llms.txtPoints onward, links stay on this host
✗entity graphParses as JSON and points home

A machine file that does not parse is worth less than one that is absent, because it looks present. Rows behind this.

Where the bytes go

Of the 783,576 decompressed bytes the homepage delivers, 1.5% is text a reader or a model can actually use. Most of what a crawler downloads here is not words.

  • Readable text 1.5% · 11,905 B
  • Markup & attributes 20.8% · 163,370 B
  • Structured data (JSON-LD) 0.2% · 1,277 B
  • Inline CSS 35% · 274,232 B
  • Inline JavaScript 1% · 7,767 B
  • Inline SVG 41.5% · 325,025 B

The individual blocks that weigh the most, so the fix is a search rather than a hunt:

  • Inline CSS · 272,194 B (34.7%) — unnamedopens p{margin:0} .se-tabs__wrapper{overflow:auto;scrollbar-width:none;justi
  • Inline SVG · 218,634 B (27.9%) — unnamedopens <defs><symbol id="partner-logo-soapbox" fill="none"><g clip-path="url(
  • Inline SVG · 19,368 B (2.5%) — unnamedopens <path fill-rule="evenodd" clip-rule="evenodd" d="M119.407 37H4.59259C2
  • Inline SVG · 12,913 B (1.6%) — unnamedopens <path fill-rule="evenodd" clip-rule="evenodd" d="M4 0C1.79086 0 0 1.79

What changed

  1. 2026-10-14the homepage began taking more than one redirect to reachappeared
  2. 2026-10-02score moved 79 → 80score-up
  3. 2026-09-24score moved 79 → 78score-down
  4. 2026-09-17a new finding appeared: the machine files cost more than the pageappeared
  5. 2026-09-15score moved 78 → 79score-up
  6. 2026-09-08score moved 77 → 76score-down
  7. 2026-09-07score moved 76 → 77score-up
  8. 2026-09-04a new finding appeared: the hsts header asks for browser preloading but does not qualify for itappeared
  9. 2026-09-01resolved: the cache is still serving a file the origin no longer hasresolved
  10. 2026-09-01a named-agent group shadowed the wildcard rulesappeared
  11. 2026-09-01a new finding appeared: an entity is missing geographic coordinatesappeared
  12. 2026-08-18score moved 73 → 74score-up

24 scans on record, first 2026-08-14. Score movements are shown only between readings taken under the same score version; finding codes are comparable across all of them.

Is this your site?

This listing reads the public record. Claim it and Watch keeps that record on your terms: every list this page holds back, finding age, and twice-daily re-measurement. Free for 30 days, no card.

Claim the record for seranking.com

Is this your company?

This listing came from a fetch, not a submission, so nobody was asked. If seranking.com is yours you can prove it in a minute and for nothing — a DNS TXT record or one meta tag on the home page, both checkable by anyone.

Claiming marks you as the verified owner and lets you correct the category and the company name. It moves no score, no rank and no position.

Claim this listing — free or ask about a verified profile

Dispute or re-scan

If a reading here is wrong, it is our instrument that is wrong, and we want to know. Tell us what is wrong and the site is re-measured; the result is published as measured. Nothing about a listing, a payment or a request changes a number.

By email instead: hello@crawlcheck.io. Category “SEO suite” is our label for what the product is primarily sold as; it is not scored. Back to the directory.