CrawlCheck

Directory · Video and image generation

Freepik — what a crawler receives from freepik.com

Website measurement, not a product review. This page records what machine clients received from freepik.com. It does not evaluate Freepik software, features, pricing or support.

78
Cgrade

Answer engines can reach and read this site. It needs more it can quote.

AI visibility 78/100, measured 2026-10-06 20:19 UTC from outside its network, as each named AI and search crawler and as a browser. An engine can reach and read this site. What is left is giving it something specific to say.

Held at C A medium-severity finding sets the letter.

Open the full report freepik.com ↗

6

findings

✗

llms.txt on its host

✗

entity map on its host

4

scans on record since 2026-09-18

The three stages, in the order an engine hits a site

Each stage gates the next. An engine that cannot reach a page never reads it; one that cannot read it never quotes it. That is why reach is a ceiling and not just a weight.

92

Stage 1 · 40% of the score

Reach

Can a named answer-engine crawler get your pages at all?

Every named crawler was served the same page a browser gets.

60

Stage 2 · 30% of the score

Read

Once it has the bytes, can it find the words?

The content is buried in markup, or the files that guide a crawler are missing.

—

Stage 3 · 30% of the score

Quote

Is there a specific fact it can state and attribute?

Not measured on this scan; left out rather than counted as zero.

  • Structured datan/a
  • Local presence & NAPn/a
  • Claim consistencyn/a
  • Authors & trust signalsn/a
  • Linked datan/a
  • Quotable contentn/a
  • Entity corroborationn/a
  • Page subjectn/a

The stage to fix first is read, because the three run in order.

What to fix

6 findings on this site, 1 of them scored serious. Every one is named below; the top one is shown in full, free. What we saw, why each matters, how to fix it and the bytes behind it are what a licence buys — or we implement the whole list for you.

1 Medium 4 Low 1 Note

1robots.txt rules do not apply to named agents3 named User-agent groups (3 agents) do not repeat 111 of the Disallow rules the `*` group carries. A crawler obeys only its own most-specific group and ignoresMediumSetting

What we saw

3 named User-agent groups (3 agents) do not repeat 111 of the Disallow rules the `*` group carries. A crawler obeys only its own most-specific group and ignores `*` entirely, so those rules do not apply to any of the named agents. Worst group: `mediapartners-google` bypasses /app/, /*/app/, /sitemaps/, /login, /contacto/, /contact/, /contact, /trk-download/, /ad/adserver.php, /advertisers/, /dmca_notification, /search?, /profile/payment/getstarted/*, /profile/license, /profile/downloads_limit, /xhr/, /media/js/translations.js, /download-limit, /download-file/, /redirect. /robots.txt

Why it matters

A crawler reads only the User-agent group that matches it best and ignores every other group, including `*`. Naming an agent and giving it only `Allow: /` therefore deletes all of your `*` Disallow rules for that agent. The file still parses and the agent still reaches your homepage, so this is invisible on inspection — but the paths you meant to keep out of search are open, and search engines will crawl and may index them.

How to fix it

Every User-agent group that names a crawler must repeat the Disallow rules you want applied. A named group with no rules means 'allow everything' for that crawler.

Setting: a setting on the server, CDN, DNS or a plugin — no code and no writing

Why this was decided
RuleROBOTS_RULES_SHADOWED · rule pack sv28 · scope core
Evaluated2026-10-06 20:19:04 UTC
Decisiond1:216f6c9626fc8fd92566 · finding f1:8b8d7083af6e8ac84d92 resolve either at /api/graph/<id> with a key
Observercrawlcheck-worker build 65d93cd9 · audit v4

What it rests on

IdentityStatusBytessha256Kept
read: /robots.txt2005,4166e86f04a1ec7kept

5 more in the manifest.

Artifacts: manifest:44f7542636ee5f5a99a87686d9dcbeedd0e8a4f616025b1655ec171f559ea53d

Grade effect Caps the letter at C. Without it the letter would be B (score 78). Moves no points; the score is built from the measured rows.

Rule ROBOTS_RULES_SHADOWED under scoring rules v31 · fingerprint ROBOTS_RULES_SHADOWED|/robots.txt · new on this scan (1 scan)

Verify the fix Re-scan after the change. This finding is cleared when ROBOTS_RULES_SHADOWED is no longer reported at /robots.txt; if it comes back after clearing, it is marked a regression, not a new finding.

ROBOTS_RULES_SHADOWED · full transcript

2The sitemap is refused/sitemap_index.xml🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Low
3The sitemap is refused/wp-sitemap.xml🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Low
4The homepage refused this client, so every homepage section is unmeasured🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Low
5The sitemap does not say when anything changed/sitemap.xml🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Low
6No llms.txt/llms.txt🔒 What we saw, why it matters, the fix and the evidence bytes are in the licensed report.Note

Open the other 5

What we saw, why it matters, how to fix it, and the evidence bytes for every finding — on this report and every re-scan. From $29 a month.

Unlock the findings

Or have them fixed

We implement the list on your site and re-measure, with a sealed before and after. One site, $749 once.

Get this fixed — $749

What changed

  1. 2026-10-06resolved: this origin refused crawlcheck, so the site was never measuredresolved
  2. 2026-10-06a new finding appeared: the sitemap does not say when anything changedappeared
  3. 2026-10-06a new finding appeared: the sitemap is refusedappeared
  4. 2026-10-06a named-agent group shadowed the wildcard rulesappeared
  5. 2026-10-06no llms.txt was foundappeared
  6. 2026-10-06the homepage refused this clientappeared

4 scans on record, first 2026-09-18. Score movements are shown only between readings taken under the same score version; finding codes are comparable across all of them.

Is this your site?

This listing reads the public record. Claim it and Watch keeps that record on your terms: every list this page holds back, finding age, and twice-daily re-measurement. Free for 30 days, no card.

Claim the record for freepik.com

Is this your company?

This listing came from a fetch, not a submission, so nobody was asked. If freepik.com is yours you can prove it in a minute and for nothing — a DNS TXT record or one meta tag on the home page, both checkable by anyone.

Claiming marks you as the verified owner and lets you correct the category and the company name. It moves no score, no rank and no position.

Claim this listing — free or ask about a verified profile

Dispute or re-scan

If a reading here is wrong, it is our instrument that is wrong, and we want to know. Tell us what is wrong and the site is re-measured; the result is published as measured. Nothing about a listing, a payment or a request changes a number.

By email instead: hello@crawlcheck.io. Category “Video and image generation” is our label for what the product is primarily sold as; it is not scored. Back to the directory.