CrawlCheck

AI crawlers · Answer engines

PhindBot

PhindBot is the answer-engine crawler run by Phind: fetches pages for answers in the Phind AI search engine. Its operator publishes no IP ranges or DNS names for it, so a request carrying this name cannot be verified. Treat the name in a log line as a claim.

User-agent tokenPhindBot
OperatorPhind
What it doesfetches pages for answers in the Phind AI search engine
Kindanswer-engine crawler
Can a request be verified?No — user agent string only
In a CrawlCheck scanRead from robots.txt; a refusal is scored

Allow or block it in robots.txt

User-agent: PhindBot
Disallow: /
User-agent: PhindBot
Allow: /

Add a group that names it: "User-agent: PhindBot" followed by "Disallow: /". A crawler follows only the most specific group that names it, so once a group names PhindBot, rules under "User-agent: *" no longer apply to it; repeat in that group any Disallow lines you still want.

What blocking it changes

Yes. It is how Phind reaches a page to answer a question or to build the index its answers read, so refusing it stops that engine reading the site.

See what PhindBot and every other named agent receive from your own site: run a free scan. The full catalogue is on AI crawlers and as JSON at /ai-crawlers.json.

Questions about PhindBot

QHow do I block PhindBot in robots.txt?
Add a group that names it: "User-agent: PhindBot" followed by "Disallow: /". A crawler follows only the most specific group that names it, so once a group names PhindBot, rules under "User-agent: *" no longer apply to it; repeat in that group any Disallow lines you still want.
QHow can I tell if a request from PhindBot is real?
Its operator publishes no IP ranges or DNS names for it, so a request carrying this name cannot be verified. Treat the name in a log line as a claim.
QDoes blocking PhindBot affect whether my site appears in AI answers?
Yes. It is how Phind reaches a page to answer a question or to build the index its answers read, so refusing it stops that engine reading the site.
QDoes CrawlCheck test my site as PhindBot?
Not as a request. CrawlCheck reads the rules your robots.txt sets for PhindBot and reports them. A refusal of it counts toward the grade, because it costs the site visibility.