AI crawlers · Answer engines
Gemini-Deep-Research
Gemini-Deep-Research is the user-triggered fetch run by Google: Gemini research agent. Its operator publishes no IP ranges or DNS names for it, so a request carrying this name cannot be verified. Treat the name in a log line as a claim.
| User-agent token | Gemini-Deep-Research |
| Operator | |
| What it does | Gemini research agent |
| Kind | user-triggered fetch |
| Can a request be verified? | No — user agent string only |
| In a CrawlCheck scan | Read from robots.txt; a refusal is scored |
Allow or block it in robots.txt
User-agent: Gemini-Deep-Research Disallow: /
User-agent: Gemini-Deep-Research Allow: /
Add a group that names it: "User-agent: Gemini-Deep-Research" followed by "Disallow: /". A crawler follows only the most specific group that names it, so once a group names Gemini-Deep-Research, rules under "User-agent: *" no longer apply to it; repeat in that group any Disallow lines you still want.
What blocking it changes
Yes. It is how Google reaches a page to answer a question at the moment a person asks, so refusing it stops that engine reading the site.
Other agents from Google
Google-CloudVertexBot— Vertex AI groundingGooglebot— Google Search / AI OverviewsGoogle-Extended— Gemini trainingGooglebot-Image— Google image crawlerGooglebot-News— Google NewsGooglebot-Video— Google video crawlerStorebot-Google— Google ShoppingMediapartners-Google— Google AdSenseAPIs-Google— Google push deliveryGoogleOther— Google non-search fetchAdsBot-Google— Google Ads qualityGoogle-Agent— Google user-triggered agent, acts on the webGoogle-GeminiNotebook— Gemini Notebook user-supplied URL fetchGoogleOther-Image— Google common crawler, public image URLsGoogleOther-Video— Google common crawler, public video URLs
See what Gemini-Deep-Research and every other named agent receive from your own site: run a free scan. The full catalogue is on AI crawlers and as JSON at /ai-crawlers.json.