AI crawlers · Regional search engines

`YisouSpider`

YisouSpider is the search index crawler run by Shenma (UCWeb and Alibaba): indexes pages for Shenma Search (sm.cn), the mobile search engine in China. Its operator publishes no IP ranges or DNS names for it, so a request carrying this name cannot be verified. Treat the name in a log line as a claim.

User-agent token	`YisouSpider`
Operator	Shenma (UCWeb and Alibaba)
What it does	indexes pages for Shenma Search (sm.cn), the mobile search engine in China
Kind	search index crawler
Can a request be verified?	No — user agent string only
In a CrawlCheck scan	Read from robots.txt; reported, never scored

What YisouSpider is

YisouSpider is the crawler token for Shenma Search (sm.cn), the mobile search engine UCWeb and Alibaba launched in 2014. The robots.txt name is YisouSpider. In server logs the token usually appears inside a browser-like user-agent, often a mobile one, as YisouSpider or YisouSpider/5.0.

It is not Baiduspider and it is not Sogou web spider. A robots.txt group that names one of those does not apply to this token. It is also not EasouSpider, which is a different crawler that people mix up with this one.

What a log line looks like

Two forms that show up in logs. The token is the part robots.txt matches. The rest of the string is a browser disguise, and it is not proof the request came from Shenma.

Mozilla/5.0 (Linux; U; Android 4.3; zh-CN; SCH-N719 Build/JSS15J) AppleWebKit/533.1 (KHTML, like Gecko) Version/4.0 YisouSpider/1.0.0 Mobile Safari/533.1

Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e YisouSpider/5.0 Safari/602.1

Whether to block it

Block it only if you do not want pages in Shenma’s index. Disallowing YisouSpider does not change what Baiduspider or Sogou web spider may fetch. Allow it, in its own group, if you want that mobile-search traffic. CrawlCheck does not have a published IP feed for this token, so a matching user-agent is a claim, not a verification.

Allow or block it in robots.txt

User-agent: YisouSpider
Disallow: /

User-agent: YisouSpider
Allow: /

Add a group that names it: "User-agent: YisouSpider" followed by "Disallow: /". A crawler follows only the most specific group that names it, so once a group names YisouSpider, rules under "User-agent: *" no longer apply to it; repeat in that group any Disallow lines you still want.

What blocking it changes

No. It indexes for a regional search engine; allowing it matters only if you serve that market.

See what YisouSpider and every other named agent receive from your own site: run a free scan. The full catalogue is on AI crawlers and as JSON at /ai-crawlers.json.

Questions about YisouSpider

QHow do I block YisouSpider in robots.txt?

QHow can I tell if a request from YisouSpider is real?

Its operator publishes no IP ranges or DNS names for it, so a request carrying this name cannot be verified. Treat the name in a log line as a claim.

QDoes blocking YisouSpider affect whether my site appears in AI answers?

No. It indexes for a regional search engine; allowing it matters only if you serve that market.

QDoes CrawlCheck test my site as YisouSpider?

Not as a request. CrawlCheck reads the rules your robots.txt sets for YisouSpider and reports them. Rules for it are reported and never scored, because refusing it is a policy choice.

QWhat is YisouSpider?

YisouSpider is the robots.txt token for Shenma Search (sm.cn), the mobile search engine UCWeb and Alibaba launched in 2014. In logs the token usually sits inside a browser-like user-agent, often a mobile one. It is not Baiduspider, not Sogou web spider, and not EasouSpider.

QShould I block YisouSpider?

Block it only if you do not want pages in Shenma’s index. A Disallow for YisouSpider does not change what Baiduspider or Sogou web spider may fetch. If you want that mobile-search traffic, give it its own group with Allow: /.