Crawlerpeek
Check a site

Baiduspider (Baidu): what it is and how to allow or block it

Updated · checked against the operator's documentation on

Baiduspider is Baidu's search engine crawler, which collects pages for the Baidu Search index. Its robots.txt token is Baiduspider.

Facts

Operator
Baidu
Category
Search engine crawler
robots.txt token
Baiduspider
Honors robots.txt?
Yes, per Baidu. Baidu says it checks robots.txt in the site root and supports the * and $ wildcards; the order of Allow and Disallow rules matters.
User-agent example
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
User agent we logged
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)Most common variant in our own logs, 49 requests, 19 to 25 Oct 2026. Static snapshot, not the live counter below. A logged string is a claim: anyone can send it.
Official source
Baidu: robots.txt (English)
Compared with the source

What it is used for

Per Baidu's English robots.txt page, it crawls pages for the Baidu search index. A Baiduspider-render variant is reported to exist for rendered crawling.

A traditional search engine crawler. AI features of the same company often draw on its index.

What happens if you block it

Per Baidu, it will not crawl, index or show the content of pages blocked by robots.txt. A blocked URL can still appear if other sites link to it.

Baidu's own spider FAQ is in Chinese and the page named in the user agent now redirects to a page we could not read, so the user-agent shape and the verification method come from secondary sources. Third-party reports on compliance conflict.

Is it really Baiduspider?

Anyone can send Baiduspider as a user agent, and Baidu publishes no IP list or reverse-DNS method that we could find, so a log line cannot prove a request is real. Check whether it fetched /robots.txt and whether the address belongs to the operator's network.

  • We did not find an IP list or a reverse-DNS method in the official source we compared on 2026-10-25, so the user agent alone cannot show that a request is genuine. Check the operator's page for updates.
  • Paste any user agent from your logs into the user-agent lookup, or follow the scripts in Fake Googlebots and PHP scanners.

How to allow or block Baiduspider

Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.

Allow Baiduspider
User-agent: Baiduspider
Allow: /
Block Baiduspider
User-agent: Baiduspider
Disallow: /

Does your site allow Baiduspider today? The checker evaluates your robots.txt for this and every other bot.Check my site

What we see on our own sites

Live counter, last 30 days: 1 request on 1 day identified as Baiduspider (latest: ). That is a small sample: read it as an example, not as a measurement of the web.

  • Content pages: 1

Counts come from the websites we operate; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.

Questions about Baiduspider

What is Baiduspider?

Baidu's search engine crawler, which collects pages for the Baidu Search index. Per Baidu's English robots.txt page, it crawls pages for the Baidu search index. A Baiduspider-render variant is reported to exist for rendered crawling.

Is Baiduspider safe and legitimate?

The real Baiduspider is a search engine crawler run by Baidu. A user-agent string is only a claim, though, so anyone can send it. We did not find an IP list or reverse-DNS method in the official source we compared on 2026-10-25, so the user agent alone cannot prove a request is real.

Does Baiduspider obey robots.txt?

Yes, per Baidu. Baidu says it checks robots.txt in the site root and supports the * and $ wildcards; the order of Allow and Disallow rules matters.

How do I block Baiduspider?

Add a group to the robots.txt at the root of your domain: User-agent: Baiduspider followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.

Will blocking Baiduspider hurt my Google rankings or AI visibility?

For that search engine, yes: this is the crawler behind its index, and AI features of the same company often draw on that index. Per Baidu, it will not crawl, index or show the content of pages blocked by robots.txt. A blocked URL can still appear if other sites link to it.

Related bots

Other Search engine crawlers

All Search Engine Crawlers · Bot directory · Which bots to allow or block · robots.txt generator · See a page as a bot