Crawlerpeek
Check a site

xAI-SearchBot (xAI): what it is and how to allow or block it

Updated · checked against the operator's documentation on

xAI-SearchBot is a crawler that identifies itself as xAI-SearchBot in server logs. Its robots.txt token is xAI-SearchBot.

Facts

Operator
xAI
Category
AI search crawler (reported, unconfirmed)
robots.txt token
xAI-SearchBot
Honors robots.txt?
Not documented. xAI documents nothing about robots.txt for this agent that we could find; compliance is unconfirmed.
User-agent example
Contains xai-searchbot (the operator documents no full example string)
User agent we logged
Mozilla/5.0 (compatible; xAI-SearchBot/1.0; +https://x.ai)Most common variant in our own logs, 32 requests, 19 to 25 Oct 2026. Static snapshot, not the live counter below. A logged string is a claim: anyone can send it.
Official source
No crawler documentation published by xAI (checked 2026-10-25)
Compared with the source

What it is used for

Third-party bot directories list it as a search crawler. xAI itself publishes no crawler page that we could find, so its purpose is not confirmed by the operator.

What happens if you block it

We cannot say what blocking it changes, because xAI documents nothing about this agent. Directories describe it as a search crawler, so a block may keep you out of a search feature; that is unconfirmed.

xAI publishes no crawler page that we could find. The user agent points to the company homepage, not to a bot page. Because anyone can send this user agent, treat the identity of a request as unconfirmed.

Is it really xAI-SearchBot?

Anyone can send xAI-SearchBot as a user agent, and xAI publishes no IP list or reverse-DNS method that we could find, so a log line cannot prove a request is real. Check whether it fetched /robots.txt and whether the address belongs to the operator's network.

  • xAI publishes no crawler documentation that we could find (checked 2026-10-25), so there is no IP list or reverse-DNS method to compare against and the user agent alone cannot show that a request is genuine.
  • Paste any user agent from your logs into the user-agent lookup, or follow the scripts in Fake Googlebots and PHP scanners.

How to allow or block xAI-SearchBot

Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.

Allow xAI-SearchBot
User-agent: xAI-SearchBot
Allow: /
Block xAI-SearchBot
User-agent: xAI-SearchBot
Disallow: /

Does your site allow xAI-SearchBot today? The checker evaluates your robots.txt for this and every other bot.Check my site

What we see on our own sites

Live counter, last 30 days: no request identifying as xAI-SearchBot recorded yet. The counter started after the week below, so it does not cover it. Earlier log snapshot (19 to 25 Oct 2026): 32 requests identified as xAI-SearchBot.

Counts come from the websites we operate; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.

Questions about xAI-SearchBot

What is xAI-SearchBot?

A crawler that identifies itself as xAI-SearchBot in server logs. Third-party bot directories list it as a search crawler. xAI itself publishes no crawler page that we could find, so its purpose is not confirmed by the operator.

Is xAI-SearchBot safe and legitimate?

xAI publishes no crawler documentation that we could find, so we cannot say what a genuine xAI-SearchBot request looks like. A user-agent string is only a claim, and anyone can send it. We found no IP list or reverse-DNS method published by xAI (checked 2026-10-25), so the user agent alone cannot prove a request is real.

Does xAI-SearchBot obey robots.txt?

Not documented. xAI documents nothing about robots.txt for this agent that we could find; compliance is unconfirmed.

How do I block xAI-SearchBot?

Add a group to the robots.txt at the root of your domain: User-agent: xAI-SearchBot followed by Disallow: /. A group that names the bot overrides a general User-agent: * group. xAI documents nothing about robots.txt for this agent, so we cannot promise it is honored.

Will blocking xAI-SearchBot hurt my Google rankings or AI visibility?

xAI documents nothing about this agent, so we cannot say what blocking it changes. Bot directories describe it as a search crawler; that is unconfirmed.

Related bots

Other AI search crawlers

All AI Search Crawlers · Bot directory · Which bots to allow or block · robots.txt generator · See a page as a bot