Crawlerpeek
Check a site

WebMCPIndexBot (WebMCP Shield): what it is and how to allow or block it

Updated · checked against the operator's documentation on

WebMCPIndexBot is a survey crawler that measures how widely websites adopt WebMCP. Its robots.txt token is WebMCPIndexBot.

Facts

Operator
WebMCP Shield
Category
Special-purpose crawler
robots.txt token
WebMCPIndexBot
Honors robots.txt?
Yes, per WebMCP Shield. The operator says it checks robots.txt first and treats a disallow as final. Some follow-up requests load pages in a real browser from other hosts.
User-agent example
WebMCPIndexBot/0.1 (+https://webmcpshield.com/bot)
User agent we logged
WebMCPIndexBot/0.1 (+https://webmcpshield.com/bot)Most common variant in our own logs, 26 requests, 19 to 25 Oct 2026. Static snapshot, not the live counter below. A logged string is a claim: anyone can send it.
Official source
WebMCP Shield: WebMCPIndexBot
Compared with the source

What it is used for

Per the operator, it measures how widely sites adopt WebMCP and publishes the results in aggregate.

Not the crawler behind a search index. What blocking it changes is specific to its tool, so read the next section.

What happens if you block it

Your site is left out of the WebMCP adoption survey and its aggregate results.

Version 0.1 of a new bot. No IP list is published.

Is it really WebMCPIndexBot?

Anyone can send WebMCPIndexBot as a user agent, and WebMCP Shield publishes no IP list or reverse-DNS method that we could find, so a log line cannot prove a request is real. Check whether it fetched /robots.txt and whether the address belongs to the operator's network.

  • We did not find an IP list or a reverse-DNS method in the official source we compared on 2026-10-25, so the user agent alone cannot show that a request is genuine. Check the operator's page for updates.
  • Paste any user agent from your logs into the user-agent lookup, or follow the scripts in Fake Googlebots and PHP scanners.

How to allow or block WebMCPIndexBot

Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.

Allow WebMCPIndexBot
User-agent: WebMCPIndexBot
Allow: /
Block WebMCPIndexBot
User-agent: WebMCPIndexBot
Disallow: /

Does your site allow WebMCPIndexBot today? The checker evaluates your robots.txt for this and every other bot.Check my site

What we see on our own sites

Live counter, last 30 days: no request identifying as WebMCPIndexBot recorded yet. The counter started after the week below, so it does not cover it. Earlier log snapshot (19 to 25 Oct 2026): 26 requests identified as WebMCPIndexBot.

Counts come from the websites we operate; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.

Questions about WebMCPIndexBot

What is WebMCPIndexBot?

A survey crawler that measures how widely websites adopt WebMCP. Per the operator, it measures how widely sites adopt WebMCP and publishes the results in aggregate.

Is WebMCPIndexBot safe and legitimate?

The real WebMCPIndexBot is a special-purpose crawler run by WebMCP Shield. A user-agent string is only a claim, though, so anyone can send it. We did not find an IP list or reverse-DNS method in the official source we compared on 2026-10-25, so the user agent alone cannot prove a request is real.

Does WebMCPIndexBot obey robots.txt?

Yes, per WebMCP Shield. The operator says it checks robots.txt first and treats a disallow as final. Some follow-up requests load pages in a real browser from other hosts.

How do I block WebMCPIndexBot?

Add a group to the robots.txt at the root of your domain: User-agent: WebMCPIndexBot followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.

Will blocking WebMCPIndexBot hurt my Google rankings or AI visibility?

This is not the crawler behind a search index, so blocking it is not a ranking decision. Your site is left out of the WebMCP adoption survey and its aggregate results.

Related bots

Other Special-purpose crawlers

All Special-Purpose Crawlers · Bot directory · Which bots to allow or block · robots.txt generator · See a page as a bot