Storebot-Google (Google): what it is and how to allow or block it

Updated · checked against the operator's documentation on

Storebot-Google is Google's crawler for Google Shopping. Its robots.txt token is Storebot-Google.

Facts

Operator
Google
Category
Search engine crawler
robots.txt token
Storebot-Google
Honors robots.txt?
Yes, per Google. Google says its common crawlers always obey robots.txt rules when crawling automatically.
User-agent example
Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36
Official source
Google: Overview of Google crawlers and fetchers
Compared with the source

What it is used for

Per Google, its robots.txt rules apply to all Google Shopping surfaces, including the Shopping tab in Google Search.

What happens if you block it

Your pages can drop out of Google Shopping, including the Shopping tab in Google Search.

Google's verification page names several IP range files but does not say which crawler is in which file, so check the current page rather than assuming.

Is it really Storebot-Google?

Anyone can send Storebot-Google as a user agent, so a log line proves nothing by itself. The way to tell is the requesting IP address.

How to allow or block Storebot-Google

Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.

Allow Storebot-Google
User-agent: Storebot-Google
Allow: /
Block Storebot-Google
User-agent: Storebot-Google
Disallow: /

Does your site allow Storebot-Google today? The checker evaluates your robots.txt for this and every other bot.Check my site

What we see on our own sites

No request identifying as Storebot-Google has been recorded in the last 30 days, so there is nothing to show yet. We never fill this in with estimates.

Counts come from the websites we operate; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.

Questions about Storebot-Google

What is Storebot-Google?

Google's crawler for Google Shopping. Per Google, its robots.txt rules apply to all Google Shopping surfaces, including the Shopping tab in Google Search.

Is Storebot-Google safe and legitimate?

The real Storebot-Google is a search engine crawler run by Google. A user-agent string is only a claim, though, so anyone can send it. Compare the requesting IP address with the published IP ranges.

Does Storebot-Google obey robots.txt?

Yes, per Google. Google says its common crawlers always obey robots.txt rules when crawling automatically.

How do I block Storebot-Google?

Add a group to the robots.txt at the root of your domain: User-agent: Storebot-Google followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.

Will blocking Storebot-Google hurt my Google rankings or AI visibility?

It affects Google Shopping. Per Google, its rules apply to all surfaces of Google Shopping, including the Shopping tab in Google Search.

More from Google

Other Search engine crawlers

All Search Engine Crawlers · Bot directory · Bots from Google · Which bots to allow or block · robots.txt generator · See a page as a bot