Storebot-Google (Google): what it is and how to allow or block it
Updated · checked against the operator's documentation on
Storebot-Google is Google's crawler for Google Shopping. Its robots.txt token is Storebot-Google.
Facts
- Operator
- Category
- Search engine crawler
- robots.txt token
Storebot-Google
- Honors robots.txt?
- Yes, per Google. Google says its common crawlers always obey robots.txt rules when crawling automatically.
- User-agent example
Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36
- Official source
- Google: Overview of Google crawlers and fetchers
- Compared with the source
What it is used for
Per Google, its robots.txt rules apply to all Google Shopping surfaces, including the Shopping tab in Google Search.
What happens if you block it
Your pages can drop out of Google Shopping, including the Shopping tab in Google Search.
Google's verification page names several IP range files but does not say which crawler is in which file, so check the current page rather than assuming.
Is it really Storebot-Google?
Anyone can send Storebot-Google as a user agent, so a log line proves nothing by itself. The way to tell is the requesting IP address.
- Compare the IP address with the Google: Verifying Googlebot (links the IP range files). A request from outside those ranges is not the operator's crawler.
- Paste any user agent from your logs into the user-agent lookup, or follow the scripts in Fake Googlebots and PHP scanners.
How to allow or block Storebot-Google
Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.
User-agent: Storebot-Google Allow: /
User-agent: Storebot-Google Disallow: /
Does your site allow Storebot-Google today? The checker evaluates your robots.txt for this and every other bot.Check my site
What we see on our own sites
No request identifying as Storebot-Google has been recorded in the last 30 days, so there is nothing to show yet. We never fill this in with estimates.
Counts come from the websites we operate; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.
Questions about Storebot-Google
What is Storebot-Google?
Google's crawler for Google Shopping. Per Google, its robots.txt rules apply to all Google Shopping surfaces, including the Shopping tab in Google Search.
Is Storebot-Google safe and legitimate?
The real Storebot-Google is a search engine crawler run by Google. A user-agent string is only a claim, though, so anyone can send it. Compare the requesting IP address with the published IP ranges.
Does Storebot-Google obey robots.txt?
Yes, per Google. Google says its common crawlers always obey robots.txt rules when crawling automatically.
How do I block Storebot-Google?
Add a group to the robots.txt at the root of your domain: User-agent: Storebot-Google followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.
Will blocking Storebot-Google hurt my Google rankings or AI visibility?
It affects Google Shopping. Per Google, its rules apply to all surfaces of Google Shopping, including the Shopping tab in Google Search.
Related bots
More from Google
- Google-Extended AI control tokenA robots.txt token that lets you manage whether Google may use crawled content for Gemini training and grounding.
- Googlebot Search engine crawlerGoogle's main crawler for Google Search, whose index Google's AI features in Search also draw on.
- Googlebot-Image Search engine crawlerGoogle's crawler for the images that appear in Google Search and related surfaces.
- GoogleOther Special-purpose crawlerGoogle's generic crawler that product teams can use for their own purposes.
Other Search engine crawlers
- Bingbot MicrosoftMicrosoft's crawler for the Bing search index.
- Applebot AppleApple's crawler for search in Spotlight, Siri and Safari.
- DuckDuckBot DuckDuckGoDuckDuckGo's crawler for its search results.
- SofyaBot SofyaCrawler for Sofya's independent search index.
All Search Engine Crawlers · Bot directory · Bots from Google · Which bots to allow or block · robots.txt generator · See a page as a bot