AmazonProductDiscoverybot (Amazon): what it is and how to allow or block it
Updated · checked against the operator's documentation on
AmazonProductDiscoverybot is Amazon's crawler that collects publicly available product details from selling-partner, brand and retailer websites. Amazon says every request is signed with Signature headers and that the bot honors robots.txt. Block it with User-agent: AmazonProductDiscoverybot. Its robots.txt token is AmazonProductDiscoverybot.
Seen AmazonProductDiscovery/1.0 in your logs?
Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0 (compatible; AmazonProductDiscovery/1.0; https://vendorcentral.amazon.com/support/amazonproductbot)The example string from Amazon's documentation. Version numbers change; the token AmazonProductDiscoverybot stays.
- What it is
- A special-purpose crawler run by Amazon.
- Honors robots.txt
- YesYes, per Amazon.
- Real or fake?
- No official checkThe user agent is only a claim, and Amazon publishes no IP list or DNS check we could find.
- If you block it
- Amazon stops collecting product details from your site with this bot.
Facts
- Operator
- Amazon
- Category
- Special-purpose crawler
- robots.txt token
AmazonProductDiscoverybot
- Honors robots.txt?
- Yes, per Amazon. Amazon says it honors the user-agent and Disallow directives, that changes can take up to 24 hours to apply, and that if robots.txt cannot be fetched it behaves as if none exists. It says the bot does not support crawl-delay, nofollow or noindex.
- User-agent example
Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0 (compatible; AmazonProductDiscovery/1.0; https://vendorcentral.amazon.com/support/amazonproductbot)
- Official source
- Amazon: Amazon Product Bot
- Compared with the source
What it is used for
Per Amazon, AmazonProductDiscoverybot collects publicly available product details from Amazon selling-partner, brand and retailer websites to improve the accuracy and completeness of product information on Amazon. A second agent, AmazonSellerInitiatedListing, creates product pages when a seller supplies a website URL.
Not the crawler behind a search index. What blocking it changes is specific to its tool, so read the next section.
What happens if you block it
Amazon stops collecting product details from your site with this bot. It is not Amazonbot and not a search engine crawler.
Amazon publishes no IP ranges. It says every request carries Signature, Signature-Input and Signature-Agent headers; to verify, fetch the public key from the directory named in the Signature-Agent header and validate the signature. The user agent contains the token AmazonProductDiscovery/1.0; the robots.txt line Amazon shows is AmazonProductDiscoverybot.
Is it really AmazonProductDiscoverybot?
Anyone can send AmazonProductDiscoverybot as a user agent, and Amazon publishes no IP list or reverse-DNS method that we could find, so a log line cannot prove a request is real. Check whether it fetched /robots.txt and whether the address belongs to the operator's network.
- We did not find an IP list or a reverse-DNS method in the official source we compared on 2026-11-09, so the user agent alone cannot show that a request is genuine. Check the operator's page for updates.
- Guide: Which crawlers send Web Bot Auth headers? 34 hours of requests to a small site.
- Guide: Fake Googlebots and PHP scanners: what hit our new server in 48 hours.
- Paste any user agent from your logs into the user-agent lookup, or follow the scripts in Fake Googlebots and PHP scanners.
How to allow or block AmazonProductDiscoverybot
Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.
User-agent: AmazonProductDiscoverybot Allow: /
User-agent: AmazonProductDiscoverybot Disallow: /
Block AmazonProductDiscoverybot at the server
robots.txt asks; a server rule refuses. These answer 403 to any request whose user agent contains amazonproductdiscovery (case-insensitive). They stop only bots that name themselves honestly, so keep the robots.txt group as well.
# server { ... }
if ($http_user_agent ~* "amazonproductdiscovery") {
return 403;
}RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} amazonproductdiscovery [NC]
RewriteRule .* - [F,L]Step by step, with a test command: Block AI bots in nginx by user agent · Block AI bots in Apache with .htaccess · Block AI crawlers on Cloudflare · Block AI bots on Vercel
Does your site allow AmazonProductDiscoverybot today? The checker evaluates your robots.txt for this and every other bot.Check my site
What we see on this site
No request identifying as AmazonProductDiscoverybot has been recorded in the last 30 days, so there is nothing to show yet. We never fill this in with estimates.
Counts come from this site's own server; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.
Questions about AmazonProductDiscoverybot
What is AmazonProductDiscoverybot?
Amazon's crawler that collects public product details from seller, brand and retailer sites. Per Amazon, AmazonProductDiscoverybot collects publicly available product details from Amazon selling-partner, brand and retailer websites to improve the accuracy and completeness of product information on Amazon. A second agent, AmazonSellerInitiatedListing, creates product pages when a seller supplies a website URL.
Is AmazonProductDiscoverybot safe and legitimate?
The real AmazonProductDiscoverybot is a special-purpose crawler run by Amazon. A user-agent string is only a claim, though, so anyone can send it. We did not find an IP list or reverse-DNS method in the official source we compared on 2026-11-09, so the user agent alone cannot prove a request is real.
Does AmazonProductDiscoverybot obey robots.txt?
Yes, per Amazon. Amazon says it honors the user-agent and Disallow directives, that changes can take up to 24 hours to apply, and that if robots.txt cannot be fetched it behaves as if none exists. It says the bot does not support crawl-delay, nofollow or noindex.
How do I block AmazonProductDiscoverybot?
Add a group to the robots.txt at the root of your domain: User-agent: AmazonProductDiscoverybot followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.
Will blocking AmazonProductDiscoverybot hurt my Google rankings or AI visibility?
This is not the crawler behind a search index, so blocking it is not a ranking decision. Amazon stops collecting product details from your site with this bot. It is not Amazonbot and not a search engine crawler.
What does "Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0 (compatible; AmazonProductDiscovery/1.0; https://vendorcentral.amazon.com/support/amazonproductbot)" mean in my logs?
It is the user-agent string in Amazon's documentation for AmazonProductDiscoverybot, a special-purpose crawler run by Amazon. The part that robots.txt rules match is the token AmazonProductDiscoverybot. The string is only a claim, because anyone can send it; the section "Is it really AmazonProductDiscoverybot?" above shows how to check a request.
Related bots
More from Amazon
- Amazonbot AI training crawlerAmazon's crawler, used to improve its products and services and possibly to train Amazon AI models.
- Amzn-SearchBot AI search crawlerAmazon's crawler for search experiences in Amazon products and services, such as Alexa.
- Amzn-User AI user-triggered fetcherAmazon's fetcher that retrieves live web pages for user actions, such as answering Alexa questions.
Other Special-purpose crawlers
- GoogleOther GoogleGoogle's generic crawler that product teams can use for their own purposes.
- Google-InspectionTool GoogleThe Google fetcher behind Search testing tools such as the Rich Result Test and URL Inspection.
- archive.org_bot Internet ArchiveReported to be the crawler the Internet Archive uses for Wayback Machine and Archive-It captures.
- WebMCPIndexBot WebMCP ShieldA survey crawler that measures how widely websites adopt WebMCP.
All Special-Purpose Crawlers · Bot directory · Bots from Amazon · Which bots to allow or block · robots.txt generator · See a page as a bot