PerplexityBot (Perplexity): what it is and how to allow or block it
PerplexityBot is Perplexity's crawler that surfaces and links websites in Perplexity search results. Its robots.txt token is PerplexityBot.
Facts
- Operator
- Perplexity
- Category
- AI search crawler
- robots.txt token
PerplexityBot
- Honors robots.txt?
- Yes, per Perplexity. Perplexity documents robots.txt control; changes may take up to 24 hours to take effect.
- User-agent example
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
- Official source
- Perplexity: Bots and user agents
- Published IP ranges
- https://www.perplexity.com/perplexitybot.json
- Compared with the source
What it is used for
Designed to surface and link websites in Perplexity search results. Perplexity says it is not used to gather data for AI foundation model training. Builds the index an AI assistant searches when it answers. Blocking it can keep you out of that assistant's answers.
What happens if you block it
Perplexity says sites should allow PerplexityBot in robots.txt for their pages to appear in its search results.
How to allow or block PerplexityBot
Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.
User-agent: PerplexityBot Allow: /
User-agent: PerplexityBot Disallow: /
Does your site allow PerplexityBot today? The checker evaluates your robots.txt for this and every other bot.Check my site
What we see on our own sites
No request identifying as PerplexityBot has been recorded in the last 30 days, so there is nothing to show yet. We never fill this in with estimates.
Counts come from the websites we operate; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.
Related bots
More from Perplexity
Other AI search crawlers
- OAI-SearchBot OpenAIOpenAI's crawler that surfaces websites in ChatGPT's search features.
- Claude-SearchBot AnthropicAnthropic's crawler that analyzes online content to improve the quality of Claude's search results.
All AI Search Crawlers · Bot directory · Bots from Perplexity · Which bots to allow or block · robots.txt generator · See a page as a bot