Bot operators: which company runs which crawler

Most large operators run several bots with different jobs, and each has its own robots.txt token. These are the operators with two or more bots in our directory.

• AnthropicClaudeBot, Claude-SearchBot, Claude-User
• Metameta-externalagent, meta-externalfetcher, facebookexternalhit
• OpenAIGPTBot, OAI-SearchBot, ChatGPT-User
• AppleApplebot-Extended, Applebot
• GoogleGoogle-Extended, Googlebot
• PerplexityPerplexityBot, Perplexity-User

See every bot in the bot directory.