User-agent lookup: which bot is this?
Paste a user-agent string from your server logs. We match it against the bots in our catalogue and show who runs the bot, what it does and how to check that a request really came from it.
Result for
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
- Bot
- AhrefsBot
- Operator
- Ahrefs
- Category
- SEO tool crawler
- Matched on
ahrefsbot
- Honors robots.txt?
- Yes, per Ahrefs
Is the request really from this bot?
- The user agent only says what the client calls itself. Anyone can send
AhrefsBot, so check the requesting IP address. - Compare it with the Ahrefs: published IP ranges.
- Of 651 requests that claimed to be AhrefsBot on our sites (19 to 25 October 2026), all came from the published IP ranges of Ahrefs. Our study and its limits.
- Scripts for the check are in Fake Googlebots and PHP scanners. To allow or block the bot, see its bot page.
Questions
Can a user agent tell me whether a request is real?
No. A user-agent string is only a claim, and any client can send any string. Compare the requesting IP address with the operator's published IP ranges or, where documented, a reverse-DNS check. Our study of forged bot names has the numbers, and the crawler IP checker runs the comparison for you.
What if my user agent is not found?
The catalogue is small and checked by hand, so many bots are missing. Look for a URL or email address inside the string, which often leads to the operator's page, then check the IP address and whether the client fetched robots.txt.
Looking for the other direction? The checker shows which bots your robots.txt lets in, and the bot directory lists every bot we document. To check an address from your logs, use the crawler IP checker. To test how your own site answers these user agents, use the crawlerpeek CLI.