Crawlerpeek
Check a site

DataForSeoBot (DataForSEO): what it is and how to allow or block it

Updated · checked against the operator's documentation on

DataForSeoBot is DataForSEO's crawler that adds links to its backlink database. Its robots.txt token is DataForSeoBot.

Facts

Operator
DataForSEO
Category
SEO tool crawler
robots.txt token
DataForSeoBot
Honors robots.txt?
Yes, per DataForSEO. DataForSEO says it obeys robots.txt and Crawl-delay, with a default of about one visit per 5 seconds.
User-agent example
Mozilla/5.0 (compatible; DataForSeoBot; +https://dataforseo.com/dataforseo-bot)
Official source
DataForSEO: DataForSeoBot
Compared with the source

What it is used for

Per DataForSEO, it constantly crawls the web to add new links to its backlink database and to recheck known links. It states it collects no other site data.

Crawls the web for a marketing or SEO tool, mostly to build a backlink or site database. It does not decide whether you rank, and blocking it only removes you from that tool's data.

What happens if you block it

DataForSEO stops adding links from your pages to its backlink database and stops rechecking known ones. Search rankings are not affected.

DataForSEO publishes its address ranges on the page itself, not as a downloadable file. We did not see DataForSeoBot in our logs.

Is it really DataForSeoBot?

Anyone can send DataForSeoBot as a user agent, so a log line proves nothing by itself. The way to tell is the requesting IP address.

How to allow or block DataForSeoBot

Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.

Allow DataForSeoBot
User-agent: DataForSeoBot
Allow: /
Block DataForSeoBot
User-agent: DataForSeoBot
Disallow: /

Does your site allow DataForSeoBot today? The checker evaluates your robots.txt for this and every other bot.Check my site

What we see on our own sites

No request identifying as DataForSeoBot has been recorded in the last 30 days, so there is nothing to show yet. We never fill this in with estimates.

Counts come from the websites we operate; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.

Questions about DataForSeoBot

What is DataForSeoBot?

DataForSEO's crawler that adds links to its backlink database. Per DataForSEO, it constantly crawls the web to add new links to its backlink database and to recheck known links. It states it collects no other site data.

Is DataForSeoBot safe and legitimate?

The real DataForSeoBot is an SEO tool crawler run by DataForSEO. A user-agent string is only a claim, though, so anyone can send it. Compare the requesting IP address with the published IP ranges. DataForSEO documents reverse DNS names of the form crawling-gateway-*.dataforseo.com.

Does DataForSeoBot obey robots.txt?

Yes, per DataForSEO. DataForSEO says it obeys robots.txt and Crawl-delay, with a default of about one visit per 5 seconds.

How do I block DataForSeoBot?

Add a group to the robots.txt at the root of your domain: User-agent: DataForSeoBot followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.

Will blocking DataForSeoBot hurt my Google rankings or AI visibility?

Not for Google rankings. SEO tool crawlers do not decide whether you rank; blocking one only removes you from that tool's data. DataForSEO stops adding links from your pages to its backlink database and stops rechecking known ones. Search rankings are not affected.

Related bots

Other SEO tool crawlers

All SEO Tool Crawlers · Bot directory · Which bots to allow or block · robots.txt generator · See a page as a bot