Barkrowler (Babbar.tech): what it is and how to allow or block it

Updated · checked against the operator's documentation on

Barkrowler is the crawler of Babbar.tech, which feeds Babbar's graph of the web for SEO and online-marketing tools. Babbar says it follows robots.txt including Disallow and Crawl-delay. Block it with User-agent: barkrowler. Its robots.txt token is barkrowler.

Seen Barkrowler in your logs?

What it is
An SEO tool crawler run by Babbar.tech.
Honors robots.txt
YesYes, per Babbar.tech.
Real or fake?
Can be verifiedThe user agent is only a claim. Check the requesting IP against Babbar.tech's published IP ranges.
If you block it
Your pages stop being crawled for Babbar's link graph and the tools built on it.

Facts

Operator
Babbar.tech
Category
SEO tool crawler
robots.txt token
barkrowler
Honors robots.txt?
Yes, per Babbar.tech. Babbar.tech says Barkrowler follows robots.txt, using the crawler-commons toolset, including Disallow, and follows Crawl-delay. Its default politeness interval is 5 seconds between requests to the same host. Rule for it: User-agent: barkrowler followed by Disallow or Crawl-delay.
User-agent example
Contains barkrowler (the operator documents no full example string)
Official source
Babbar.tech: Barkrowler
Published IP ranges
https://www.babbar.tech/barkrowler-ip-ranges.json
Compared with the source

What it is used for

Per Babbar.tech, Barkrowler (version 0.9) feeds and updates Babbar's graph representation of the web, which powers SEO and online-marketing tools. It crawls URLs found on public pages and keeps links and meta-information, not page content. It may still crawl nofollow links, because nofollow does not block crawling.

Crawls the web for a marketing or SEO tool, mostly to build a backlink or site database. It does not decide whether you rank, and blocking it only removes you from that tool's data.

What happens if you block it

Your pages stop being crawled for Babbar's link graph and the tools built on it. Nothing about your Google rankings changes.

Babbar.tech publishes its IP ranges at https://www.babbar.tech/barkrowler-ip-ranges.json and gives the reverse-DNS suffix babbar.eu. The page documents no full user-agent string, only the token barkrowler. Babbar says it may be blacklisted by firewalls that mistake it for an attack.

Is it really Barkrowler?

Anyone can send Barkrowler as a user agent, so a log line proves nothing by itself. The way to tell is the requesting IP address.

How to allow or block Barkrowler

Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.

Allow Barkrowler
User-agent: barkrowler
Allow: /
Block Barkrowler
User-agent: barkrowler
Disallow: /

Block Barkrowler at the server

robots.txt asks; a server rule refuses. These answer 403 to any request whose user agent contains barkrowler (case-insensitive). They stop only bots that name themselves honestly, so keep the robots.txt group as well.

nginx
# server { ... }
if ($http_user_agent ~* "barkrowler") {
    return 403;
}
Apache (.htaccess)
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} barkrowler [NC]
RewriteRule .* - [F,L]

Step by step, with a test command: Block AhrefsBot, SemrushBot, MJ12bot and other SEO crawlers · Block AI bots in nginx by user agent · Block AI bots in Apache with .htaccess

Does your site allow Barkrowler today? The checker evaluates your robots.txt for this and every other bot.Check my site

What we see on this site

Live counter, last 30 days: 203 requests on 3 days identified as Barkrowler (latest: ).

  • Content pages: 198
  • robots.txt: 3
  • Home page: 1
  • Legal pages: 1

Counts come from this site's own server; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.

Questions about Barkrowler

What is Barkrowler?

Babbar.tech's crawler that feeds its web graph for SEO and marketing tools. Per Babbar.tech, Barkrowler (version 0.9) feeds and updates Babbar's graph representation of the web, which powers SEO and online-marketing tools. It crawls URLs found on public pages and keeps links and meta-information, not page content. It may still crawl nofollow links, because nofollow does not block crawling.

Is Barkrowler safe and legitimate?

The real Barkrowler is an SEO tool crawler run by Babbar.tech. A user-agent string is only a claim, though, so anyone can send it. Compare the requesting IP address with the published IP ranges.

Does Barkrowler obey robots.txt?

Yes, per Babbar.tech. Babbar.tech says Barkrowler follows robots.txt, using the crawler-commons toolset, including Disallow, and follows Crawl-delay. Its default politeness interval is 5 seconds between requests to the same host. Rule for it: User-agent: barkrowler followed by Disallow or Crawl-delay.

How do I block Barkrowler?

Add a group to the robots.txt at the root of your domain: User-agent: barkrowler followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.

Will blocking Barkrowler hurt my Google rankings or AI visibility?

Not for Google rankings. SEO tool crawlers do not decide whether you rank; blocking one only removes you from that tool's data. Your pages stop being crawled for Babbar's link graph and the tools built on it. Nothing about your Google rankings changes.

Other SEO tool crawlers

All SEO Tool Crawlers · Bot directory · Which bots to allow or block · robots.txt generator · See a page as a bot