SiteCheckerBotCrawler (Sitechecker): what it is and how to allow or block it
Updated · checked against the operator's documentation on
SiteCheckerBotCrawler is the crawler of the Sitechecker SEO tool, which scans only the domains its users ask for. Its robots.txt token is SiteCheckerBotCrawler.
Facts
- Operator
- Sitechecker
- Category
- SEO tool crawler
- robots.txt token
SiteCheckerBotCrawler
- Honors robots.txt?
- Exclusion example documented. Sitechecker's page shows User-agent: SiteCheckerBotCrawler examples with Disallow: / and Allow: /, and mentions .htaccess or firewall rules as another way to block it. It does not mention a crawl delay.
- User-agent example
SiteCheckerBotCrawler/1.0 (+http://sitechecker.pro)
- Official source
- Sitechecker: how to control the robot
- Compared with the source
What it is used for
Per Sitechecker, it scans only the domains or URLs that users request, in its Site Audit, Site Monitoring and On-Page Checker tools.
Crawls the web for a marketing or SEO tool, mostly to build a backlink or site database. It does not decide whether you rank, and blocking it only removes you from that tool's data.
What happens if you block it
Sitechecker's Site Audit, Site Monitoring and On-Page Checker tools cannot scan your pages when its users ask for them.
Sitechecker says it publishes an IP list on its crawler site; we did not fetch it, so we link the help page that mentions it. No reverse-DNS method is documented. We did not see this bot in our logs.
Is it really SiteCheckerBotCrawler?
Anyone can send SiteCheckerBotCrawler as a user agent, so a log line proves nothing by itself. The way to tell is the requesting IP address.
- Compare the IP address with the Sitechecker: help page (mentions its IP list). A request from outside those ranges is not the operator's crawler.
- Paste any user agent from your logs into the user-agent lookup, or follow the scripts in Fake Googlebots and PHP scanners.
How to allow or block SiteCheckerBotCrawler
Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.
User-agent: SiteCheckerBotCrawler Allow: /
User-agent: SiteCheckerBotCrawler Disallow: /
Does your site allow SiteCheckerBotCrawler today? The checker evaluates your robots.txt for this and every other bot.Check my site
What we see on our own sites
No request identifying as SiteCheckerBotCrawler has been recorded in the last 30 days, so there is nothing to show yet. We never fill this in with estimates.
Counts come from the websites we operate; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.
Questions about SiteCheckerBotCrawler
What is SiteCheckerBotCrawler?
The crawler of the Sitechecker SEO tool, which scans only the domains its users ask for. Per Sitechecker, it scans only the domains or URLs that users request, in its Site Audit, Site Monitoring and On-Page Checker tools.
Is SiteCheckerBotCrawler safe and legitimate?
The real SiteCheckerBotCrawler is an SEO tool crawler run by Sitechecker. A user-agent string is only a claim, though, so anyone can send it. Compare the requesting IP address with the published IP ranges.
Does SiteCheckerBotCrawler obey robots.txt?
Exclusion example documented. Sitechecker's page shows User-agent: SiteCheckerBotCrawler examples with Disallow: / and Allow: /, and mentions .htaccess or firewall rules as another way to block it. It does not mention a crawl delay.
How do I block SiteCheckerBotCrawler?
Robots.txt may not stop it. Sitechecker's page shows User-agent: SiteCheckerBotCrawler examples with Disallow: / and Allow: /, and mentions .htaccess or firewall rules as another way to block it. It does not mention a crawl delay. If you add a group anyway, use User-agent: SiteCheckerBotCrawler followed by Disallow: /.
Will blocking SiteCheckerBotCrawler hurt my Google rankings or AI visibility?
Not for Google rankings. SEO tool crawlers do not decide whether you rank; blocking one only removes you from that tool's data. Sitechecker's Site Audit, Site Monitoring and On-Page Checker tools cannot scan your pages when its users ask for them.
Related bots
Other SEO tool crawlers
- AhrefsBot AhrefsThe crawler of Ahrefs, a marketing intelligence platform.
- SemrushBot SemrushSemrush's crawler for data behind tools such as Backlink Analytics and Site Audit.
- MJ12bot MajesticMajestic's crawler that maps link relationships between websites for its search engine and backlink index.
- serpstatbot SerpstatSerpstat's crawler that collects links for its backlink database.
All SEO Tool Crawlers · Bot directory · Which bots to allow or block · robots.txt generator · See a page as a bot