VeskonBot (Veskon): what it is and how to allow or block it
Updated · checked against the operator's documentation on
VeskonBot is the crawler of Veskon, a directory that lists websites when they launch. Veskon says it reads robots.txt and then the home page, nothing else. Block it with User-agent: VeskonBot. Its robots.txt token is VeskonBot.
Seen VeskonBot/1.0 in your logs?
Mozilla/5.0 (compatible; VeskonBot/1.0; +https://veskon.com/bot)The example string from Veskon's documentation. Version numbers change; the token VeskonBot stays.
- What it is
- A special-purpose crawler run by Veskon.
- Honors robots.txt
- YesYes, per Veskon.
- Real or fake?
- No official checkThe user agent is only a claim, and Veskon publishes no IP list or DNS check we could find.
- If you block it
- Your site is not read for the Veskon directory, so it is not listed there.
Facts
- Operator
- Veskon
- Category
- Special-purpose crawler
- robots.txt token
VeskonBot
- Honors robots.txt?
- Yes, per Veskon. Veskon says it reads robots.txt before every visit and shows User-agent: VeskonBot with Disallow: / as the opt-out. It also accepts an email with your domain, and says it honors a Retry-After header.
- User-agent example
Mozilla/5.0 (compatible; VeskonBot/1.0; +https://veskon.com/bot)
- Official source
- Veskon: VeskonBot
- Compared with the source
What it is used for
Per Veskon, when it learns that a new site has appeared, the crawler reads the public home page (title, description, icon) for the directory, with an occasional recheck of sites already listed. It requests /robots.txt and then the home page, following redirects, and does no deep crawling, forms or logins.
Not the crawler behind a search index. What blocking it changes is specific to its tool, so read the next section.
What happens if you block it
Your site is not read for the Veskon directory, so it is not listed there. Veskon says that after refusals (403, 429 or 503) it waits at least six hours, then one and three days, and stops after three tries.
Veskon says requests come from the server that hosts veskon.com, but names no address, IP list or reverse-DNS method, so the user agent alone cannot show that a request is genuine.
Is it really VeskonBot?
Anyone can send VeskonBot as a user agent, and Veskon publishes no IP list or reverse-DNS method that we could find, so a log line cannot prove a request is real. Check whether it fetched /robots.txt and whether the address belongs to the operator's network.
- We did not find an IP list or a reverse-DNS method in the official source we compared on 2026-11-09, so the user agent alone cannot show that a request is genuine. Check the operator's page for updates.
- Paste any user agent from your logs into the user-agent lookup, or follow the scripts in Fake Googlebots and PHP scanners.
How to allow or block VeskonBot
Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.
User-agent: VeskonBot Allow: /
User-agent: VeskonBot Disallow: /
Block VeskonBot at the server
robots.txt asks; a server rule refuses. These answer 403 to any request whose user agent contains veskonbot (case-insensitive). They stop only bots that name themselves honestly, so keep the robots.txt group as well.
# server { ... }
if ($http_user_agent ~* "VeskonBot") {
return 403;
}RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} VeskonBot [NC]
RewriteRule .* - [F,L]Step by step, with a test command: Block AI bots in nginx by user agent · Block AI bots in Apache with .htaccess · Block AI crawlers on Cloudflare · Block AI bots on Vercel
Does your site allow VeskonBot today? The checker evaluates your robots.txt for this and every other bot.Check my site
What we see on this site
No request identifying as VeskonBot has been recorded in the last 30 days, so there is nothing to show yet. We never fill this in with estimates.
Counts come from this site's own server; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.
Questions about VeskonBot
What is VeskonBot?
Veskon's crawler that reads the home page of a newly launched site for its directory. Per Veskon, when it learns that a new site has appeared, the crawler reads the public home page (title, description, icon) for the directory, with an occasional recheck of sites already listed. It requests /robots.txt and then the home page, following redirects, and does no deep crawling, forms or logins.
Is VeskonBot safe and legitimate?
The real VeskonBot is a special-purpose crawler run by Veskon. A user-agent string is only a claim, though, so anyone can send it. We did not find an IP list or reverse-DNS method in the official source we compared on 2026-11-09, so the user agent alone cannot prove a request is real.
Does VeskonBot obey robots.txt?
Yes, per Veskon. Veskon says it reads robots.txt before every visit and shows User-agent: VeskonBot with Disallow: / as the opt-out. It also accepts an email with your domain, and says it honors a Retry-After header.
How do I block VeskonBot?
Add a group to the robots.txt at the root of your domain: User-agent: VeskonBot followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.
Will blocking VeskonBot hurt my Google rankings or AI visibility?
This is not the crawler behind a search index, so blocking it is not a ranking decision. Your site is not read for the Veskon directory, so it is not listed there. Veskon says that after refusals (403, 429 or 503) it waits at least six hours, then one and three days, and stops after three tries.
What does "Mozilla/5.0 (compatible; VeskonBot/1.0; +https://veskon.com/bot)" mean in my logs?
It is the user-agent string in Veskon's documentation for VeskonBot, a special-purpose crawler run by Veskon. The part that robots.txt rules match is the token VeskonBot. The string is only a claim, because anyone can send it; the section "Is it really VeskonBot?" above shows how to check a request.
Related bots
Other Special-purpose crawlers
- GoogleOther GoogleGoogle's generic crawler that product teams can use for their own purposes.
- Google-InspectionTool GoogleThe Google fetcher behind Search testing tools such as the Rich Result Test and URL Inspection.
- archive.org_bot Internet ArchiveReported to be the crawler the Internet Archive uses for Wayback Machine and Archive-It captures.
- WebMCPIndexBot WebMCP ShieldA survey crawler that measures how widely websites adopt WebMCP.
All Special-Purpose Crawlers · Bot directory · Which bots to allow or block · robots.txt generator · See a page as a bot