BeaconBot (Ascendant Finance): what it is and how to allow or block it
Updated · checked against the operator's documentation on
BeaconBot is a crawler of Ascendant Finance that notices newly launched websites through Certificate Transparency logs, newly registered domain lists and public DNS. Ascendant Finance says it visits a domain at most once every seven days. Block it with User-agent: BeaconBot. Its robots.txt token is BeaconBot.
Seen BeaconBot/1.0 in your logs?
BeaconBot/1.0The example string from Ascendant Finance's documentation. Version numbers change; the token BeaconBot stays.
- What it is
- A special-purpose crawler run by Ascendant Finance.
- Honors robots.txt
- YesYes, per Ascendant Finance.
- Real or fake?
- No official checkThe user agent is only a claim, and Ascendant Finance publishes no IP list or DNS check we could find.
- If you block it
- Ascendant Finance says any one opt-out stops all BeaconBot activity for your domain permanently, including passive lookups.
Facts
- Operator
- Ascendant Finance
- Category
- Special-purpose crawler
- robots.txt token
BeaconBot
- Honors robots.txt?
- Yes, per Ascendant Finance. Ascendant Finance says it fetches robots.txt first and honors it. It accepts three opt-outs: User-agent: BeaconBot with Disallow: /, the line Beacon-Opt-Out: true in /.well-known/security.txt, or an email with the domain name.
- User-agent example
BeaconBot/1.0
- Official source
- Ascendant Finance: BeaconBot
- Compared with the source
What it is used for
Per Ascendant Finance, it notices newly launched or relaunched sites from public signals and records what is publicly observable about them. For a domain it has not been invited to watch it makes at most one visit every seven days: robots.txt, /.well-known/security.txt, and one unauthenticated GET of / over HTTP and one over HTTPS.
Not the crawler behind a search index. What blocking it changes is specific to its tool, so read the next section.
What happens if you block it
Ascendant Finance says any one opt-out stops all BeaconBot activity for your domain permanently, including passive lookups. Nothing about your search visibility changes.
Ascendant Finance's page publishes no IP list or reverse-DNS method, so the user agent alone cannot show that a request is genuine.
Is it really BeaconBot?
Anyone can send BeaconBot as a user agent, and Ascendant Finance publishes no IP list or reverse-DNS method that we could find, so a log line cannot prove a request is real. Check whether it fetched /robots.txt and whether the address belongs to the operator's network.
- We did not find an IP list or a reverse-DNS method in the official source we compared on 2026-11-09, so the user agent alone cannot show that a request is genuine. Check the operator's page for updates.
- Paste any user agent from your logs into the user-agent lookup, or follow the scripts in Fake Googlebots and PHP scanners.
How to allow or block BeaconBot
Add one of these groups to the robots.txt at the root of your domain. A group that names the bot overrides a general User-agent: * group.
User-agent: BeaconBot Allow: /
User-agent: BeaconBot Disallow: /
Block BeaconBot at the server
robots.txt asks; a server rule refuses. These answer 403 to any request whose user agent contains beaconbot (case-insensitive). They stop only bots that name themselves honestly, so keep the robots.txt group as well.
# server { ... }
if ($http_user_agent ~* "BeaconBot") {
return 403;
}RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} BeaconBot [NC]
RewriteRule .* - [F,L]Step by step, with a test command: Block AI bots in nginx by user agent · Block AI bots in Apache with .htaccess · Block AI crawlers on Cloudflare · Block AI bots on Vercel
Does your site allow BeaconBot today? The checker evaluates your robots.txt for this and every other bot.Check my site
What we see on this site
No request identifying as BeaconBot has been recorded in the last 30 days, so there is nothing to show yet. We never fill this in with estimates.
Counts come from this site's own server; they hold no IP addresses or URLs, and a user agent is only a claim. See the bot traffic data and the methodology.
Questions about BeaconBot
What is BeaconBot?
Ascendant Finance's crawler that records what is publicly observable about newly launched websites. Per Ascendant Finance, it notices newly launched or relaunched sites from public signals and records what is publicly observable about them. For a domain it has not been invited to watch it makes at most one visit every seven days: robots.txt, /.well-known/security.txt, and one unauthenticated GET of / over HTTP and one over HTTPS.
Is BeaconBot safe and legitimate?
The real BeaconBot is a special-purpose crawler run by Ascendant Finance. A user-agent string is only a claim, though, so anyone can send it. We did not find an IP list or reverse-DNS method in the official source we compared on 2026-11-09, so the user agent alone cannot prove a request is real.
Does BeaconBot obey robots.txt?
Yes, per Ascendant Finance. Ascendant Finance says it fetches robots.txt first and honors it. It accepts three opt-outs: User-agent: BeaconBot with Disallow: /, the line Beacon-Opt-Out: true in /.well-known/security.txt, or an email with the domain name.
How do I block BeaconBot?
Add a group to the robots.txt at the root of your domain: User-agent: BeaconBot followed by Disallow: /. A group that names the bot overrides a general User-agent: * group.
Will blocking BeaconBot hurt my Google rankings or AI visibility?
This is not the crawler behind a search index, so blocking it is not a ranking decision. Ascendant Finance says any one opt-out stops all BeaconBot activity for your domain permanently, including passive lookups. Nothing about your search visibility changes.
What does "BeaconBot/1.0" mean in my logs?
It is the user-agent string in Ascendant Finance's documentation for BeaconBot, a special-purpose crawler run by Ascendant Finance. The part that robots.txt rules match is the token BeaconBot. The string is only a claim, because anyone can send it; the section "Is it really BeaconBot?" above shows how to check a request.
Related bots
More from Ascendant Finance
Other Special-purpose crawlers
- GoogleOther GoogleGoogle's generic crawler that product teams can use for their own purposes.
- Google-InspectionTool GoogleThe Google fetcher behind Search testing tools such as the Rich Result Test and URL Inspection.
- archive.org_bot Internet ArchiveReported to be the crawler the Internet Archive uses for Wayback Machine and Archive-It captures.
- WebMCPIndexBot WebMCP ShieldA survey crawler that measures how widely websites adopt WebMCP.
All Special-Purpose Crawlers · Bot directory · Bots from Ascendant Finance · Which bots to allow or block · robots.txt generator · See a page as a bot