Does Claude use Brave Search? What a site owner can and cannot check
Anthropic's Trust Center lists Brave Search as a web search subprocessor for all products (we checked on 25 October 2026), but Anthropic's help page on web search does not name a provider, and nothing public says how Claude combines Brave results with its own bots. Brave says its crawler uses no user agent of its own and will not crawl a page that Googlebot cannot, so there is no Brave bot to allow in robots.txt. What you can check is whether Googlebot can fetch your pages, whether they appear on search.brave.com, and what Anthropic's bots do on your server.
By the Crawlerpeek editorial team · Updated · How we check
Short answer: Anthropic lists Brave Search, but its help page names no provider
On 25 October 2026 we searched Anthropic's subprocessor list in a browser for “Brave”. It has one entry: “Brave Search”, purpose “Web Search”, products “All products”, location United States. That is all it says. It does not say how Claude picks, ranks or combines results. Anthropic's help article What is web search? describes the feature without naming a search provider, so “Anthropic documents Brave as its search engine” is more than the sources support.
Others have looked closer. In March 2025, Simon Willison and TechCrunch reported that Brave Search had appeared on the list. Willison also reported that the ten citations Claude returned for one query matched Brave's results for the same query, and that Claude's search tool definition carried a parameter set called “BraveSearchParams”. TechCrunch noted that Anthropic had not formally announced the change. These are reports, not Anthropic documentation.
What is confirmed and what is not
| Statement | Status | Source |
|---|---|---|
| Anthropic's subprocessor list names Brave Search for web search | Anthropic's own page, checked 25 Oct 2026 | Anthropic Trust Center |
| Anthropic's help page names the provider of Claude's web search | No: the page names none | Anthropic help article |
| Claude's web search returns Brave results | Reported by Simon Willison and TechCrunch in March 2025; not documented by Anthropic | Willison |
| Claude's citations overlap strongly with Brave's top results | Reported second-hand: a summary by Xponent21 cites Profound tests with 13 of 15 citations overlapping (March 2025) and 79.2 percent in a re-run of about 400 queries (June 2026). We did not read Profound's original | Xponent21 |
| How Claude-SearchBot, Claude-User and Brave results combine in one answer | Unknown: Anthropic does not publish it | None |
What Brave says about its crawler
Brave's help page on its crawler says the Brave Search crawler “does not advertise a differentiated user agent”, because Brave must avoid discriminating against sites that allow only Google to crawl them. It adds that if a domain or page is not crawlable by Googlebot, Brave Search's bot will not crawl it either. It also says robots.txt is not used to prevent a page from being indexed: to remove a page you use noindex, and Brave has to fetch the page again before it sees that. Brave describes part of its index as fed by opt-in users of its Web Discovery Project. Brave's Search API page says its results come from its own independent index.
- There is no Brave line to look for in your access log, because the crawler does not name itself.
- There is no Brave token to allow or block in robots.txt. Some bot directories list a “Bravebot” token; Brave's page does not confirm one, so we do not have a bot page for it.
- Brave visibility follows Googlebot access. A rule that keeps Googlebot out, or a
noindex, affects Brave as well, according to Brave.
What Anthropic's own bots did on four new sites
Anthropic runs three bots: ClaudeBot, which it describes as collecting content that may be used for training, Claude-SearchBot, which it says improves the quality of Claude's search results, and Claude-User, which opens pages when a person asks Claude something. We counted their requests on four small sites we run, between 19 and 25 October 2026. All four domains were new.
| Bot | Requests | From Anthropic's published IP ranges | Notes |
|---|---|---|---|
| ClaudeBot | 758 | 719 | 29 came from outside the ranges, 7 were our own tool and 3 were test or hosting traffic. Seen on all four sites, with 147 robots.txt requests |
| Claude-SearchBot | 0 | 0 | Not seen in the window |
| Claude-User | 3 | 3 | One day (19 October), one site |
For comparison, OAI-SearchBot made 2,360 requests in the same logs. The sample is four sites, seven days and new domains, so it says little about Claude in general. It does show one thing: on new sites, Anthropic's training crawler turned up within a week and its search crawler did not, so you should not assume that an Anthropic bot has read your new pages. The study behind the “from the published ranges” column, including how many requests borrowed a bot's name, is on the fake bots page.
Five checks you can run today
- Ask your server what it returns to Googlebot's name:
curl -A "Googlebot" -I https://example.com/your-page. You want200and noX-Robots-Tag: noindex. This is only a header test. It sends the name from your machine, so it does not prove that Google can reach you; the URL Inspection tool in Google Search Console answers that. - Open your robots.txt and make sure no group disallows Googlebot for the page. The checker evaluates the file for every bot we track, and robots.txt basics explains how groups are chosen.
- Look for a noindex in the HTML:
curl -s https://example.com/your-page | grep -i 'name="robots"'. Nothing printed, or a value withoutnoindex, is what you want. - Search for your domain on search.brave.com by hand, for example
site:example.com. Pages that appear are in Brave's index. A page that does not appear is not proof of a problem, because new pages take time. Run it once; do not script Brave's search. - Ask Claude, with web search switched on, a question that only your page answers, and read the sources it cites. That is one observation, not a measurement.
To see Anthropic's bots on your own server, search the log and compare the address with the operator's list. zgrep -hE 'ClaudeBot|Claude-SearchBot|Claude-User' /var/log/nginx/access.log* | awk '{print $1, $7, $9}' prints address, path and status. Anthropic publishes one list of ranges for all its bots at claude.com/crawling/bots.json, so it cannot tell Claude-User from ClaudeBot. The script in the 48-hour log guide checks addresses against it, and the user-agent lookup tells you which bot a logged string names.
If a check fails
| What you find | What to do |
|---|---|
noindex in a header or in the HTML | Remove it on pages that should be found. Brave has to fetch the page again to see the change. |
| robots.txt disallows Googlebot | Allow it for the pages you want found. See how to let AI assistants read your site. |
| Your server or CDN answers a bot name with 403 or a challenge page | Check the firewall and bot rules. Why Google isn't crawling your site lists the usual causes. |
| Not in Brave's results after a few weeks, but all checks pass | Brave's crawler page links a form for submitting pages. We have not tested what it accepts. |
Checked 25 October 2026
Sources: Anthropic's subprocessor list (a JavaScript page without a stable link to one entry: search it for “Brave”), Anthropic's articles What is web search? and Does Anthropic crawl data from the web?, Brave's crawler page and Search API page, and the reports by Simon Willison, TechCrunch and Xponent21. Our log counts are from 19 to 25 October 2026. These pages change, so check the originals before you rely on a detail.
Follow-up questions
Does Claude use Brave Search?
Anthropic's subprocessor list names Brave Search as a web search subprocessor for all products, as we saw on 25 October 2026. Anthropic's help page on web search names no provider, and how Claude combines Brave results with its own bots is not published. Reports from March 2025 found Claude's citations matching Brave's results for a test query.
Does Brave have a bot I can allow in robots.txt?
Not by name. Brave says its crawler does not advertise a differentiated user agent, and that if Googlebot cannot crawl a page, Brave's bot will not crawl it either. So there is nothing to allow separately. A rule that blocks Googlebot also affects Brave, according to Brave.
Does blocking ClaudeBot remove me from Claude's answers?
Anthropic describes ClaudeBot as collecting content that may be used for training; blocking it signals that future materials should be excluded from training. For Claude-SearchBot and Claude-User, Anthropic says that disabling them may reduce your visibility in search results and in user-directed web search.
How do I submit my site to Brave?
Brave's crawler help page links a form for submitting pages. We have not tested what it accepts. Before that, check that Googlebot can fetch the page and that it carries no noindex, because Brave says it follows Googlebot's access.
Is ClaudeBot the same as Claude-User?
No. ClaudeBot is Anthropic's crawler for content that may be used for training. Claude-User opens a page when a person asks Claude a question that needs a website. They appear under different names in your logs, but Anthropic publishes one IP list for all its bots.
See how your own site does.Run the checker
Keep reading
- How to let AI assistants read your site (and which bots to block)
- Do ChatGPT, Claude and Gemini obey your robots.txt? What operators document, and a test for your logs
- robots.txt explained: syntax, matching rules and where the file goes
- Fake Googlebots and PHP scanners: what hit four new sites in 48 hours
- All AI bots and robots.txt tokens