How do I get my company recommended by Claude?
To get recommended by Claude, let Anthropic's search and user crawlers (Claude-SearchBot and Claude-User) read your site, then publish pages that answer real customer questions in their first lines with facts and sources. Claude searches the web and cites the pages it uses, so a clear, consistent and readable page is what it can quote.
Facts
- Claude gained web search on March 20, 2025, with direct citations to the sources it uses; since May 27, 2025 it is available globally on all Claude plans. (Claude: Claude can now search the web)
- Anthropic states that blocking Claude-SearchBot prevents its system from indexing your content and may reduce your visibility in user search results. (Anthropic: Does Anthropic crawl data from the web?)
- Anthropic states that blocking Claude-User prevents Claude from retrieving your content in response to a user query. (Anthropic: Does Anthropic crawl data from the web?)
- ClaudeBot collects web content that may be used for training; blocking it excludes the site's future content from training datasets. (Anthropic: Does Anthropic crawl data from the web?)
- In the GEO study (KDD 2024), optimisation methods raised a source's visibility in generative engine answers by up to 40%. (Aggarwal et al., GEO: Generative Engine Optimization (KDD 2024))
Which Anthropic crawlers matter for being recommended?
Claude-SearchBot and Claude-User are the two that decide whether Claude can find and read your pages when someone asks; ClaudeBot only concerns training.
| Crawler | What it does | If you block it |
|---|---|---|
| Claude-SearchBot | Indexes pages to improve Claude's search results | Your pages may be less visible in Claude's answers |
| Claude-User | Fetches a page when a user's question needs it | Claude cannot read your page for that user |
| ClaudeBot | Collects content that may be used for training | Future content is excluded from training |
What kind of page does Claude cite?
Claude cites pages that answer the question directly and can be checked: the answer in the first lines, each claim with a number, a date and a source, and the same facts on every page about you.
Can I block training but still be recommended?
Yes. Anthropic lists the crawlers separately, so you can disallow ClaudeBot and keep Claude-SearchBot and Claude-User allowed in robots.txt.
How does easyIndex help with Claude?
easyIndex runs inside Claude Code over MCP: it gives the agent each page to write, audits it, checks it on the live site, confirms robots.txt admits AI crawlers and shows visitors who arrive from claude.ai.
Step by step
- Check robots.txt. Make sure Claude-SearchBot and Claude-User are not disallowed, in robots.txt or at your firewall.
- List the questions. Write down the questions customers ask before choosing a company like yours.
- Write one page per question. Put the question in the heading and a 40 to 70 word answer right below it.
- Add sourced facts. Back every claim with a number, a date and a link to the source.
- Publish and confirm. Load each page live as a crawler would and confirm the text is in the HTML, not only drawn by JavaScript.
- Measure. Track visits referred by claude.ai and reads by Anthropic's crawlers, and update the pages that fall behind.
Common mistakes
- Blocking every Anthropic crawler with one rule when only training was the concern.
- Leaving a firewall or bot-protection setting that challenges Claude-User, so the page never loads for it.
- Rendering the answer only in client-side JavaScript, so a crawler reads an empty page.
- Stating prices or terms differently across pages, which gives Claude conflicting facts.
How easyIndex solves it
Your coding agent builds the pages over MCP; easyIndex audits each one, checks it live, verifies with run_audit that robots.txt admits AI crawlers, and measures visitors from Claude and AI crawler reads, for US$ 30 per website a month with a 7-day free trial.
Frequently asked questions
Can I pay Anthropic to have Claude recommend me?
No. Anthropic sells no placement in Claude's answers; what you control is being readable, clear and consistent.
Does blocking ClaudeBot stop Claude from recommending me?
ClaudeBot is the training crawler; search and user fetches go through Claude-SearchBot and Claude-User, which are listed separately.
Do I need an llms.txt file for Claude?
It is optional. Readable pages that crawlers can fetch matter more; an llms.txt can point to the key ones.
How do I see visits from Claude?
Look for visits referred by claude.ai in your analytics; easyIndex reports them per page.
Continue reading
- How does easyIndex work, what do I need, and how long until results?
- How much does easyIndex cost?
- Which AI crawlers exist and how do I allow them in robots.txt?
- How do I write a page that AI assistants cite?
- Does llms.txt work?
- How do I measure visitors who come from ChatGPT and other AI assistants?
Last verified on .