Claude-User
Anthropic fetcher, purpose: user_fetch.
The Claude-User record on Rattlesnakes By Mail is the full published file on Claude-User, a fetcher from Anthropic. Each fact on the Claude-User record is a dated claim with a verbatim quote from Anthropic, a source URL, a verification method and a confidence. Sections run in a fixed order: Identity, Claims, Observations, Changes, Questions, Notes.
Identity
- vendor
- Anthropic
- kind
- fetcher
- purpose
- user_fetch
- ua_token
Claude-User- robots_token
Claude-User- ip_list_url
- https://claude.com/crawling/bots.json
- docs_url
- https://support.claude.com/en/articles/8896518-does-anthropic-crawl-content-from-the-web-and-how-can-site-owners-block-the-crawler
- status
- active
Retrieves a page when a Claude user directs Claude to access that URL.
Claims
| Field | Value | Method | Confidence |
|---|---|---|---|
| cites_sources | not_documented | vendor_doc | n/a |
| honours_crawl_delay | yes | vendor_doc | medium |
| publishes_ip_list | yes | vendor_doc | high |
| purpose_documented | user_fetch | vendor_doc | high |
| reads_llms_txt | not_documented | vendor_doc | n/a |
| respects_robots_txt | yes | vendor_doc | medium |
| separate_search_and_training_tokens | not_documented | vendor_doc | medium |
| user_agent_string_full | not_documented | vendor_doc | n/a |
| user_fetch_exception_documented | no | vendor_doc | high |
| verifiable_by_rdns | not_documented | vendor_doc | n/a |
Observations
- requests, last 30 days
- 19
- verified requests, last 30 days
- 17
- verified share, last 30 days
- 89%
- daily rows recorded
- 5
Changes
| Date | Claim | Kind | Old value | New value |
|---|---|---|---|---|
| 2026-09-13 | respects_robots_txt | new | yes | |
| 2026-09-13 | user_fetch_exception_documented | new | no | |
| 2026-09-13 | honours_crawl_delay | new | yes | |
| 2026-09-13 | publishes_ip_list | new | yes | |
| 2026-09-13 | verifiable_by_rdns | new | not_documented | |
| 2026-09-13 | purpose_documented | new | user_fetch | |
| 2026-09-13 | separate_search_and_training_tokens | new | not_documented | |
| 2026-09-13 | cites_sources | new | not_documented | |
| 2026-09-13 | reads_llms_txt | new | not_documented | |
| 2026-09-13 | user_agent_string_full | new | not_documented |
Notes
No published notes for this entity yet.
Compare with
- Claude-User vs Claude-SearchBot
- Claude-User vs ClaudeBot
- Claude-User vs Applebot
- Claude-User vs Applebot-Extended
- Claude-User vs Google-Extended
- Claude-User vs GoogleOther
- Claude-User vs Googlebot
- Claude-User vs Bingbot
- Claude-User vs ChatGPT-User
- Claude-User vs GPTBot
- Claude-User vs OAI-AdsBot
- Claude-User vs OAI-SearchBot
- Claude-User vs Perplexity-User
- Claude-User vs PerplexityBot
Every claimed field for Claude-User is documented at /fields.
Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.