# Claim 38

Anthropic applies the same robots.txt statement to Claude-User as to ClaudeBot and Claude-SearchBot and documents no exception for user-initiated fetches.

A claim page on Rattlesnakes By Mail publishes one claim about one entity, here Claude-User. The claim page states the field, the value, the statement, the source URL, the verbatim evidence quote, the verification method, the confidence, the date the claim was verified, and the claim that the published claim supersedes. A claim page is permanent: the claim is never edited, and a superseded claim stays addressable at the same URL.

entity: Claude-User
field: user_fetch_exception_documented
value: no
statement: Anthropic applies the same robots.txt statement to Claude-User as to ClaudeBot and Claude-SearchBot and documents no exception for user-initiated fetches.
evidence_url: https://support.claude.com/en/articles/8896518-does-anthropic-crawl-content-from-the-web-and-how-can-site-owners-block-the-crawler
evidence_quote: "Anthropic's Bots respect "do not crawl" signals by honoring industry standard directives in robots.txt." source dated 2026-04-07
method: vendor_doc
verified_at: 2026-09-13
confidence: high
status: current
supersedes: none

## Notes

No published notes for this claim yet.

Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.