Rattlesnakes By Mail

Claim 62

Google-Extended is a robots.txt control token and does not correspond to a crawler user agent string.

A claim page on Rattlesnakes By Mail publishes one claim about one entity, here Google-Extended. The claim page states the field, the value, the statement, the source URL, the verbatim evidence quote, the verification method, the confidence, the date the claim was verified, and the claim that the published claim supersedes. A claim page is permanent: the claim is never edited, and a superseded claim stays addressable at the same URL.

entity
Google-Extended
field
robots_token_differs_from_ua
value
yes
statement
Google-Extended is a robots.txt control token and does not correspond to a crawler user agent string.
evidence_url
https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers
evidence_quote
"Google-Extended doesn't have a separate HTTP request user agent string. Crawling is done with existing Google user agent strings; the robots.txt user-agent token is used in a control capacity." source dated 2026-07-14
method
vendor_doc
verified_at
2026-09-13
confidence
high
status
current
supersedes
none

Notes

No published notes for this claim yet.

Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.