Google-Extended

Google policy token, purpose: training.

The Google-Extended record on Rattlesnakes By Mail is the full published file on Google-Extended, a policy_token from Google. Each fact on the Google-Extended record is a dated claim with a verbatim quote from Google, a source URL, a verification method and a confidence. Sections run in a fixed order: Identity, Claims, Observations, Changes, Questions, Notes.

Identity

vendor: Google
kind: policy_token
purpose: training
ua_token: (none, see notes)
robots_token: Google-Extended
ip_list_url: (none published)
docs_url: https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
status: active

Robots.txt token that controls whether content already crawled by Googlebot may be used to train Gemini models and ground Gemini features. Vendor documentation states Google-Extended is not a separate crawler and uses no distinct user agent string: it cannot be observed directly in request logs, only declared for in robots.txt.

Claims

Field	Value	Method	Confidence
honours_crawl_delay	`n/a`	vendor_doc	n/a
publishes_ip_list	`no`	vendor_doc	high
purpose_documented	`policy_only`	vendor_doc	high
respects_robots_txt	`n/a`	vendor_doc	high
robots_token_differs_from_ua	`yes`	vendor_doc	high
separate_search_and_training_tokens	`yes`	vendor_doc	high
verifiable_by_rdns	`n/a`	vendor_doc	n/a
what_it_controls	`Gemini model training and grounding, not Search inclusion`	vendor_doc	high

Observations

requests, last 30 days: 0
verified requests, last 30 days: 0
verified share, last 30 days: no data yet
daily rows recorded: 0

Changes

Date	Claim	Kind	New value
2026-09-13	respects_robots_txt	new	n/a
2026-09-13	honours_crawl_delay	new	n/a
2026-09-13	publishes_ip_list	new	no
2026-09-13	verifiable_by_rdns	new	n/a
2026-09-13	purpose_documented	new	policy_only
2026-09-13	separate_search_and_training_tokens	new	yes
2026-09-13	what_it_controls	new	Gemini model training and grounding, not Search inclusion
2026-09-13	robots_token_differs_from_ua	new	yes

Notes

No published notes for this entity yet.

Compare with

Every claimed field for Google-Extended is documented at /fields.

Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.