# Googlebot

Google crawler, purpose: search.

The Googlebot record on Rattlesnakes By Mail is the full published file on Googlebot, a crawler from Google. Each fact on the Googlebot record is a dated claim with a verbatim quote from Google, a source URL, a verification method and a confidence. Sections run in a fixed order: Identity, Claims, Observations, Changes, Questions, Notes.

## Identity

vendor: Google
kind: crawler
purpose: search
ua_token: Googlebot
robots_token: Googlebot
ip_list_url: https://developers.google.com/static/crawling/ipranges/common-crawlers.json
docs_url: https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
status: active

Common crawler for Google Search, Discover, Images, Video and News.

## Claims

| Field | Value | Method | Confidence |
| --- | --- | --- | --- |
| observed_verified_request_ratio_census | 0.991 | observed_here | high |
| cites_sources | yes | vendor_doc | high |
| honours_crawl_delay | no | vendor_doc | medium |
| publishes_ip_list | yes | vendor_doc | high |
| purpose_documented | search | vendor_doc | high |
| reads_llms_txt | no | vendor_doc | high |
| respects_robots_txt | yes | vendor_doc | high |
| separate_search_and_training_tokens | yes | vendor_doc | high |
| user_agent_string_full | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) | vendor_doc | high |
| verifiable_by_rdns | yes | vendor_doc | high |

## Observations

requests, last 30 days: 1063
verified requests, last 30 days: 367
verified share, last 30 days: 35%
daily rows recorded: 9

## Changes

| Date | Claim | Kind | Old value | New value |
| --- | --- | --- | --- | --- |
| 2026-09-17 | observed_verified_request_ratio_census | new |  | 0.991 |
| 2026-09-14 | reads_llms_txt | new |  | no |
| 2026-09-13 | respects_robots_txt | new |  | yes |
| 2026-09-13 | honours_crawl_delay | new |  | no |
| 2026-09-13 | publishes_ip_list | new |  | yes |
| 2026-09-13 | verifiable_by_rdns | new |  | yes |
| 2026-09-13 | purpose_documented | new |  | search |
| 2026-09-13 | separate_search_and_training_tokens | new |  | yes |
| 2026-09-13 | cites_sources | new |  | yes |
| 2026-09-13 | user_agent_string_full | new |  | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) |

## Notes

No published notes for this entity yet.

## Compare with

- Googlebot vs Claude-SearchBot
- Googlebot vs Claude-User
- Googlebot vs ClaudeBot
- Googlebot vs Applebot
- Googlebot vs Applebot-Extended
- Googlebot vs Google-Extended
- Googlebot vs GoogleOther
- Googlebot vs Bingbot
- Googlebot vs ChatGPT-User
- Googlebot vs GPTBot
- Googlebot vs OAI-AdsBot
- Googlebot vs OAI-SearchBot
- Googlebot vs Perplexity-User
- Googlebot vs PerplexityBot

Every claimed field for Googlebot is documented at /fields.

Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.