# Claim 99

OpenAI separates search and training controls into two robots.txt tokens: OAI-SearchBot for search and GPTBot for training.

A claim page on Rattlesnakes By Mail publishes one claim about one entity, here OAI-SearchBot. The claim page states the field, the value, the statement, the source URL, the verbatim evidence quote, the verification method, the confidence, the date the claim was verified, and the claim that the published claim supersedes. A claim page is permanent: the claim is never edited, and a superseded claim stays addressable at the same URL.

entity: OAI-SearchBot
field: separate_search_and_training_tokens
value: yes
statement: OpenAI separates search and training controls into two robots.txt tokens: OAI-SearchBot for search and GPTBot for training.
evidence_url: https://developers.openai.com/api/docs/bots
evidence_quote: "a webmaster can allow OAI-SearchBot in order to appear in search results while disallowing GPTBot to indicate that crawled content should not be used for training OpenAI's generative AI foundation models."
method: vendor_doc
verified_at: 2026-09-13
confidence: high
status: current
supersedes: none

## Notes

No published notes for this claim yet.

Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.