Claim 10
Applebot does not follow the robots.txt Crawl-delay directive.
A claim page on Rattlesnakes By Mail publishes one claim about one entity, here Applebot. The claim page states the field, the value, the statement, the source URL, the verbatim evidence quote, the verification method, the confidence, the date the claim was verified, and the claim that the published claim supersedes. A claim page is permanent: the claim is never edited, and a superseded claim stays addressable at the same URL.
- entity
- Applebot
- field
- honours_crawl_delay
- value
no- statement
- Applebot does not follow the robots.txt Crawl-delay directive.
- evidence_url
- https://support.apple.com/en-us/119829
- evidence_quote
- "Applebot does not follow crawl-delay. Applebot is engineered for efficiency and will adjust to minimize the impact on site owners." source dated 2026-09-04
- method
- vendor_doc
- verified_at
- 2026-09-13
- confidence
- high
- status
- current
- supersedes
- none
Notes
No published notes for this claim yet.
Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.