ByteDance · training
Is Bytespider blocked on your site?
Bytespider is ByteDance’s training token for ByteDance’s assistants, and whether it reaches you is decided by one line in your robots.txt. A training crawler with a reputation for crawling aggressively. Blocking it is a common choice and costs little in Western answer engines.
- Secondary crawler weight
- Bytespider robots.txt token
Body copy pending
Phase 2 adds the parts that rank: the exact allow and block snippets for Bytespider, what ByteDance publishes about it, the CDN and plugin defaults that block it without telling you, and how it differs from the vendor’s other tokens.
This page is noindex until that lands, and it is not in the sitemap.