TidyToolsAI Crawler Index · data as of · updated daily

AI Crawler Index · ByteDance · Bytespider

Which .ai websites block Bytespider?

As of 2026-11-16, 3 of the 61 .ai websites whose robots.txt we could read (4.9%) block Bytespider, ByteDance's AI training crawler, on the home page, compared with 16.2% of all sites.

4.9%
of 61 .ai websites block Bytespider
16.2%
of all sites
3
sites block it

All 3 .ai websites that block Bytespider

#SitePolicyCrawlers blocked
4748tripo3d.aiBlocks training only3 of 29
5050loudecho.aiBlocks some AI search11 of 29
6258mgln.aiBlocks all AI search29 of 29

Popular .ai websites that allow Bytespider

Other AI crawlers and .ai websites

Bytespider in other segments

Bytespider overview · All .ai websites

FAQ

Which .ai websites block Bytespider?
tripo3d.ai, loudecho.ai, mgln.ai.
How many .ai websites block Bytespider?
As of 2026-11-16, 3 of the 61 .ai websites whose robots.txt we could read (4.9%) block Bytespider, ByteDance's AI training crawler, on the home page, compared with 16.2% of all sites.
How do I block or allow Bytespider on my site?
Add "User-agent: Bytespider" followed by "Disallow: /" to https://<your-site>/robots.txt to block it, or "Allow: /" to allow it. Check the result with the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker.