TidyToolsAI Crawler Index · data as of · updated daily

AI Crawler Index · category

Do entertainment websites block AI crawlers?

As of 2026-11-16, 19.6% of the 332 entertainment websites whose robots.txt we could read block GPTBot, 18.7% block ClaudeBot and 4.2% block PerplexityBot (all sites: 15.4%, 14.7%, 8.2%). 30 of 370 publish an llms.txt file.

Block rate by crawler: entertainment vs all sites

CrawlerOperatorEntertainmentAll sites
BytespiderByteDance20.5%16.2%
CCBotCommon Crawl20.2%16.4%
GPTBotOpenAI19.6%15.4%
Meta-ExternalAgentMeta19%13.6%
cohere-aiCohere19%12.7%
ClaudeBotAnthropic18.7%14.7%
Applebot-ExtendedApple18.4%13.4%
AmazonbotAmazon17.5%13.2%
Google-ExtendedGoogle16.6%13.2%
Google-CloudVertexBotGoogle13.9%8.8%
MistralAI-TrainingMistral13.9%7.1%
ChatGPT-UserOpenAI4.5%7.4%
meta-webindexerMeta4.5%5.1%
PerplexityBotPerplexity4.2%8.2%
DuckAssistBotDuckDuckGo3.9%5.9%
Perplexity-UserPerplexity3.6%6.1%
meta-externalfetcherMeta3.6%6.5%
MistralAI-UserMistral3.6%5.7%
Claude-UserAnthropic3.3%5.9%
ApplebotApple3.3%3.2%
OAI-SearchBotOpenAI3%5.8%
Claude-SearchBotAnthropic2.7%5.7%
Amzn-SearchBotAmazon2.7%4.4%
Amzn-UserAmazon2.4%4.4%
MistralAI-IndexMistral2.4%3.6%
OAI-AdsBotOpenAI1.8%3%
Google-GeminiNotebookGoogle1.8%3.3%
meta-externaladsMeta1.8%2.9%
Google-AgentGoogle1.5%3.6%

Top 150 of 370 entertainment sites in the index

✕ blocked · ◐ partially blocked (some paths) · ✓ allowed · ? robots.txt unreadable. "#" is the position in our popularity-ordered sample.

#SitePolicyGPTBotOAI-SearchChatGPT-UserClaudeBotClaude-SearchPerplexityGoogle-Ext.CCBotllms.txt
5youtube.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
19netflix.comBlocks some AI searchpartialpartialpartialpartialpartialpartialpartialblocked–
29roblox.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
31spotify.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
38vimeo.comBlocks training onlypartialallowedallowedpartialallowedallowedpartialblocked–
52amazonvideo.comBlocks some AI searchallowedallowedblockedallowedallowedblockedallowedblocked–
53epicgames.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
81soundcloud.comOpenpartialpartialpartialpartialpartialpartialpartialpartial–
97twitch.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
128steampowered.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
146bilibili.comOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
152ea.comBlocks training onlyallowedallowedallowedallowedallowedallowedallowedallowedyes
186dailymotion.comBlocks training onlyallowedallowedallowedallowedallowedallowedallowedallowedyes
187steamcommunity.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
191supercell.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
217ivi.ruOpenallowedallowedallowedallowedallowedallowedallowedallowed–
265playstation.comOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
277nintendo.comBlocks training onlyblockedallowedallowedblockedallowedallowedblockedblocked–
295primevideo.comBlocks some AI searchallowedallowedblockedallowedallowedblockedallowedblocked–
315kick.comBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
325itch.ioOpenallowedallowedallowedallowedallowedallowedallowedallowed–
334imgur.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
347warnerbros.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
349curseforge.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
356ted.comBlocks training onlyblockedpartialpartialblockedpartialpartialblockedblocked–
360disneyplus.comBlocks some AI searchpartialpartialpartialpartialpartialpartialpartialpartial–
362xbox.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
389chess.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
422youku.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
436nexusmods.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
438playrix.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
441pixiv.netBlocks training onlyblockedallowedallowedblockedallowedallowedblockedblocked–
443ubi.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
446flightradar24.comBlocks training onlyblockedallowedallowedallowedallowedallowedallowedblockedyes
448poki.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
499crazygames.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
501tabelog.comBlocks training onlyblockedallowedallowedallowedallowedallowedblockedallowed–
506giphy.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
507aparat.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
508riotgames.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
517cookpad.comBlocks some AI searchblockedallowedblockedblockedallowedblockedblockedblocked–
527nexon.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
542tbs.co.jpNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
566lichess.orgOpenallowedallowedallowedallowedallowedallowedallowedallowed–
570pandora.comBlocks training onlyblockedallowedallowedblockedallowedallowedblockedblocked–
579rutube.ruOpenallowedallowedallowedallowedallowedallowedallowedallowed–
614battle.netUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
626netkeiba.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
629playhop.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
633lookmovie2.toOpenallowedallowedallowedallowedallowedallowedallowedallowed–
657aternos.orgOpenallowedallowedallowedallowedallowedallowedallowedallowed–
663cardgames.ioOpenallowedallowedallowedallowedallowedallowedallowedallowed–
674mangabuff.ruOpenallowedallowedallowedallowedallowedallowedallowedallowed–
679filmweb.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
685zedge.netBlocks training onlyblockedallowedallowedallowedallowedallowedallowedallowed–
703gamewith.jpOpenallowedallowedallowedallowedallowedallowedallowedallowed–
707myinstants.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
739hanime1.meOpenallowedallowedallowedallowedallowedallowedallowedallowed–
741musicdel.irOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
758myreadingmanga.infoBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
779plex.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
781nustargame.comOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
782kingbokep.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
786playfabapi.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
798skipthegames.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
806arionplay.comOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
823moe.videoOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
835yasyadong02.tvNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
836mangaraw.acOpenallowedallowedallowedallowedallowedallowedallowedallowed–
838playinboss.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
840kolkataff.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
841filmyfly.soyNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
887pluto.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
888gamebanana.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
925hulu.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
935iqiyi.comBlocks some AI searchblockedallowedblockedblockedallowedblockedallowedallowed–
952videoxx.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
10415movierulz.kitchenOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1044mp4moviez.ripOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1045moviesdatamil.meUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
1046moviezwap.taxiBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
1047filmywap.technologyUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
1048filmyzilla63.comBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
1049filmyzilla56.comBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
1050filmyzilla62.comBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
1092vkvideo.ruOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1202zeasn.tvNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
1213gameanalytics.comBlocks training onlyallowedallowedallowedallowedallowedallowedallowedblockedyes
1218samba.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1331jwplayer.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1335rockstargames.comBlocks training onlyblockedallowedallowedblockedallowedallowedallowedblocked–
1358weplayapp.comOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
1371like.videoOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1418gamespot.comBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
1580medal.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1587v-videoapp.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
1647bigolive.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1681nicovideo.jpBlocks training onlyblockedallowedallowedallowedallowedallowedallowedallowed–
1701myanimelist.netBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
1753videolan.orgOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1777ispot.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1835likeevideo.ruOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2048centurygame.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2076tcgplayer.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2090likee.videoOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2095kingsgroupgames.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
2229vkplay.ruOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2239jennymovies.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2242gameloft.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2276okko.tvUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2309boardgamegeek.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2316farlightgames.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowedyes
2350playfamily.ruUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2381movie-box.coOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2418lectormangass.netBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
2426movieswood.cloudOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2430filmyzilla52.comBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
2450boomplaymusic.comBlocks training onlyallowedallowedallowedblockedallowedallowedallowedblocked–
2461my.gamesOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2627ivideon.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2670ustream.tvOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2796arte.tvBlocks all AI searchblockedblockedblockedblockedblockedblockedblockedblocked–
2816pscp.tvBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
2901gamestop.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2952gameinstaller.ruOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2982videotron.caOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3034gamer.com.twOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3100stadtgame.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
3110gamerant.comBlocks training onlyblockedallowedallowedblockedallowedallowedblockedblocked–
3118filmaffinity.comUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
3122adplay.ruNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
3304pcgamer.comBlocks some AI searchallowedallowedallowedallowedallowedallowedallowedallowed–
3309bhphotovideo.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3316fubo.tvNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
3320game8.coBlocks training onlyblockedallowedallowedallowedallowedallowedblockedallowed–
3399movieweb.comBlocks training onlyblockedallowedallowedblockedallowedallowedblockedblocked–
3411mangadex.orgOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3429playtika.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3443playground.ruOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3519devline.tvNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
3524prodigygame.comOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
35469gag.comOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
3553ahagamecenter.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3591nimo.tvBlocks some AI searchallowedallowedallowedallowedallowedallowedallowedallowed–
3634raiplay.itBlocks some AI searchblockedallowedblockedblockedallowedblockedblockedblocked–
3708plaync.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
3724videoamp.comOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3733playdigo.comOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
3748microsoftcasualgames.comNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
3751gamesradar.comBlocks some AI searchallowedallowedallowedallowedallowedallowedallowedallowed–

Sorted by popularity. Every site has its own page: all 10,000 sites (A-Z lists), or download the CSV.

FAQ

Do entertainment websites block AI crawlers?
As of 2026-11-16, 19.6% of the 332 entertainment websites whose robots.txt we could read block GPTBot, 18.7% block ClaudeBot and 4.2% block PerplexityBot (all sites: 15.4%, 14.7%, 8.2%). 30 of 370 publish an llms.txt file.
Which entertainment websites block GPTBot?
nintendo.com, kick.com, ted.com, pixiv.net, flightradar24.com, tabelog.com, cookpad.com, pandora.com, zedge.net, myreadingmanga.info, and more (full list on this page).

Other categories