TidyToolsAI Crawler Index · data as of · updated daily

AI Crawler Index · country

Do websites in Poland (.pl) block AI crawlers?

As of 2026-10-02, 26.4% of the 53 websites in Poland (.pl) whose robots.txt we could read block GPTBot, 9.4% block ClaudeBot and 7.5% block PerplexityBot (all 8,366 sites: 12%, 11%, 8.3%). 5 of them (9.4%) serve an llms.txt (all sites: 15.2%).

26.4%
block GPTBot (all sites 12%)
9.4%
block ClaudeBot (all sites 11%)
9.4%
serve an llms.txt (all sites 15.2%)
53
of 59 sites with a readable robots.txt

Block rate by crawler: .pl (Poland) vs all sites

CrawlerOperator.pl (Poland)All sitesDifference
GPTBotOpenAI26.4%12%+14.4 pp
CCBotCommon Crawl20.8%12.7%+8.1 pp
BytespiderByteDance15.1%12.2%+2.9 pp
AmazonbotAmazon11.3%9.2%+2.1 pp
cohere-aiCohere11.3%9%+2.3 pp
ClaudeBotAnthropic9.4%11%-1.6 pp
Meta-ExternalAgentMeta9.4%9.5%-0.1 pp
Applebot-ExtendedApple7.5%9.6%-2.1 pp
ChatGPT-UserOpenAI7.5%7.4%+0.1 pp
Google-ExtendedGoogle7.5%9.5%-2 pp
PerplexityBotPerplexity7.5%8.3%-0.8 pp
Amzn-SearchBotAmazon5.7%4.1%+1.6 pp
Amzn-UserAmazon5.7%3.9%+1.8 pp
DuckAssistBotDuckDuckGo5.7%5.7%0 pp
meta-externalfetcherMeta5.7%6%-0.3 pp
meta-webindexerMeta5.7%4.6%+1.1 pp
OAI-SearchBotOpenAI5.7%5.7%0 pp
Perplexity-UserPerplexity5.7%5.7%0 pp
ApplebotApple3.8%3.1%+0.7 pp
Claude-SearchBotAnthropic3.8%5.4%-1.6 pp
Claude-UserAnthropic1.9%5.5%-3.6 pp
Google-AgentGoogle1.9%3.2%-1.3 pp
Google-CloudVertexBotGoogle1.9%5.2%-3.3 pp
Google-GeminiNotebookGoogle1.9%3%-1.1 pp
meta-externaladsMeta1.9%2.8%-0.9 pp
MistralAI-IndexMistral1.9%3.3%-1.4 pp
MistralAI-TrainingMistral1.9%3.2%-1.3 pp
MistralAI-UserMistral1.9%5.3%-3.4 pp
OAI-AdsBotOpenAI1.9%3%-1.1 pp

Who blocks what, by name: GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider, Applebot-Extended, OAI-SearchBot.

Policy mix

PolicySitesShare
Open3355.9%
Blocks training only1118.6%
Blocks some AI search711.9%
Unreadable610.2%
No robots.txt23.4%

Most restrictive .pl (Poland) sites

  1. uj.edu.pl 28 of 29 blocked
  2. portalsamorzadowy.pl 16 of 29 blocked
  3. rynekzdrowia.pl 16 of 29 blocked
  4. wyborcza.pl 8 of 29 blocked
  5. onet.pl 7 of 29 blocked
  6. fakt.pl 7 of 29 blocked
  7. ceneo.pl 3 of 29 blocked
  8. money.pl 3 of 29 blocked
  9. bankier.pl 3 of 29 blocked
  10. wp.pl 2 of 29 blocked
  11. gazeta.pl 2 of 29 blocked
  12. o2.pl 2 of 29 blocked
  13. abczdrowie.pl 2 of 29 blocked
  14. pudelek.pl 2 of 29 blocked
  15. tvn24.pl 1 of 29 blocked

Sites with an llms.txt (5)

All 59 .pl (Poland) sites

✕ blocked · ◐ partially blocked (some paths) · ✓ allowed · ? robots.txt unreadable. "#" is the position in our popularity-ordered sample.

#SitePolicyGPTBotOAI-SearchChatGPT-UserClaudeBotClaude-SearchPerplexityGoogle-Ext.CCBotllms.txt
306allegro.plOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
336wp.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedblocked–
427onet.plBlocks some AI searchallowedallowedallowedallowedallowedallowedallowedallowed–
490interia.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
641mediaexpert.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
679filmweb.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
690home.plOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
691otomoto.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2204nazwa.plOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
2455gazeta.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedblocked–
2510cyberfolks.plOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
2740certum.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3142gemius.plNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
3217ceneo.plBlocks some AI searchallowedallowedallowedblockedblockedallowedallowedallowed–
3437tvn24.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedallowed–
3484o2.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedblocked–
3640icm.edu.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3808zus.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3915infor.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3981money.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedblocked–
3999pracuj.plUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4074bankier.plBlocks training onlyblockedallowedallowedallowedallowedallowedblockedblocked–
4316tvp.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4346rmf24.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4405centrum24.plUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4409fakt.plBlocks some AI searchallowedallowedallowedallowedallowedallowedallowedallowed–
4507dziennik.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4562doz.plUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4679polsatnews.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4682krakow.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4778euro.com.plUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4992poznan.plBlocks training onlyallowedallowedallowedallowedallowedallowedallowedallowed–
5280abczdrowie.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedblocked–
5311pudelek.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedblocked–
5315portalsamorzadowy.plBlocks some AI searchblockedblockedblockedblockedallowedblockedblockedblocked–
5405rynekzdrowia.plBlocks some AI searchblockedblockedblockedblockedallowedblockedblockedblocked–
5720pomponik.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
5755aniagotuje.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
5951kurnik.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
6481dorzeczy.plOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
6677polki.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
6756librus.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
6893uw.edu.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
6922wyborcza.plBlocks some AI searchblockedallowedblockedblockedallowedblockedallowedblocked–
6943plotek.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedallowed–
7074rp.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
7077tvn.plBlocks training onlyblockedallowedallowedallowedallowedallowedallowedallowed–
8328castorama.plUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
8815seohost.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
8867lh.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
8885chomikuj.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
9016agh.edu.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
9132cda.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
9298art.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
9507salesmanago.plNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
9727gazetaprawna.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–
9891uj.edu.plBlocks some AI searchblockedblockedblockedblockedblockedblockedblockedblocked–
9903trojmiasto.plUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
9931amu.edu.plOpenallowedallowedallowedallowedallowedallowedallowedallowed–

Categories on .pl (Poland)

FAQ

Do websites in Poland (.pl) block AI crawlers?
As of 2026-10-02, 26.4% of the 53 websites in Poland (.pl) whose robots.txt we could read block GPTBot, 9.4% block ClaudeBot and 7.5% block PerplexityBot (all 8,366 sites: 12%, 11%, 8.3%). 5 of them (9.4%) serve an llms.txt (all sites: 15.2%).
Which .pl (Poland) websites block the most AI crawlers?
uj.edu.pl (28 of 29), portalsamorzadowy.pl (16 of 29), rynekzdrowia.pl (16 of 29), wyborcza.pl (8 of 29), onet.pl (7 of 29). The full per-site status is on each site page.
How is this measured?
We fetch each site's robots.txt every day from one residential IP in Taiwan with an honest user agent, and apply the rules to 29 AI crawlers for the home page. 59 .pl (Poland) sites are in the sample, 53 had a readable robots.txt (6 did not answer or returned an error page).

Other countries and suffixes

Compare all suffixes