AI Crawler Index · country
Do websites in Czechia (.cz) block AI crawlers?
As of 2026-10-02, 3.2% of the 31 websites in Czechia (.cz) whose robots.txt we could read block GPTBot, 6.5% block ClaudeBot and 3.2% block PerplexityBot (all 8,366 sites: 12%, 11%, 8.3%). 2 of them (6.5%) serve an llms.txt (all sites: 15.2%).
3.2%
block GPTBot (all sites 12%)
6.5%
block ClaudeBot (all sites 11%)
6.5%
serve an llms.txt (all sites 15.2%)
31
of 37 sites with a readable robots.txt
Block rate by crawler: .cz (Czechia) vs all sites
| Crawler | Operator | .cz (Czechia) | All sites | Difference |
|---|---|---|---|---|
| Bytespider | ByteDance | 9.7% | 12.2% | -2.5 pp |
| CCBot | Common Crawl | 6.5% | 12.7% | -6.2 pp |
| ClaudeBot | Anthropic | 6.5% | 11% | -4.5 pp |
| Meta-ExternalAgent | Meta | 6.5% | 9.5% | -3 pp |
| meta-externalfetcher | Meta | 6.5% | 6% | +0.5 pp |
| Amazonbot | Amazon | 3.2% | 9.2% | -6 pp |
| Applebot | Apple | 3.2% | 3.1% | +0.1 pp |
| cohere-ai | Cohere | 3.2% | 9% | -5.8 pp |
| DuckAssistBot | DuckDuckGo | 3.2% | 5.7% | -2.5 pp |
| Google-Extended | 3.2% | 9.5% | -6.3 pp | |
| GPTBot | OpenAI | 3.2% | 12% | -8.8 pp |
| PerplexityBot | Perplexity | 3.2% | 8.3% | -5.1 pp |
| Amzn-SearchBot | Amazon | 0% | 4.1% | -4.1 pp |
| Amzn-User | Amazon | 0% | 3.9% | -3.9 pp |
| Applebot-Extended | Apple | 0% | 9.6% | -9.6 pp |
| ChatGPT-User | OpenAI | 0% | 7.4% | -7.4 pp |
| Claude-SearchBot | Anthropic | 0% | 5.4% | -5.4 pp |
| Claude-User | Anthropic | 0% | 5.5% | -5.5 pp |
| Google-Agent | 0% | 3.2% | -3.2 pp | |
| Google-CloudVertexBot | 0% | 5.2% | -5.2 pp | |
| Google-GeminiNotebook | 0% | 3% | -3 pp | |
| meta-externalads | Meta | 0% | 2.8% | -2.8 pp |
| meta-webindexer | Meta | 0% | 4.6% | -4.6 pp |
| MistralAI-Index | Mistral | 0% | 3.3% | -3.3 pp |
| MistralAI-Training | Mistral | 0% | 3.2% | -3.2 pp |
| MistralAI-User | Mistral | 0% | 5.3% | -5.3 pp |
| OAI-AdsBot | OpenAI | 0% | 3% | -3 pp |
| OAI-SearchBot | OpenAI | 0% | 5.7% | -5.7 pp |
| Perplexity-User | Perplexity | 0% | 5.7% | -5.7 pp |
Who blocks what, by name: Bytespider.
Policy mix
| Policy | Sites | Share |
|---|---|---|
| Open | 23 | 62.2% |
| Unreadable | 6 | 16.2% |
| No robots.txt | 3 | 8.1% |
| Blocks some AI search | 3 | 8.1% |
| Blocks training only | 2 | 5.4% |
Most restrictive .cz (Czechia) sites
- idnes.cz 7 of 29 blocked
- livesport.cz 6 of 29 blocked
- csfd.cz 2 of 29 blocked
- windguru.cz 2 of 29 blocked
- blesk.cz 1 of 29 blocked
Sites with an llms.txt (2)
All 37 .cz (Czechia) sites
✕ blocked · ◐ partially blocked (some paths) · ✓ allowed · ? robots.txt unreadable. "#" is the position in our popularity-ordered sample.
| # | Site | Policy | GPTBot | OAI-Search | ChatGPT-User | ClaudeBot | Claude-Search | Perplexity | Google-Ext. | CCBot | llms.txt |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 322 | seznam.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 662 | novinky.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 1042 | cukrarnauandela.cz | No robots.txt | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 1503 | idnes.cz | Blocks some AI search | blocked | allowed | allowed | blocked | allowed | blocked | blocked | allowed | – |
| 2786 | wedos.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | yes |
| 2790 | cuni.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 2994 | forpsi.cz | No robots.txt | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 3342 | alza.cz | Unreadable | unknown | unknown | unknown | unknown | unknown | unknown | unknown | unknown | – |
| 3480 | muni.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 3506 | centrum.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 3698 | cra.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 3911 | csfd.cz | Blocks training only | allowed | allowed | allowed | blocked | allowed | allowed | allowed | blocked | – |
| 4037 | blesk.cz | Blocks training only | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 4134 | nova.cz | Unreadable | unknown | unknown | unknown | unknown | unknown | unknown | unknown | unknown | – |
| 4176 | seznamzpravy.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 4201 | windguru.cz | Blocks some AI search | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 4579 | cvut.cz | Unreadable | unknown | unknown | unknown | unknown | unknown | unknown | unknown | unknown | – |
| 4769 | bazos.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 4851 | super.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 4924 | livesport.cz | Blocks some AI search | allowed | allowed | allowed | allowed | allowed | allowed | allowed | blocked | – |
| 5138 | allwyn.cz | Unreadable | unknown | unknown | unknown | unknown | unknown | unknown | unknown | unknown | – |
| 5435 | kupi.cz | Unreadable | unknown | unknown | unknown | unknown | unknown | unknown | unknown | unknown | – |
| 5472 | prehrajto.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 5509 | anikoto.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 5623 | idos.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 5851 | freevideo.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 6860 | thinline.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 7489 | master.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | yes |
| 8106 | web4u.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 8643 | ceskatelevize.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 8862 | 257.cz | No robots.txt | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 9017 | phoca.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 9059 | active24.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 9158 | heureka.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 9478 | regzone.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
| 9494 | ignum.cz | Unreadable | unknown | unknown | unknown | unknown | unknown | unknown | unknown | unknown | – |
| 9703 | iprima.cz | Open | allowed | allowed | allowed | allowed | allowed | allowed | allowed | allowed | – |
Categories on .cz (Czechia)
- Other 33 sites
- News & media 2 sites
- Tech 1 sites
- Entertainment 1 sites
FAQ
- Do websites in Czechia (.cz) block AI crawlers?
- As of 2026-10-02, 3.2% of the 31 websites in Czechia (.cz) whose robots.txt we could read block GPTBot, 6.5% block ClaudeBot and 3.2% block PerplexityBot (all 8,366 sites: 12%, 11%, 8.3%). 2 of them (6.5%) serve an llms.txt (all sites: 15.2%).
- Which .cz (Czechia) websites block the most AI crawlers?
- idnes.cz (7 of 29), livesport.cz (6 of 29), csfd.cz (2 of 29), windguru.cz (2 of 29), blesk.cz (1 of 29). The full per-site status is on each site page.
- How is this measured?
- We fetch each site's robots.txt every day from one residential IP in Taiwan with an honest user agent, and apply the rules to 29 AI crawlers for the home page. 37 .cz (Czechia) sites are in the sample, 31 had a readable robots.txt (6 did not answer or returned an error page).
Other countries and suffixes
- .com GPTBot 12.4%
- .org GPTBot 11.3%
- .net GPTBot 13.4%
- .ru (Russia) GPTBot 5.1%
- .de (Germany) GPTBot 23.6%
- .jp (Japan) GPTBot 6%
- .io GPTBot 4.3%
- .edu GPTBot 3.7%
- .gov GPTBot 4.6%
- .br (Brazil) GPTBot 5.6%
- .uk (United Kingdom) GPTBot 20%
- .fr (France) GPTBot 31.8%
- .in (India) GPTBot 4.1%
- .cn (China) GPTBot 3.7%
- .it (Italy) GPTBot 27.3%
- .ai GPTBot 4.8%
- .pl (Poland) GPTBot 26.4%
- .au (Australia) GPTBot 27.8%
- .tv GPTBot 6%
- .nl (Netherlands) GPTBot 27.1%
- .es (Spain) GPTBot 22.2%
- .co GPTBot 9.1%
- .ca (Canada) GPTBot 7.1%
- .ch (Switzerland) GPTBot 16.7%