TidyToolsAI Crawler Index · data as of · updated daily

AI Crawler Index · country

Do websites in Brazil (.br) block AI crawlers?

As of 2026-10-03, 6.7% of the 90 websites in Brazil (.br) whose robots.txt we could read block GPTBot, 5.6% block ClaudeBot and 4.4% block PerplexityBot (all 8,357 sites: 12%, 11%, 8.3%). 14 of them (15.6%) serve an llms.txt (all sites: 15.2%).

6.7%
block GPTBot (all sites 12%)
5.6%
block ClaudeBot (all sites 11%)
15.6%
serve an llms.txt (all sites 15.2%)
90
of 128 sites with a readable robots.txt

Block rate by crawler: .br (Brazil) vs all sites

CrawlerOperator.br (Brazil)All sitesDifference
CCBotCommon Crawl10%12.8%-2.8 pp
cohere-aiCohere6.7%9.1%-2.4 pp
Google-ExtendedGoogle6.7%9.5%-2.8 pp
GPTBotOpenAI6.7%12%-5.3 pp
ClaudeBotAnthropic5.6%11%-5.4 pp
AmazonbotAmazon4.4%9.2%-4.8 pp
Applebot-ExtendedApple4.4%9.6%-5.2 pp
BytespiderByteDance4.4%12.3%-7.9 pp
Meta-ExternalAgentMeta4.4%9.5%-5.1 pp
Perplexity-UserPerplexity4.4%5.7%-1.3 pp
PerplexityBotPerplexity4.4%8.3%-3.9 pp
Google-CloudVertexBotGoogle3.3%5.2%-1.9 pp
MistralAI-UserMistral3.3%5.4%-2.1 pp
Claude-SearchBotAnthropic2.2%5.4%-3.2 pp
Claude-UserAnthropic2.2%5.5%-3.3 pp
DuckAssistBotDuckDuckGo2.2%5.8%-3.6 pp
MistralAI-TrainingMistral2.2%3.3%-1.1 pp
Amzn-SearchBotAmazon1.1%4.1%-3 pp
Amzn-UserAmazon1.1%3.9%-2.8 pp
ApplebotApple1.1%3.1%-2 pp
ChatGPT-UserOpenAI1.1%7.5%-6.4 pp
Google-AgentGoogle1.1%3.2%-2.1 pp
Google-GeminiNotebookGoogle1.1%3%-1.9 pp
meta-externalfetcherMeta1.1%6%-4.9 pp
meta-webindexerMeta1.1%4.6%-3.5 pp
MistralAI-IndexMistral1.1%3.3%-2.2 pp
OAI-AdsBotOpenAI1.1%3%-1.9 pp
OAI-SearchBotOpenAI1.1%5.7%-4.6 pp
meta-externaladsMeta0%2.8%-2.8 pp

Who blocks what, by name: GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider, Applebot-Extended.

Policy mix

PolicySitesShare
Open5845.3%
Unreadable3829.7%
No robots.txt2217.2%
Blocks some AI search64.7%
Blocks training only43.1%

Most restrictive .br (Brazil) sites

  1. uol.com.br 16 of 29 blocked
  2. olhardigital.com.br 16 of 29 blocked
  3. jusbrasil.com.br 11 of 29 blocked
  4. diariodolitoral.com.br 11 of 29 blocked
  5. chavesnamao.com.br 8 of 29 blocked
  6. clicrbs.com.br 8 of 29 blocked
  7. gazetadopovo.com.br 4 of 29 blocked
  8. americanas.com.br 3 of 29 blocked
  9. diariodocomercio.com.br 3 of 29 blocked
  10. ndmais.com.br 1 of 29 blocked

Sites with an llms.txt (14)

Top 100 of 128 .br (Brazil) sites

✕ blocked · ◐ partially blocked (some paths) · ✓ allowed · ? robots.txt unreadable. "#" is the position in our popularity-ordered sample.

#SitePolicyGPTBotOAI-SearchChatGPT-UserClaudeBotClaude-SearchPerplexityGoogle-Ext.CCBotllms.txt
250uol.com.brBlocks some AI searchallowedallowedallowedblockedblockedblockedblockedblocked–
291shopee.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
416mercadolivre.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
435caixa.gov.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
470olx.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
491terra.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
541locaweb.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
564acesso.gov.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
593jusbrasil.com.brBlocks some AI searchpartialpartialpartialpartialpartialpartialpartialblockedyes
717nfse.gov.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
794letras.mus.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
813tjsp.jus.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
955clickpetroleoegas.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
959alura.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
1110nubank.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1511kinghost.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1577ntp.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
1593intelbras.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
1723santander.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
1732usp.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
1757magazineluiza.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
1782ifood.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2033bb.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2085itau.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2103rnp.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2295abril.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2334netshoes.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2383serpro.gov.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2561estadao.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2591sicredi.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2596reclameaqui.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
2702bradesco.com.brOpenpartialpartialpartialpartialallowedpartialpartialallowedyes
2752eb.mil.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
2764correios.com.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
2845casasbahia.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
2850cnnbrasil.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3173serasa.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
3189sympla.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3198drogasil.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
3199scielo.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3493bancointer.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3680enjoei.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
3705zapimoveis.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
3789kabum.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
4047chavesnamao.com.brBlocks training onlyblockedallowedallowedblockedallowedallowedblockedblockedyes
4200cifraclub.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4272boticario.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4281webmotors.com.brOpenpartialpartialpartialpartialallowedallowedpartialallowed–
4381privacy.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4461bling.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4482lance.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
4530bcb.gov.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4561americanas.com.brBlocks training onlyblockedallowedallowedallowedallowedallowedblockedblockedyes
4591climatempo.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4601itatiaia.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4607voeazul.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4657ndmais.com.brBlocks training onlyallowedallowedallowedallowedallowedallowedallowedblocked–
4698unicamp.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4710correio24horas.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4764catho.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4837bibliaonline.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
4839drogariasaopaulo.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
4884radios.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4896ig.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4918ufmg.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
4936tudogostoso.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
4995vivareal.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
5094imovelweb.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
5142esocial.gov.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
5163quintoandar.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
5205olhardigital.com.brBlocks some AI searchblockedblockedblockedblockedallowedblockedblockedblocked–
5376pciconcursos.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
5414diariodocomercio.com.brBlocks training onlyblockedallowedallowedallowedallowedallowedblockedblocked–
5679ridigital.org.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
5687resultadofacil.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
5690pje.jus.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
5696prefeitura.sp.gov.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
5697portaltemponovo.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
5873educacao.sp.gov.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
5893portal6.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
5966garotocomlocal.com.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
5987riovagas.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
5994sertastore.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
6033detran.sp.gov.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
6299operacoes.sp.gov.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
6439nsctotal.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
6596oantagonista.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
6622tecconcursos.com.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
6651colaboraread.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
6708tse.jus.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
6799diariodolitoral.com.brBlocks some AI searchblockedallowedallowedblockedallowedallowedblockedblocked–
6829drogaraia.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
6888netvasco.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
6889ufrj.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
6921ligapokemon.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
6981placardefutebol.com.brUnreadableunknownunknownunknownunknownunknownunknownunknownunknown–
6988unb.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–
7009travesticomlocal.com.brOpenallowedallowedallowedallowedallowedallowedallowedallowedyes
7106fieltorcedor.com.brNo robots.txtallowedallowedallowedallowedallowedallowedallowedallowed–
7114goias.gov.brOpenallowedallowedallowedallowedallowedallowedallowedallowed–

Sorted by popularity; the rest are on the A-Z lists.

Categories on .br (Brazil)

FAQ

Do websites in Brazil (.br) block AI crawlers?
As of 2026-10-03, 6.7% of the 90 websites in Brazil (.br) whose robots.txt we could read block GPTBot, 5.6% block ClaudeBot and 4.4% block PerplexityBot (all 8,357 sites: 12%, 11%, 8.3%). 14 of them (15.6%) serve an llms.txt (all sites: 15.2%).
Which .br (Brazil) websites block the most AI crawlers?
uol.com.br (16 of 29), olhardigital.com.br (16 of 29), jusbrasil.com.br (11 of 29), diariodolitoral.com.br (11 of 29), chavesnamao.com.br (8 of 29). The full per-site status is on each site page.
How is this measured?
We fetch each site's robots.txt every day from one residential IP in Taiwan with an honest user agent, and apply the rules to 29 AI crawlers for the home page. 128 .br (Brazil) sites are in the sample, 90 had a readable robots.txt (38 did not answer or returned an error page).

Other countries and suffixes

Compare all suffixes