Which .cn (China) websites block the most AI crawlers?

zol.com.cn (29 of 29), 22.cn (1 of 29). The full per-site status is on each site page.

How is this measured?

We fetch each site's robots.txt every day from one residential IP in Taiwan with an honest user agent, and apply the rules to 29 AI crawlers for the home page. 92 .cn (China) sites are in the sample, 54 had a readable robots.txt (38 did not answer or returned an error page).

AI Crawler Index · country

Do websites in China (.cn) block AI crawlers?

As of 2026-10-02, 3.7% of the 54 websites in China (.cn) whose robots.txt we could read block GPTBot, 1.9% block ClaudeBot and 1.9% block PerplexityBot (all 8,366 sites: 12%, 11%, 8.3%). 1 of them (1.9%) serve an llms.txt (all sites: 15.2%).

3.7%

block GPTBot (all sites 12%)

1.9%

block ClaudeBot (all sites 11%)

1.9%

serve an llms.txt (all sites 15.2%)

of 92 sites with a readable robots.txt

Block rate by crawler: .cn (China) vs all sites

Crawler	Operator	.cn (China)	All sites	Difference
GPTBot	OpenAI	3.7%	12%	-8.3 pp
Amazonbot	Amazon	1.9%	9.2%	-7.3 pp
Amzn-SearchBot	Amazon	1.9%	4.1%	-2.2 pp
Amzn-User	Amazon	1.9%	3.9%	-2 pp
Applebot	Apple	1.9%	3.1%	-1.2 pp
Applebot-Extended	Apple	1.9%	9.6%	-7.7 pp
Bytespider	ByteDance	1.9%	12.2%	-10.3 pp
CCBot	Common Crawl	1.9%	12.7%	-10.8 pp
ChatGPT-User	OpenAI	1.9%	7.4%	-5.5 pp
Claude-SearchBot	Anthropic	1.9%	5.4%	-3.5 pp
Claude-User	Anthropic	1.9%	5.5%	-3.6 pp
ClaudeBot	Anthropic	1.9%	11%	-9.1 pp
cohere-ai	Cohere	1.9%	9%	-7.1 pp
DuckAssistBot	DuckDuckGo	1.9%	5.7%	-3.8 pp
Google-Agent	Google	1.9%	3.2%	-1.3 pp
Google-CloudVertexBot	Google	1.9%	5.2%	-3.3 pp
Google-Extended	Google	1.9%	9.5%	-7.6 pp
Google-GeminiNotebook	Google	1.9%	3%	-1.1 pp
meta-externalads	Meta	1.9%	2.8%	-0.9 pp
Meta-ExternalAgent	Meta	1.9%	9.5%	-7.6 pp
meta-externalfetcher	Meta	1.9%	6%	-4.1 pp
meta-webindexer	Meta	1.9%	4.6%	-2.7 pp
MistralAI-Index	Mistral	1.9%	3.3%	-1.4 pp
MistralAI-Training	Mistral	1.9%	3.2%	-1.3 pp
MistralAI-User	Mistral	1.9%	5.3%	-3.4 pp
OAI-AdsBot	OpenAI	1.9%	3%	-1.1 pp
OAI-SearchBot	OpenAI	1.9%	5.7%	-3.8 pp
Perplexity-User	Perplexity	1.9%	5.7%	-3.8 pp
PerplexityBot	Perplexity	1.9%	8.3%	-6.4 pp

Policy mix

Policy	Sites	Share
Unreadable	38	41.3%
No robots.txt	29	31.5%
Open	23	25%
Blocks training only	1	1.1%
Blocks all AI search	1	1.1%

Most restrictive .cn (China) sites

zol.com.cn 29 of 29 blocked
22.cn 1 of 29 blocked

Sites with an llms.txt (1)

bt.cn

All 92 .cn (China) sites

✕ blocked · ◐ partially blocked (some paths) · ✓ allowed · ? robots.txt unreadable. "#" is the position in our popularity-ordered sample.

#	Site	Policy	GPTBot	OAI-Search	ChatGPT-User	ClaudeBot	Claude-Search	Perplexity	Google-Ext.	CCBot	llms.txt
88	miit.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
183	beian.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
211	sina.com.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
297	360.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
366	vivo.com.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
1075	feishu.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
1366	chinadaily.com.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
1388	sjtu.edu.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
1404	cib.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
1456	tsinghua.edu.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
1570	tenda.com.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
1608	sinaimg.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
1689	dbankedge.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
1774	kdocs.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
1838	quark.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
2160	10086.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
2234	10jqka.com.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
2270	uc.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
2288	ucloud.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
2514	pku.edu.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
2542	china.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
2546	bmw-motorrad.com.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
2687	189.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
2726	cloudlinks.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
2819	thinkingdata.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
3077	chinanews.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
3353	cloudbirds.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
3422	chinatax.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
3535	xyyh.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
3599	4.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
3646	midea.com.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
3793	gmw.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
3934	autohome.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
4030	22.cn	Blocks training only	blocked	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
4075	icbc.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
4089	mofcom.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
4181	thepaper.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
4248	zol.com.cn	Blocks all AI search	blocked	blocked	blocked	blocked	blocked	blocked	blocked	blocked	–
4330	cri.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
4426	globaltimes.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
4466	17u.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
4758	cntv.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
4932	chsi.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
5528	cas.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
5648	sh.gov.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
6031	bjx.com.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
6118	pconline.com.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
6194	beijing.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
6540	neu.edu.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
6548	msn.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
6695	west.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
6805	gd.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
6896	sm.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
6977	dfmc.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
7137	ustc.edu.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
7162	zju.edu.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
7224	wanfangdata.com.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
7227	samr.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
7233	wechatpay.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
7558	12377.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
7579	ndrc.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
7607	domob.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
7660	hapseemate.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
7805	boc.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
7839	mof.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
7850	qwps.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
7867	nhc.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
8199	ctyun.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
8207	fudan.edu.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
8212	ruijie.com.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
8325	mohrss.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
8327	stats.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
8543	hapsee.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
8553	fmprc.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
8598	g.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
8759	xuexi.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
8804	court.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
8818	12371.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
8908	youth.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
8909	zj.gov.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
9195	kuwo.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
9289	12306.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
9304	wjx.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
9305	bt.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	yes
9312	nju.edu.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
9329	t.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
9363	cninfo.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
9405	dcloud.net.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
9689	juejin.cn	Open	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
9723	most.gov.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–
9916	pcauto.com.cn	Unreadable	unknown	unknown	unknown	unknown	unknown	unknown	unknown	unknown	–
9951	sdu.edu.cn	No robots.txt	allowed	allowed	allowed	allowed	allowed	allowed	allowed	allowed	–

Categories on .cn (China)

Other 58 sites
Government 17 sites
Education 9 sites
Tech 3 sites
News & media 3 sites
Finance 2 sites

FAQ

Do websites in China (.cn) block AI crawlers?: As of 2026-10-02, 3.7% of the 54 websites in China (.cn) whose robots.txt we could read block GPTBot, 1.9% block ClaudeBot and 1.9% block PerplexityBot (all 8,366 sites: 12%, 11%, 8.3%). 1 of them (1.9%) serve an llms.txt (all sites: 15.2%).
Which .cn (China) websites block the most AI crawlers?: zol.com.cn (29 of 29), 22.cn (1 of 29). The full per-site status is on each site page.
How is this measured?: We fetch each site's robots.txt every day from one residential IP in Taiwan with an honest user agent, and apply the rules to 29 AI crawlers for the home page. 92 .cn (China) sites are in the sample, 54 had a readable robots.txt (38 did not answer or returned an error page).

Other countries and suffixes

.com GPTBot 12.4%
.org GPTBot 11.3%
.net GPTBot 13.4%
.ru (Russia) GPTBot 5.1%
.de (Germany) GPTBot 23.6%
.jp (Japan) GPTBot 6%
.io GPTBot 4.3%
.edu GPTBot 3.7%
.gov GPTBot 4.6%
.br (Brazil) GPTBot 5.6%
.uk (United Kingdom) GPTBot 20%
.fr (France) GPTBot 31.8%
.in (India) GPTBot 4.1%
.it (Italy) GPTBot 27.3%
.ai GPTBot 4.8%
.pl (Poland) GPTBot 26.4%
.au (Australia) GPTBot 27.8%
.tv GPTBot 6%
.nl (Netherlands) GPTBot 27.1%
.es (Spain) GPTBot 22.2%
.co GPTBot 9.1%
.ca (Canada) GPTBot 7.1%
.ch (Switzerland) GPTBot 16.7%
.ir (Iran) GPTBot 0%

Compare all suffixes