TidyToolsAI Crawler Index · data as of · updated daily

AI Crawler Index · Anthropic · ClaudeBot

Which .de (Germany) websites block ClaudeBot?

As of 2026-10-03, 41 of the 203 .de (Germany) websites whose robots.txt we could read (20.2%) block ClaudeBot, Anthropic's AI training crawler, on the home page, compared with 11% of all sites; 6 more block it on some paths.

20.2%
of 203 .de (Germany) websites block ClaudeBot
11%
of all sites
41
sites block it

All 41 .de (Germany) websites that block ClaudeBot

#SitePolicyCrawlers blocked
90t-online.deBlocks some AI search7 of 29
613spiegel.deBlocks some AI search13 of 29
881merkur.deBlocks some AI search21 of 29
1336zeit.deBlocks some AI search10 of 29
1484sueddeutsche.deBlocks some AI search6 of 29
1658tagesschau.deBlocks training only7 of 29
1808tagesspiegel.deBlocks training only6 of 29
1907ndr.deBlocks training only7 of 29
1937br.deBlocks training only7 of 29
1950wdr.deBlocks training only7 of 29
2000ardmediathek.deBlocks training only7 of 29
2298kicker.deBlocks some AI search12 of 29
2312swr.deBlocks training only7 of 29
2459mdr.deBlocks training only7 of 29
3023fr.deBlocks some AI search21 of 29
3285autoscout24.deBlocks training only5 of 29
3504giga.deBlocks some AI search8 of 29
4025sportschau.deBlocks training only7 of 29
4042rp-online.deBlocks some AI search17 of 29
4155schwaebische.deBlocks some AI search10 of 29
4288gala.deBlocks some AI search16 of 29
4359nordkurier.deBlocks some AI search10 of 29
4938kino.deBlocks some AI search8 of 29
5156ruhr24.deBlocks some AI search21 of 29
6488morgenpost.deBlocks some AI search11 of 29
6904augsburger-allgemeine.deBlocks some AI search19 of 29
7109posteo.deBlocks some AI search15 of 29
7299dwd.deBlocks some AI search28 of 29
7420abendblatt.deBlocks some AI search11 of 29
7449arcor.deBlocks all AI search29 of 29
7592wiwo.deBlocks some AI search11 of 29
8192hna.deBlocks some AI search21 of 29
8719hessenschau.deBlocks training only7 of 29
8923derwesten.deBlocks some AI search19 of 29
9280waz.deBlocks some AI search11 of 29
9281aerzteblatt.deBlocks some AI search10 of 29
9345mopo.deBlocks some AI search17 of 29
9629netzwelt.deBlocks some AI search9 of 29
9818shz.deBlocks some AI search16 of 29
9923qrco.deBlocks all AI search29 of 29
9930t3n.deBlocks some AI search10 of 29

Popular .de (Germany) websites that allow ClaudeBot

Other AI crawlers and .de (Germany) websites

ClaudeBot in other segments

ClaudeBot overview · All .de (Germany) websites

FAQ

Which .de (Germany) websites block ClaudeBot?
t-online.de, spiegel.de, merkur.de, zeit.de, sueddeutsche.de, tagesschau.de, tagesspiegel.de, ndr.de, and 33 more (full list on this page).
How many .de (Germany) websites block ClaudeBot?
As of 2026-10-03, 41 of the 203 .de (Germany) websites whose robots.txt we could read (20.2%) block ClaudeBot, Anthropic's AI training crawler, on the home page, compared with 11% of all sites; 6 more block it on some paths.
How do I block or allow ClaudeBot on my site?
Add "User-agent: ClaudeBot" followed by "Disallow: /" to https://<your-site>/robots.txt to block it, or "Allow: /" to allow it. Check the result with the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker.