TidyToolsAI Crawler Index · data as of · updated daily

AI Crawler Index · OpenAI · OAI-SearchBot

Which .de (Germany) websites block OAI-SearchBot?

As of 2026-11-16, 15 of the 201 .de (Germany) websites whose robots.txt we could read (7.5%) block OAI-SearchBot, OpenAI's AI search crawler, on the home page, compared with 5.8% of all sites; 8 more block it on some paths.

7.5%
of 201 .de (Germany) websites block OAI-SearchBot
5.8%
of all sites
15
sites block it

All 15 .de (Germany) websites that block OAI-SearchBot

#SitePolicyCrawlers blocked
613spiegel.deBlocks some AI search12 of 29
1336zeit.deBlocks some AI search27 of 29
4042rp-online.deBlocks some AI search17 of 29
4155schwaebische.deBlocks some AI search10 of 29
4359nordkurier.deBlocks some AI search10 of 29
6904augsburger-allgemeine.deBlocks some AI search19 of 29
7109posteo.deBlocks some AI search27 of 29
7299dwd.deBlocks some AI search28 of 29
7449arcor.deBlocks all AI search29 of 29
8923derwesten.deBlocks some AI search19 of 29
9281aerzteblatt.deBlocks all AI search29 of 29
9345mopo.deBlocks some AI search17 of 29
9388bundesfinanzministerium.deBlocks all AI search29 of 29
9818shz.deBlocks some AI search21 of 29
9923qrco.deBlocks all AI search29 of 29

Popular .de (Germany) websites that allow OAI-SearchBot

Other AI crawlers and .de (Germany) websites

OAI-SearchBot in other segments

OAI-SearchBot overview · All .de (Germany) websites

FAQ

Which .de (Germany) websites block OAI-SearchBot?
spiegel.de, zeit.de, rp-online.de, schwaebische.de, nordkurier.de, augsburger-allgemeine.de, posteo.de, dwd.de, and 7 more (full list on this page).
How many .de (Germany) websites block OAI-SearchBot?
As of 2026-11-16, 15 of the 201 .de (Germany) websites whose robots.txt we could read (7.5%) block OAI-SearchBot, OpenAI's AI search crawler, on the home page, compared with 5.8% of all sites; 8 more block it on some paths.
How do I block or allow OAI-SearchBot on my site?
Add "User-agent: OAI-SearchBot" followed by "Disallow: /" to https://<your-site>/robots.txt to block it, or "Allow: /" to allow it. Check the result with the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker.