TidyToolsAI Crawler Index · data as of · updated daily

AI Crawler Index · OpenAI · GPTBot

Which .in (India) websites block GPTBot?

As of 2026-10-02, 3 of the 74 .in (India) websites whose robots.txt we could read (4.1%) block GPTBot, OpenAI's AI training crawler, on the home page, compared with 12% of all sites.

4.1%
of 74 .in (India) websites block GPTBot
12%
of all sites
3
sites block it

All 3 .in (India) websites that block GPTBot

#SitePolicyCrawlers blocked
983lnkd.inBlocks some AI search26 of 29
8226brainly.inBlocks training only2 of 29
8809theprint.inBlocks training only2 of 29

Popular .in (India) websites that allow GPTBot

Other AI crawlers and .in (India) websites

GPTBot in other segments

GPTBot overview · All .in (India) websites

FAQ

Which .in (India) websites block GPTBot?
lnkd.in, brainly.in, theprint.in.
How many .in (India) websites block GPTBot?
As of 2026-10-02, 3 of the 74 .in (India) websites whose robots.txt we could read (4.1%) block GPTBot, OpenAI's AI training crawler, on the home page, compared with 12% of all sites.
How do I block or allow GPTBot on my site?
Add "User-agent: GPTBot" followed by "Disallow: /" to https://<your-site>/robots.txt to block it, or "Allow: /" to allow it. Check the result with the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker.