TidyToolsAI Crawler Index · data as of · updated daily

AI crawler · OpenAI · User-triggered fetch

Which websites block ChatGPT-User?

As of 2026-10-01, 82 of the 853 popular websites whose robots.txt we could read (9.6%) block ChatGPT-User, OpenAI's user-triggered AI fetcher, on the home page; 56 more block it on some paths. Among the top 100 sites: 15.7%.

9.6%
of 853 readable sites block ChatGPT-User
15.7%
of the top 100
#11
most blocked of 29 AI crawlers
715
sites allow it on the home page

Blocked by category

CategorySites readBlock ChatGPT-User
News & media12628.6%
Social4822.9%
Reference4311.6%
AI911.1%
Other2607.7%
Entertainment685.9%
E-commerce583.4%
Government333%
Tech1541.3%
Education200%
Finance160%
Telecom50%
Travel130%

Popular sites that block ChatGPT-User (82)

  1. facebook.com Social
  2. instagram.com Social
  3. twitter.com Social
  4. linkedin.com Social
  5. amazon.com E-commerce
  6. x.com Social
  7. pinterest.com Social
  8. tiktok.com Social
  9. yahoo.com Tech
  10. reddit.com Social
  11. amazonvideo.com Entertainment
  12. nytimes.com News & media
  13. bbc.com News & media
  14. meraki.com Tech
  15. imdb.com Reference
  16. nature.com Reference
  17. weibo.com Social
  18. espn.com News & media
  19. claude.ai AI
  20. cnbc.com News & media
  21. quora.com Reference
  22. usatoday.com News & media
  23. threads.com Social
  24. telegraph.co.uk News & media
  25. techcrunch.com News & media
  26. primevideo.com Entertainment
  27. cambridge.org Reference
  28. dailymail.com News & media
  29. fb.com Other
  30. cnet.com News & media
  31. theverge.com News & media
  32. nbcnews.com News & media
  33. corriere.it News & media
  34. elmundo.es News & media
  35. archiveofourown.org Social
  36. bfmtv.com News & media
  37. huffpost.com News & media
  38. marca.com News & media
  39. cookpad.com Entertainment
  40. gsmarena.com News & media
  41. economist.com News & media
  42. theconversation.com News & media
  43. ad.nl News & media
  44. nu.nl News & media
  45. elconfidencial.com News & media
  46. spiegel.de News & media
  47. hln.be News & media
  48. emag.ro E-commerce
  49. abc.net.au News & media
  50. themoviedb.org Reference
  51. actu.fr News & media
  52. nikkansports.com News & media
  53. huffingtonpost.com News & media
  54. sapo.pt News & media
  55. dw.com News & media
  56. iltalehti.fi News & media
  57. aljazeera.com News & media
  58. ekstrabladet.dk News & media
  59. tjk.org Other
  60. aka.ms Other
  61. sportfilm800.com News & media
  62. twkan.com Other
  63. rocketmoney.dev Other
  64. qcloud.com Other
  65. newsweek.com News & media
  66. blackhub.team Other
  67. zdnet.com News & media
  68. adrta.com Other
  69. scientificamerican.com Other
  70. sciencemag.org Other
  71. thelancet.com Other
  72. iqiyi.com Entertainment
  73. wikihow.com Other
  74. liquipedia.net Other
  75. lnkd.in Other
  76. ssrn.com Other
  77. meb.gov.tr Government
  78. sogou.com Other
  79. science.org Other
  80. ign.com Other
  81. salesforceliveagent.com Other
  82. sedoparking.com Other

Sites that block ChatGPT-User on some paths (56)

  1. netflix.com Entertainment
  2. samsung.com Tech
  3. snapchat.com Social
  4. flickr.com Other
  5. soundcloud.com Entertainment
  6. ebay.com E-commerce
  7. oracle.com Tech
  8. ubuntu.com Tech
  9. reuters.com News & media
  10. hostinger.com Tech
  11. trustpilot.com Other
  12. tradingview.com News & media
  13. bloomberg.com News & media
  14. wsj.com News & media
  15. indeed.com Other
  16. temu.com E-commerce
  17. paloaltonetworks.com Tech
  18. aol.com Tech
  19. sohu.com Tech
  20. capcut.com Other
  21. bitrix24.ru Other
  22. trendmicro.com Tech
  23. tripadvisor.com Travel
  24. klaviyo.com Tech
  25. airbnb.com Travel
  26. ring.com Tech
  27. bestbuy.com E-commerce
  28. ted.com Entertainment
  29. disneyplus.com Entertainment
  30. people.com News & media
  31. academia.edu Reference
  32. figma.com Tech
  33. expedia.com Travel
  34. otto.de E-commerce
  35. investopedia.com News & media
  36. jimdo.com Tech
  37. skroutz.gr E-commerce
  38. finn.no E-commerce
  39. leboncoin.fr E-commerce
  40. coursera.org Tech
  41. amap.com Travel
  42. livescore.com News & media
  43. douyin.com Social
  44. bbb.org Other
  45. dagbladet.no News & media
  46. ilmeteo.it News & media
  47. deezer.com Other
  48. therapservices.net Other
  49. betpawa.ug Finance
  50. marketwatch.com E-commerce
  51. merkur.de Other
  52. hulu.com Entertainment
  53. oreilly.com Other
  54. hh.ru Other
  55. euronews.com News & media
  56. fastcompany.com Other

Trend

The daily series for ChatGPT-User starts on 2026-10-01; a trend appears here as days accumulate.

Latest changes

Block or allow ChatGPT-User

User-agent: ChatGPT-User
Disallow: /

Replace Disallow: / with Allow: / to let it in. A site that blocks training crawlers but wants to be cited in AI answers usually keeps the search and user-triggered crawlers allowed.

FAQ

How many websites block ChatGPT-User?
As of 2026-10-01, 82 of the 853 popular websites whose robots.txt we could read (9.6%) block ChatGPT-User, OpenAI's user-triggered AI fetcher, on the home page; 56 more block it on some paths. Among the top 100 sites: 15.7%.
What is ChatGPT-User?
ChatGPT-User is OpenAI's user-triggered AI fetcher: it fetches a page when a user asks the assistant about it. It is the #11 most blocked of the 29 AI crawlers in the index.
How do I block ChatGPT-User in robots.txt?
Add these lines to https://<your-site>/robots.txt: "User-agent: ChatGPT-User" followed by "Disallow: /". To allow it, use "Allow: /" instead. Well-behaved crawlers read robots.txt before fetching pages; firewall rules are needed to stop crawlers that ignore it.
How do I check whether my site blocks ChatGPT-User?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker: it shows the status of ChatGPT-User and 28 other AI crawlers with the exact robots.txt rule.

Other AI crawlers

Also from OpenAI: GPTBot (17%), OAI-SearchBot (6.7%), OAI-AdsBot (4.3%).