TidyToolsAI Crawler Index · data as of · updated daily

AI crawler · Amazon · AI search

Which websites block Amzn-SearchBot?

As of 2026-10-01, 50 of the 853 popular websites whose robots.txt we could read (5.9%) block Amzn-SearchBot, Amazon's AI search crawler, on the home page; 2 more block it on some paths. Among the top 100 sites: 13.3%.

5.9%
of 853 readable sites block Amzn-SearchBot
13.3%
of the top 100
#21
most blocked of 29 AI crawlers
801
sites allow it on the home page

Blocked by category

CategorySites readBlock Amzn-SearchBot
Social4818.8%
News & media12611.9%
Travel137.7%
Other2606.2%
Reference434.7%
Entertainment684.4%
E-commerce583.4%
Tech1541.3%
AI90%
Education200%
Finance160%
Government330%
Telecom50%

Popular sites that block Amzn-SearchBot (50)

  1. facebook.com Social
  2. instagram.com Social
  3. twitter.com Social
  4. linkedin.com Social
  5. netflix.com Entertainment
  6. x.com Social
  7. pinterest.com Social
  8. reddit.com Social
  9. flickr.com Other
  10. theguardian.com News & media
  11. bbc.com News & media
  12. meraki.com Tech
  13. reuters.com News & media
  14. weibo.com Social
  15. trustpilot.com Other
  16. wsj.com News & media
  17. sohu.com Tech
  18. usatoday.com News & media
  19. threads.com Social
  20. elpais.com News & media
  21. fb.com Other
  22. cnet.com News & media
  23. disneyplus.com Entertainment
  24. people.com News & media
  25. academia.edu Reference
  26. onet.pl News & media
  27. investopedia.com News & media
  28. healthline.com Reference
  29. as.com News & media
  30. nypost.com News & media
  31. theconversation.com News & media
  32. amap.com Travel
  33. emag.ro E-commerce
  34. notion.com Other
  35. tjk.org Other
  36. aka.ms Other
  37. sportfilm800.com News & media
  38. rocketmoney.dev Other
  39. qcloud.com Other
  40. blackhub.team Other
  41. zdnet.com News & media
  42. adrta.com Other
  43. marketwatch.com E-commerce
  44. merkur.de Other
  45. hulu.com Entertainment
  46. lnkd.in Other
  47. sogou.com Other
  48. ign.com Other
  49. salesforceliveagent.com Other
  50. sedoparking.com Other

Sites that block Amzn-SearchBot on some paths (2)

  1. imdb.com Reference
  2. capcut.com Other

Trend

The daily series for Amzn-SearchBot starts on 2026-10-01; a trend appears here as days accumulate.

Latest changes

Block or allow Amzn-SearchBot

User-agent: Amzn-SearchBot
Disallow: /

Replace Disallow: / with Allow: / to let it in. A site that blocks training crawlers but wants to be cited in AI answers usually keeps the search and user-triggered crawlers allowed.

FAQ

How many websites block Amzn-SearchBot?
As of 2026-10-01, 50 of the 853 popular websites whose robots.txt we could read (5.9%) block Amzn-SearchBot, Amazon's AI search crawler, on the home page; 2 more block it on some paths. Among the top 100 sites: 13.3%.
What is Amzn-SearchBot?
Amzn-SearchBot is Amazon's AI search crawler: it indexes pages so an AI search product can find and cite them. It is the #21 most blocked of the 29 AI crawlers in the index.
How do I block Amzn-SearchBot in robots.txt?
Add these lines to https://<your-site>/robots.txt: "User-agent: Amzn-SearchBot" followed by "Disallow: /". To allow it, use "Allow: /" instead. Well-behaved crawlers read robots.txt before fetching pages; firewall rules are needed to stop crawlers that ignore it.
How do I check whether my site blocks Amzn-SearchBot?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker: it shows the status of Amzn-SearchBot and 28 other AI crawlers with the exact robots.txt rule.

Other AI crawlers

Also from Amazon: Amazonbot (13.1%), Amzn-User (5.5%).