TidyToolsAI Crawler Index · data as of · updated daily

AI crawler · Amazon · AI search

Which websites block Amzn-SearchBot?

As of 2026-11-16, 366 of the 8,313 popular websites whose robots.txt we could read (4.4%) block Amzn-SearchBot, Amazon's AI search crawler, on the home page; 21 more block it on some paths. Among the top 100 sites: 13.3%.

4.4%
of 8,313 readable sites block Amzn-SearchBot
13.3%
of the top 100
#22
most blocked of 29 AI crawlers
7,926
sites allow it on the home page

Blocked by category

CategorySites readBlock Amzn-SearchBot
Social5119.6%
News & media3929.9%
Travel137.7%
Reference434.7%
Other66514.4%
Finance1023.9%
E-commerce1163.4%
Entertainment3322.7%
Government2031.5%
Education2321.3%
Tech1620.6%
AI100%
Telecom60%

Popular sites that block Amzn-SearchBot (366)

Showing the 200 most popular of 366. The full list is in sites.csv.

Sites that block Amzn-SearchBot on some paths (21)

Trend

The daily series for Amzn-SearchBot starts on 2026-11-16; a trend appears here as days accumulate.

Latest changes

Block or allow Amzn-SearchBot

User-agent: Amzn-SearchBot
Disallow: /

Replace Disallow: / with Allow: / to let it in. A site that blocks training crawlers but wants to be cited in AI answers usually keeps the search and user-triggered crawlers allowed.

FAQ

How many websites block Amzn-SearchBot?
As of 2026-11-16, 366 of the 8,313 popular websites whose robots.txt we could read (4.4%) block Amzn-SearchBot, Amazon's AI search crawler, on the home page; 21 more block it on some paths. Among the top 100 sites: 13.3%.
What is Amzn-SearchBot?
Amzn-SearchBot is Amazon's AI search crawler: it indexes pages so an AI search product can find and cite them. It is the #22 most blocked of the 29 AI crawlers in the index.
How do I block Amzn-SearchBot in robots.txt?
Add these lines to https://<your-site>/robots.txt: "User-agent: Amzn-SearchBot" followed by "Disallow: /". To allow it, use "Allow: /" instead. Well-behaved crawlers read robots.txt before fetching pages; firewall rules are needed to stop crawlers that ignore it.
How do I check whether my site blocks Amzn-SearchBot?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker: it shows the status of Amzn-SearchBot and 28 other AI crawlers with the exact robots.txt rule.

Other AI crawlers

Also from Amazon: Amazonbot (13.2%), Amzn-User (4.4%).