TidyToolsAI Crawler Index · data as of · updated daily

AI crawler · Amazon · Training

Which websites block Amazonbot?

As of 2026-10-01, 112 of the 853 popular websites whose robots.txt we could read (13.1%) block Amazonbot, Amazon's AI training crawler, on the home page; 23 more block it on some paths. Among the top 100 sites: 18.1%.

13.1%
of 853 readable sites block Amazonbot
18.1%
of the top 100
#9
most blocked of 29 AI crawlers
718
sites allow it on the home page

Blocked by category

CategorySites readBlock Amazonbot
News & media12642.9%
Social4822.9%
Reference4314%
Other26010.4%
E-commerce5810.3%
Government339.1%
Travel137.7%
Entertainment684.4%
Tech1540.6%
AI90%
Education200%
Finance160%
Telecom50%

Popular sites that block Amazonbot (112)

Sites that block Amazonbot on some paths (23)

Trend

The daily series for Amazonbot starts on 2026-10-01; a trend appears here as days accumulate.

Latest changes

Block or allow Amazonbot

User-agent: Amazonbot
Disallow: /

Replace Disallow: / with Allow: / to let it in. A site that blocks training crawlers but wants to be cited in AI answers usually keeps the search and user-triggered crawlers allowed.

FAQ

How many websites block Amazonbot?
As of 2026-10-01, 112 of the 853 popular websites whose robots.txt we could read (13.1%) block Amazonbot, Amazon's AI training crawler, on the home page; 23 more block it on some paths. Among the top 100 sites: 18.1%.
What is Amazonbot?
Amazonbot is Amazon's AI training crawler: it collects pages to train AI models. It is the #9 most blocked of the 29 AI crawlers in the index.
How do I block Amazonbot in robots.txt?
Add these lines to https://<your-site>/robots.txt: "User-agent: Amazonbot" followed by "Disallow: /". To allow it, use "Allow: /" instead. Well-behaved crawlers read robots.txt before fetching pages; firewall rules are needed to stop crawlers that ignore it.
How do I check whether my site blocks Amazonbot?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker: it shows the status of Amazonbot and 28 other AI crawlers with the exact robots.txt rule.

Other AI crawlers

Also from Amazon: Amzn-SearchBot (5.9%), Amzn-User (5.5%).