TidyToolsAI Crawler Index · data as of · updated daily

AI crawler · Meta · Ads review

Which websites block meta-externalads?

As of 2026-10-01, 32 of the 853 popular websites whose robots.txt we could read (3.8%) block meta-externalads, Meta's ads review crawler, on the home page; 5 more block it on some paths. Among the top 100 sites: 9.6%.

3.8%
of 853 readable sites block meta-externalads
9.6%
of the top 100
#28
most blocked of 29 AI crawlers
816
sites allow it on the home page

Blocked by category

CategorySites readBlock meta-externalads
Social4816.7%
Travel137.7%
Other2605.4%
Reference434.7%
E-commerce583.4%
News & media1261.6%
Entertainment681.5%
Tech1541.3%
AI90%
Education200%
Finance160%
Government330%
Telecom50%

Popular sites that block meta-externalads (32)

Sites that block meta-externalads on some paths (5)

Trend

The daily series for meta-externalads starts on 2026-10-01; a trend appears here as days accumulate.

Latest changes

No site changed its meta-externalads rule in the latest daily run.

Block or allow meta-externalads

User-agent: meta-externalads
Disallow: /

Replace Disallow: / with Allow: / to let it in. A site that blocks training crawlers but wants to be cited in AI answers usually keeps the search and user-triggered crawlers allowed.

FAQ

How many websites block meta-externalads?
As of 2026-10-01, 32 of the 853 popular websites whose robots.txt we could read (3.8%) block meta-externalads, Meta's ads review crawler, on the home page; 5 more block it on some paths. Among the top 100 sites: 9.6%.
What is meta-externalads?
meta-externalads is Meta's ads review crawler. It is the #28 most blocked of the 29 AI crawlers in the index.
How do I block meta-externalads in robots.txt?
Add these lines to https://<your-site>/robots.txt: "User-agent: meta-externalads" followed by "Disallow: /". To allow it, use "Allow: /" instead. Well-behaved crawlers read robots.txt before fetching pages; firewall rules are needed to stop crawlers that ignore it.
How do I check whether my site blocks meta-externalads?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker: it shows the status of meta-externalads and 28 other AI crawlers with the exact robots.txt rule.

Other AI crawlers

Also from Meta: Meta-ExternalAgent (14.4%), meta-webindexer (6.3%), meta-externalfetcher (8.7%).