AI crawler · Meta · Ads review
Which websites block meta-externalads?
As of 2026-11-16, 245 of the 8,313 popular websites whose robots.txt we could read (2.9%) block meta-externalads, Meta's ads review crawler, on the home page; 10 more block it on some paths. Among the top 100 sites: 9.6%.
2.9%
of 8,313 readable sites block meta-externalads
9.6%
of the top 100
#29
most blocked of 29 AI crawlers
8,058
sites allow it on the home page
Blocked by category
| Category | Sites read | Block meta-externalads |
|---|---|---|
| Social | 51 | 17.6% |
| Travel | 13 | 7.7% |
| Reference | 43 | 4.7% |
| Finance | 102 | 3.9% |
| News & media | 392 | 3.3% |
| Other | 6651 | 3% |
| E-commerce | 116 | 2.6% |
| Entertainment | 332 | 1.8% |
| Government | 203 | 1.5% |
| Education | 232 | 0.9% |
| Tech | 162 | 0.6% |
| AI | 10 | 0% |
| Telecom | 6 | 0% |
Popular sites that block meta-externalads (245)
- facebook.com Social
- instagram.com Social
- twitter.com Social
- linkedin.com Social
- netflix.com Entertainment
- x.com Social
- reddit.com Social
- flickr.com Other
- imdb.com Reference
- weibo.com Social
- trustpilot.com Other
- wsj.com News & media
- sohu.com Tech
- threads.com Social
- fb.com Other
- academia.edu Reference
- hbr.org News & media
- ouest-france.fr News & media
- amap.com Travel
- tjk.org Other
- aka.ms Other
- qcloud.com Other
- merkur.de Other
- rocketmoney.dev Other
- adrta.com Other
- marketwatch.com E-commerce
- blackhub.team Other
- lnkd.in Other
- sedoparking.com Other
- sogou.com Other
- salesforceliveagent.com Other
- adsco.re Other
- thesun.co.uk Other
- sap.com Other
- openssl.org Other
- constellix.com Other
- kasserver.com Other
- instacart.com Other
- co.com Other
- tappx.com Other
- redditmedia.com Other
- news.com.au News & media
- entrepreneur.com Other
- expressapisv2.net News & media
- urldefense.com Other
- gutenberg.org Other
- nextdoor.com Social
- huntress.io Other
- system-monitor.com Other
- salesforce-scrt.com Other
- wa.gov Government
- jwpltx.com Other
- thetimes.co.uk News & media
- hellotalk8.com Other
- theregister.com Other
- sas.com Other
- myanimelist.net Entertainment
- wargaming.net Other
- nzherald.co.nz News & media
- cuny.edu Education
- orf.at Other
- lenovomm.com Other
- smugmug.com Other
- rs6.net Other
- onenote.com Other
- entrust.net Other
- yomiuri.co.jp Other
- sportradarserving.com News & media
- backblazeb2.com Other
- wordreference.com Other
- gmarket.co.kr E-commerce
- cnki.net Other
- myhostadmin.net Other
- helsinki.fi Other
- paycomonline.net Finance
- feednews.com News & media
- huya.com Other
- doh.pub Other
- barrons.com Other
- ezoic.net Other
- boxofficemojo.com Other
- dayforcehcm.com Other
- arte.tv Entertainment
- manualslib.com Other
- michelin.com Other
- fr.de Other
- queue-it.net Other
- braintreegateway.com Other
- mypurecloud.com Other
- pro32connect.ru Other
- afterpay.com Finance
- jivosite.com Other
- storygize.net Other
- securedvisit.com Other
- letelegramme.fr Other
- megaphone.fm Other
- lunalabs.io Other
- ura.news News & media
- bidtheatre.com Other
- rateyourmusic.com Entertainment
- musixmatch.com Other
- carview.co.jp Other
- expediapartnercentral.com Other
- salesforce-sites.com Other
- islonline.net Other
- lanouvellerepublique.fr Other
- midasbuy.com E-commerce
- hackernoon.com Other
- athome.co.jp Other
- zol.com.cn Other
- yclients.com Other
- the-sun.com Other
- gala.de Other
- quay.io Other
- tryst.link Other
- theaustralian.com.au Other
- npci.org.in Other
- cargocollective.com Other
- mailin.fr Other
- clickadu.net Other
- healow.com Other
- spokeo.com Other
- servedbyadbutler.com Other
- ayhal.com Other
- mjt.lu Other
- ruhr24.de Other
- hs-sites.com Other
- javbus.com Other
- bloomberglaw.com Other
- widen.net Other
- novelpia.com Other
- 13o.net Other
- decafeligiblyhad.com Other
- buffermotivatorsuffice.com Other
- aruodas.lt Other
- wuytg.com Other
- novel543.com Other
- yangkeduo.com Other
- eluniversal.com.mx Other
- spiceworks.com Other
- nebo.mobi Other
- uakinogo.io Other
- nv.gov Government
- wikicv.org Other
- nofeu.com Other
- 0lin.com Other
- azureserv.com Other
- niconsul.com Other
- sangtacviet.app Other
- mgln.ai Other
- fonts.net Other
- betproexch.live Finance
- alastonsuomi.com Other
- glip.com Other
- musinsa.com Other
- twiket.com Other
- tencentcs.com Other
- fireeye.com Other
- z.com Other
- goldfishouncereburial.com Other
- hao123.com Other
- ovid.com Other
- parimatchs123.com Other
- investors.com Finance
- omappapi.com Other
- radar.io Other
- yospace.com Other
- etahub.com Other
- free-dating4you.com Other
- kexart.com Other
- attacheatableoverlabor.com Other
- dwd.de Other
- linguee.com Other
- usgbc.org Other
- juniper.net Other
- mypikpak.com Other
- taxtelecom.ru Other
- arcor.de Other
- educationboardresults.gov.bd Government
- airbrake.io Other
- getrockerbox.com Other
- 99xo4.com Other
- z-library.sk Other
- manuaisescolares.pt Other
- dreamwidth.org Other
- parspack.net Other
- zdbb.net Other
- cloudflarestream.com Other
- hearstnp.com Other
- 24smi.net Other
- ad-srv.net Other
- holahupa.com Other
- hna.de Other
- epubgame.com Entertainment
- sociogames.com Entertainment
- komus.ru Other
- merchantcircle.com Other
- nzbgeek.info Other
- governmentjobs.com Other
- england.nhs.uk Other
Showing the 200 most popular of 245. The full list is in sites.csv.
Sites that block meta-externalads on some paths (10)
- reuters.com News & media
- capcut.com Other
- disneyplus.com Entertainment
- jusbrasil.com.br Other
- protothema.gr News & media
- slate.com Other
- zeit.de Other
- ziprecruiter.com Other
- qwant.com Other
- khaleejtimes.com News & media
Trend
The daily series for meta-externalads starts on 2026-11-16; a trend appears here as days accumulate.
Latest changes
- gutenberg.org: allowed → blocked
- athome.co.jp: allowed → blocked
- yclients.com: allowed → blocked
- dreamwidth.org: allowed → blocked
- passportindia.gov.in: blocked → allowed
Block or allow meta-externalads
User-agent: meta-externalads Disallow: /
Replace Disallow: / with Allow: / to let it in. A site that blocks training crawlers but wants to be cited in AI answers usually keeps the search and user-triggered crawlers allowed.
FAQ
- How many websites block meta-externalads?
- As of 2026-11-16, 245 of the 8,313 popular websites whose robots.txt we could read (2.9%) block meta-externalads, Meta's ads review crawler, on the home page; 10 more block it on some paths. Among the top 100 sites: 9.6%.
- What is meta-externalads?
- meta-externalads is Meta's ads review crawler. It is the #29 most blocked of the 29 AI crawlers in the index.
- How do I block meta-externalads in robots.txt?
- Add these lines to https://<your-site>/robots.txt: "User-agent: meta-externalads" followed by "Disallow: /". To allow it, use "Allow: /" instead. Well-behaved crawlers read robots.txt before fetching pages; firewall rules are needed to stop crawlers that ignore it.
- How do I check whether my site blocks meta-externalads?
- Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker: it shows the status of meta-externalads and 28 other AI crawlers with the exact robots.txt rule.
Other AI crawlers
Also from Meta: Meta-ExternalAgent (13.6%), meta-webindexer (5.1%), meta-externalfetcher (6.5%).
- CCBot 16.4%
- Bytespider 16.2%
- GPTBot 15.4%
- ClaudeBot 14.7%
- Meta-ExternalAgent 13.6%
- Applebot-Extended 13.4%
- Google-Extended 13.2%
- Amazonbot 13.2%
- cohere-ai 12.7%
- Google-CloudVertexBot 8.8%
- PerplexityBot 8.2%
- ChatGPT-User 7.4%
- MistralAI-Training 7.1%
- meta-externalfetcher 6.5%
- Perplexity-User 6.1%
- Claude-User 5.9%
- DuckAssistBot 5.9%
- OAI-SearchBot 5.8%
- Claude-SearchBot 5.7%
- MistralAI-User 5.7%
- meta-webindexer 5.1%
- Amzn-SearchBot 4.4%
- Amzn-User 4.4%
- Google-Agent 3.6%
- MistralAI-Index 3.6%
- Google-GeminiNotebook 3.3%
- Applebot 3.2%
- OAI-AdsBot 3%