TidyToolsAI Crawler Index · data as of · updated daily

AI crawler access · moonpay.com

Does moonpay.com block GPTBot and other AI crawlers?

GPTBot: allowedAs of 2026-11-16, the robots.txt of moonpay.com allows all 29 AI crawlers we track: GPTBot is allowed, ClaudeBot is allowed and PerplexityBot is allowed.

All 29 AI crawlers on moonpay.com

Status for the home page (/) under moonpay.com's robots.txt. Partially blocked = home page allowed, some paths disallowed.

CrawlerOperatorrobots.txt
Training crawlers
GPTBotOpenAIallowed
ClaudeBotAnthropicallowed
Google-ExtendedGoogleallowed
Applebot-ExtendedAppleallowed
Meta-ExternalAgentMetaallowed
AmazonbotAmazonallowed
MistralAI-TrainingMistralallowed
CCBotCommon Crawlallowed
BytespiderByteDanceallowed
cohere-aiCohereallowed
AI search crawlers
OAI-SearchBotOpenAIallowed
Claude-SearchBotAnthropicallowed
PerplexityBotPerplexityallowed
Google-CloudVertexBotGoogleallowed
ApplebotAppleallowed
meta-webindexerMetaallowed
Amzn-SearchBotAmazonallowed
DuckAssistBotDuckDuckGoallowed
MistralAI-IndexMistralallowed
User-triggered fetch crawlers
ChatGPT-UserOpenAIallowed
Claude-UserAnthropicallowed
Perplexity-UserPerplexityallowed
Google-GeminiNotebookGoogleallowed
Google-AgentGoogleallowed
meta-externalfetcherMetaallowed
Amzn-UserAmazonallowed
MistralAI-UserMistralallowed
Ads review crawlers
OAI-AdsBotOpenAIallowed
meta-externaladsMetaallowed

Compared with other finance sites in the index: 6.9% of them block GPTBot and 6.9% block ClaudeBot (n=102). Across all 8,313 readable sites: 15.4% block GPTBot. All finance sites →

On .com domains: 15.9% of 4,449 readable sites block GPTBot and 21.2% serve an llms.txt. All .com sites →

History

2 recorded changes since daily tracking started on 2026-10-02:

DateWhatBeforeAfter
2026-10-06overall policyNo robots.txtOpen
2026-10-06(llms.txt)falsetrue

FAQ

Does moonpay.com block GPTBot?
No. As of 2026-11-16, https://moonpay.com/robots.txt allows GPTBot, OpenAI's AI training crawler, on the home page.
Does moonpay.com block ClaudeBot?
No. As of 2026-11-16, https://moonpay.com/robots.txt allows ClaudeBot, Anthropic's AI training crawler, on the home page.
Does moonpay.com block PerplexityBot?
No. As of 2026-11-16, https://moonpay.com/robots.txt allows PerplexityBot, Perplexity's AI search crawler, on the home page.
Can ChatGPT search (OAI-SearchBot) crawl moonpay.com?
No. As of 2026-11-16, https://moonpay.com/robots.txt allows OAI-SearchBot, OpenAI's AI search crawler, on the home page.
Does moonpay.com block Google-Extended (Gemini training)?
No. As of 2026-11-16, https://moonpay.com/robots.txt allows Google-Extended, Google's AI training crawler, on the home page.
Does moonpay.com have an llms.txt file?
Yes. moonpay.com serves a plain-text /llms.txt file (checked 2026-11-16).
How can I check moonpay.com or my own site again?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker (no sign-up). To check many sites and get alerts when rules change, use the AI Crawler Access Checker on Apify.

Similar finance sites

All sites with an llms.txt · Which finance sites block GPTBot · Which .com sites block GPTBot · What is moonpay.com built with? (Tech Stack Index) · Is moonpay.com hiring? (Hiring Index)

All 10,000 sites · All 29 AI crawlers · AI Crawler Index