TidyToolsAI Crawler Index · data as of · updated daily

AI crawler access · surfsharkstatus.com

Does surfsharkstatus.com block GPTBot and other AI crawlers?

We could not read the robots.txt of surfsharkstatus.com from our datacenter IP on 2026-11-16 (an error page, a bot wall or a connection problem), so its AI crawler rules are unknown.

All 29 AI crawlers on surfsharkstatus.com

Status for the home page (/) under surfsharkstatus.com's robots.txt. Partially blocked = home page allowed, some paths disallowed.

CrawlerOperatorrobots.txt
Training crawlers
GPTBotOpenAIunknown
ClaudeBotAnthropicunknown
Google-ExtendedGoogleunknown
Applebot-ExtendedAppleunknown
Meta-ExternalAgentMetaunknown
AmazonbotAmazonunknown
MistralAI-TrainingMistralunknown
CCBotCommon Crawlunknown
BytespiderByteDanceunknown
cohere-aiCohereunknown
AI search crawlers
OAI-SearchBotOpenAIunknown
Claude-SearchBotAnthropicunknown
PerplexityBotPerplexityunknown
Google-CloudVertexBotGoogleunknown
ApplebotAppleunknown
meta-webindexerMetaunknown
Amzn-SearchBotAmazonunknown
DuckAssistBotDuckDuckGounknown
MistralAI-IndexMistralunknown
User-triggered fetch crawlers
ChatGPT-UserOpenAIunknown
Claude-UserAnthropicunknown
Perplexity-UserPerplexityunknown
Google-GeminiNotebookGoogleunknown
Google-AgentGoogleunknown
meta-externalfetcherMetaunknown
Amzn-UserAmazonunknown
MistralAI-UserMistralunknown
Ads review crawlers
OAI-AdsBotOpenAIunknown
meta-externaladsMetaunknown

History

No change recorded since daily tracking started on 2026-10-02. We re-check surfsharkstatus.com every day; a change in its AI crawler rules shows up here and on the index page.

FAQ

Does surfsharkstatus.com block GPTBot?
Unknown. https://surfsharkstatus.com/robots.txt could not be read on 2026-11-16.
Does surfsharkstatus.com block ClaudeBot?
Unknown. https://surfsharkstatus.com/robots.txt could not be read on 2026-11-16.
Does surfsharkstatus.com block PerplexityBot?
Unknown. https://surfsharkstatus.com/robots.txt could not be read on 2026-11-16.
Can ChatGPT search (OAI-SearchBot) crawl surfsharkstatus.com?
Unknown. https://surfsharkstatus.com/robots.txt could not be read on 2026-11-16.
Does surfsharkstatus.com block Google-Extended (Gemini training)?
Unknown. https://surfsharkstatus.com/robots.txt could not be read on 2026-11-16.
How can I check surfsharkstatus.com or my own site again?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker (no sign-up). To check many sites and get alerts when rules change, use the AI Crawler Access Checker on Apify.

Similar .com sites

What is surfsharkstatus.com built with? (Tech Stack Index)

All 10,000 sites · All 29 AI crawlers · AI Crawler Index