TidyToolsAI Crawler Index · data as of · updated daily

AI crawler access · ensighten.com

Does ensighten.com block GPTBot and other AI crawlers?

We could not read the robots.txt of ensighten.com from our datacenter IP on 2026-11-16 (an error page, a bot wall or a connection problem), so its AI crawler rules are unknown.

All 29 AI crawlers on ensighten.com

Status for the home page (/) under ensighten.com's robots.txt. Partially blocked = home page allowed, some paths disallowed.

CrawlerOperatorrobots.txt
Training crawlers
GPTBotOpenAIunknown
ClaudeBotAnthropicunknown
Google-ExtendedGoogleunknown
Applebot-ExtendedAppleunknown
Meta-ExternalAgentMetaunknown
AmazonbotAmazonunknown
MistralAI-TrainingMistralunknown
CCBotCommon Crawlunknown
BytespiderByteDanceunknown
cohere-aiCohereunknown
AI search crawlers
OAI-SearchBotOpenAIunknown
Claude-SearchBotAnthropicunknown
PerplexityBotPerplexityunknown
Google-CloudVertexBotGoogleunknown
ApplebotAppleunknown
meta-webindexerMetaunknown
Amzn-SearchBotAmazonunknown
DuckAssistBotDuckDuckGounknown
MistralAI-IndexMistralunknown
User-triggered fetch crawlers
ChatGPT-UserOpenAIunknown
Claude-UserAnthropicunknown
Perplexity-UserPerplexityunknown
Google-GeminiNotebookGoogleunknown
Google-AgentGoogleunknown
meta-externalfetcherMetaunknown
Amzn-UserAmazonunknown
MistralAI-UserMistralunknown
Ads review crawlers
OAI-AdsBotOpenAIunknown
meta-externaladsMetaunknown

History

No change recorded since daily tracking started on 2026-10-02. We re-check ensighten.com every day; a change in its AI crawler rules shows up here and on the index page.

FAQ

Does ensighten.com block GPTBot?
Unknown. https://ensighten.com/robots.txt could not be read on 2026-11-16.
Does ensighten.com block ClaudeBot?
Unknown. https://ensighten.com/robots.txt could not be read on 2026-11-16.
Does ensighten.com block PerplexityBot?
Unknown. https://ensighten.com/robots.txt could not be read on 2026-11-16.
Can ChatGPT search (OAI-SearchBot) crawl ensighten.com?
Unknown. https://ensighten.com/robots.txt could not be read on 2026-11-16.
Does ensighten.com block Google-Extended (Gemini training)?
Unknown. https://ensighten.com/robots.txt could not be read on 2026-11-16.
How can I check ensighten.com or my own site again?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker (no sign-up). To check many sites and get alerts when rules change, use the AI Crawler Access Checker on Apify.

Similar .com sites

What is ensighten.com built with? (Tech Stack Index)

All 10,000 sites · All 29 AI crawlers · AI Crawler Index