TidyToolsAI Crawler Index · data as of · updated daily

AI crawler access · hot.net.il

Does hot.net.il block GPTBot and other AI crawlers?

We could not read the robots.txt of hot.net.il from our datacenter IP on 2026-11-16 (an error page, a bot wall or a connection problem), so its AI crawler rules are unknown.

All 29 AI crawlers on hot.net.il

Status for the home page (/) under hot.net.il's robots.txt. Partially blocked = home page allowed, some paths disallowed.

CrawlerOperatorrobots.txt
Training crawlers
GPTBotOpenAIunknown
ClaudeBotAnthropicunknown
Google-ExtendedGoogleunknown
Applebot-ExtendedAppleunknown
Meta-ExternalAgentMetaunknown
AmazonbotAmazonunknown
MistralAI-TrainingMistralunknown
CCBotCommon Crawlunknown
BytespiderByteDanceunknown
cohere-aiCohereunknown
AI search crawlers
OAI-SearchBotOpenAIunknown
Claude-SearchBotAnthropicunknown
PerplexityBotPerplexityunknown
Google-CloudVertexBotGoogleunknown
ApplebotAppleunknown
meta-webindexerMetaunknown
Amzn-SearchBotAmazonunknown
DuckAssistBotDuckDuckGounknown
MistralAI-IndexMistralunknown
User-triggered fetch crawlers
ChatGPT-UserOpenAIunknown
Claude-UserAnthropicunknown
Perplexity-UserPerplexityunknown
Google-GeminiNotebookGoogleunknown
Google-AgentGoogleunknown
meta-externalfetcherMetaunknown
Amzn-UserAmazonunknown
MistralAI-UserMistralunknown
Ads review crawlers
OAI-AdsBotOpenAIunknown
meta-externaladsMetaunknown

History

No change recorded since daily tracking started on 2026-10-02. We re-check hot.net.il every day; a change in its AI crawler rules shows up here and on the index page.

FAQ

Does hot.net.il block GPTBot?
Unknown. https://hot.net.il/robots.txt could not be read on 2026-11-16.
Does hot.net.il block ClaudeBot?
Unknown. https://hot.net.il/robots.txt could not be read on 2026-11-16.
Does hot.net.il block PerplexityBot?
Unknown. https://hot.net.il/robots.txt could not be read on 2026-11-16.
Can ChatGPT search (OAI-SearchBot) crawl hot.net.il?
Unknown. https://hot.net.il/robots.txt could not be read on 2026-11-16.
Does hot.net.il block Google-Extended (Gemini training)?
Unknown. https://hot.net.il/robots.txt could not be read on 2026-11-16.
How can I check hot.net.il or my own site again?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker (no sign-up). To check many sites and get alerts when rules change, use the AI Crawler Access Checker on Apify.

All 10,000 sites · All 29 AI crawlers · AI Crawler Index