TidyToolsAI Crawler Index · data as of · updated daily

AI crawler access · weathernews.jp

Does weathernews.jp block GPTBot and other AI crawlers?

GPTBot: partially blockedAs of 2026-10-01, the robots.txt of weathernews.jp blocks 0 of 29 AI crawlers on the home page and partially blocks 4 more: GPTBot is partially blocked, ClaudeBot is partially blocked and PerplexityBot is partially blocked.

All 29 AI crawlers on weathernews.jp

Status for the home page (/) under weathernews.jp's robots.txt. Partially blocked = home page allowed, some paths disallowed.

CrawlerOperatorrobots.txt
Training crawlers
GPTBotOpenAIpartial
ClaudeBotAnthropicpartial
Google-ExtendedGooglepartial
Applebot-ExtendedAppleallowed
Meta-ExternalAgentMetaallowed
AmazonbotAmazonallowed
MistralAI-TrainingMistralallowed
CCBotCommon Crawlallowed
BytespiderByteDanceallowed
cohere-aiCohereallowed
AI search crawlers
OAI-SearchBotOpenAIallowed
Claude-SearchBotAnthropicallowed
PerplexityBotPerplexitypartial
Google-CloudVertexBotGoogleallowed
ApplebotAppleallowed
meta-webindexerMetaallowed
Amzn-SearchBotAmazonallowed
DuckAssistBotDuckDuckGoallowed
MistralAI-IndexMistralallowed
User-triggered fetch crawlers
ChatGPT-UserOpenAIallowed
Claude-UserAnthropicallowed
Perplexity-UserPerplexityallowed
Google-GeminiNotebookGoogleallowed
Google-AgentGoogleallowed
meta-externalfetcherMetaallowed
Amzn-UserAmazonallowed
MistralAI-UserMistralallowed
Ads review crawlers
OAI-AdsBotOpenAIallowed
meta-externaladsMetaallowed

Compared with other news & media sites in the index: 43.7% of them block GPTBot and 49.2% block ClaudeBot (n=126). Across all 853 readable sites: 17% block GPTBot. All news & media sites →

History

No change in the latest daily run. We re-check weathernews.jp every day; changes show up here and on the index page.

FAQ

Does weathernews.jp block GPTBot?
Partly. As of 2026-10-01, https://weathernews.jp/robots.txt allows GPTBot (OpenAI's AI training crawler) on the home page but disallows some paths.
Does weathernews.jp block ClaudeBot?
Partly. As of 2026-10-01, https://weathernews.jp/robots.txt allows ClaudeBot (Anthropic's AI training crawler) on the home page but disallows some paths.
Does weathernews.jp block PerplexityBot?
Partly. As of 2026-10-01, https://weathernews.jp/robots.txt allows PerplexityBot (Perplexity's AI search crawler) on the home page but disallows some paths.
Can ChatGPT search (OAI-SearchBot) crawl weathernews.jp?
No. As of 2026-10-01, https://weathernews.jp/robots.txt allows OAI-SearchBot, OpenAI's AI search crawler, on the home page.
Does weathernews.jp block Google-Extended (Gemini training)?
Partly. As of 2026-10-01, https://weathernews.jp/robots.txt allows Google-Extended (Google's AI training crawler) on the home page but disallows some paths.
Does weathernews.jp have an llms.txt file?
No. As of 2026-10-01, weathernews.jp does not serve a plain-text /llms.txt file.
How can I check weathernews.jp or my own site again?
Use the free AI crawler checker at tools.yukai.uk/free/ai-crawler-checker (no sign-up). To check many sites and get alerts when rules change, use the AI Crawler Access Checker on Apify.

Similar news & media sites

All 1,005 sites · All 29 AI crawlers · AI Crawler Index