TidyTools

Web data tools for developers and AI agents

43 tools that turn websites, documents, audio and images into clean data. Run them in bulk on Apify; selected tools also have a RapidAPI endpoint.

Free AI crawler checker

Is your site blocking ChatGPT, Claude or Perplexity? See which of 29 AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) a site's robots.txt allows, with a ready-to-paste fix. Free JSON API, no sign-up, no key:

https://tools.yukai.uk/ai-crawlers/<domain> — try /ai-crawlers/wikipedia.org

Also try our free AI visibility checker (one sample answer per day). Also free for AI agents: https://tools.yukai.uk/md/<url>, a web page or PDF as clean Markdown (how to use it). Machine-readable catalog: /llms.txt

Featured APIs

Call these tools from your code, with a free tier and paid plans on RapidAPI.

Website Contact Extractor

Emails, phone numbers and social profiles from company websites, with the page each one was found on.

RapidAPI: free 50 requests/month; $14.99/month for 10,000 requests

Image OCR API

Text from receipts, documents, screenshots and photos in many languages.

RapidAPI: free 50 requests/month; $9.99/month for 2,000 requests

AI Web Data Extractor API

Read public pages only, respect robots.txt, and reject blocked or empty pages before calling AI. Get the fields you name as structured JSON, one row per item on list pages.

RapidAPI: free 50 requests/month; $19.99/month for 500 requests

Turn web pages and documents into clean text for AI and apps

Crawl a docs site into Markdown for RAG, pull the article out of a news page, render screenshots and PDFs, or turn a page into JSON fields you name.

  • Website to Markdown
  • Smart Fetch (URL to Markdown by region)
  • Article extractor & AI summarizer
  • Screenshots, PDFs and Markdown
  • Documents to Markdown
  • AI web data extractor
  • and 5 more

See 11 tools and prices →

Audit, check and monitor websites

Score a page in about two seconds, audit a whole site, see which AI crawlers a site blocks, and get alerted when a page changes.

  • SEO audit
  • AI crawler access checker
  • Regional price checker
  • Domain authority checker
  • Website traffic rank checker
  • Backlink gap finder
  • and 6 more

See 12 tools and prices →

Enrich companies, contacts and domains

Start from a domain or a list of websites and get the company profile, the tools it uses, public contact details and the state of its domain.

  • Website contact extractor
  • Company enrichment
  • Tech stack detector
  • Domain WHOIS, RDAP & DNS lookup
  • Email validation
  • Phone number validator
  • and 4 more

See 10 tools and prices →

Collect jobs, app store and online store data

Read official feeds and public pages into one consistent table: career-site jobs, app reviews and rankings, store catalogues and newsletter posts.

  • Career site jobs
  • Job search across 54,000 career sites
  • App Store reviews & app details
  • App Store top charts & keyword ranks
  • Shopify products & prices
  • Newsletter & blog feeds

See 6 tools and prices →

Transcribe audio and read or edit images

Speech to text with timestamps and SRT subtitles, text from receipts and screenshots, alt text for accessibility, and bulk image clean-up.

  • Audio & video transcriber
  • Image to text (OCR)
  • AI alt text generator
  • Background removal & image tools

See 4 tools and prices →

Guides and how-tos: 9 short answers with steps and prices →

Free data

Open datasets we publish with one page per site, company or service. Counts and dates below are today's.

AI Crawler Index

Which popular websites block GPTBot, ClaudeBot, PerplexityBot and other AI crawlers in robots.txt, checked every day.

10,000 websites · 29 AI crawlers, 8,317 readable robots.txt files · data of 2026-11-14

Tech Stack Index

What popular websites are built with: CMS, framework, CDN, analytics and more, from public home pages and response headers.

7,718 websites · 394 technologies detected · data of 2026-11-14

Hiring Index

Which companies are hiring now, by role family and country, counted from public job boards of 16 applicant tracking systems.

1,681,854 open jobs · 44,285 companies · data of 2026-11-14

Regional Price Index

What software and subscriptions cost in the US, UK, Singapore and Taiwan, read from each pricing page in that country.

148 services · 4 regions · data of 2026-11-14

Business Lists by City

How many businesses of each kind a city has and how many list a website, from Overture Maps.

2,050,445 businesses · 150 cities, 40 categories · data of 2026-10-03

Funding Tracker

Which companies just raised money, by industry and US state, from the new Form D filings at the SEC, updated daily.

1,386 Form D filings · last 30 days, 31 industries, 51 states · data of 2026-11-13

All free datasets →

Direct, Apify or RapidAPI?

Apify: bulk jobs, no code

Paste a list of URLs or domains, run it once or on a schedule, and download a table. You pay per result at the price shown; larger Apify plans pay less. Works from n8n, Make, Zapier and AI agents through Apify's MCP server.

RapidAPI: one HTTP call per item

Call the API from your own code with one key. Every API has a free plan with a hard monthly limit and paid monthly plans; RapidAPI handles sign-up and billing.