Web data tools for developers and AI agents
19 tools that turn websites, documents, audio and images into clean data. Run them in bulk on Apify, or call them one request at a time on RapidAPI.
Turn web pages and documents into clean text for AI and apps
Crawl a docs site into Markdown for RAG, pull the article out of a news page, render screenshots and PDFs, or turn a page into JSON fields you name.
- Website to Markdown
- Article extractor & AI summarizer
- Screenshots, PDFs and Markdown
- Documents to Markdown
- AI web data extractor
- Link preview & URL metadata
Audit, check and monitor websites
Score a page in about two seconds, audit a whole site, see which AI crawlers a site blocks, and get alerted when a page changes.
- SEO audit
- AI crawler access checker
- Website change monitor
Enrich companies, contacts and domains
Start from a domain or a list of websites and get the company profile, the tools it uses, public contact details and the state of its domain.
- Website contact extractor
- Company enrichment
- Tech stack detector
- Domain WHOIS, RDAP & DNS lookup
- Email validation
Collect jobs, app store and online store data
Read official feeds and public pages into one consistent table: career-site jobs, app reviews and rankings, store catalogues and newsletter posts.
- Career site jobs
- App Store reviews & app details
Transcribe audio and read or edit images
Speech to text with timestamps and SRT subtitles, text from receipts and screenshots, alt text for accessibility, and bulk image clean-up.
- Audio & video transcriber
- Image to text (OCR)
- Background removal & image tools
Free for AI agents, no key
Any agent that can fetch a URL can use these right now (rate limited, no sign-up):
https://tools.yukai.uk/md/<url>— a web page as clean Markdownhttps://tools.yukai.uk/ai-crawlers/<domain>— which AI crawlers a site's robots.txt allows
Machine-readable catalog: /llms.txt
AI Crawler Index
Free daily dataset: which of about 1,000 popular websites block GPTBot, ClaudeBot, PerplexityBot and other AI crawlers in robots.txt.
Apify or RapidAPI?
Apify: bulk jobs, no code
Paste a list of URLs or domains, run it once or on a schedule, and download a table. You pay per result at the price shown; larger Apify plans pay less. Works from n8n, Make, Zapier and AI agents through Apify's MCP server.
RapidAPI: one HTTP call per item
Call the API from your own code with one key. Every API has a free plan with a hard monthly limit and paid monthly plans; RapidAPI handles sign-up and billing.