Tag
16 posts tagged #web-scraping
Browse 16 posts tagged Web Scraping, including practical setup notes, reviews, comparisons, and workflow patterns for engineers working with AI tools.
TinyFish runs hundreds of browser sessions simultaneously with a serverless architecture, scoring 82% on Mind2Web hard tasks against OpenAI Operator 43%.
One API to scrape the web into clean Markdown, crawl entire sites, and extract structured brand data. YC S26.
Native Rust single-binary web scraper outputting clean Markdown and structured JSON. Firecrawl-compatible API, built-in MCP server, V8-based SPA hydration — no headless Chrome fleet.
Orchestra is a desktop studio for browser automation and web scraping. Build flows visually, watch them run live, and export plain Playwright code you own outright.
Open-source web scraper that outputs clean LLM-ready Markdown with structured JSON, MCP server, and Docker support. 74K GitHub stars.
One REST API to scrape, crawl, extract structured data, screenshot, and identify brands from any URL. Free tier included. Built for AI agents.
A fast REST API for screenshots, PDFs, web scraping, and content extraction built with Fastify and Playwright. Free tier: 200 requests/month with Go SDK and MCP server.
A desktop studio for browser automation and web scraping. Build flows visually, watch them run live, and export plain Playwright code you own forever.
Simplex provides API-first browser automation infrastructure — headless browsers, proxies, and captcha solving without managing your own browser fleet. YC S24.
Open-source web scraping API that converts any URL into clean Markdown or structured data for AI agents. Supports search, scrape, crawl, and map endpoints with LLM-ready output.
Crawlee is an Apify-built open-source web scraping library that handles bot detection, proxy rotation and headless browsers so you focus on data extraction.
Spidra is a no-code AI web scraping platform. Point at any URL, describe what you want in plain text, and get structured data back - no CSS selectors, no proxy management.
MrScraper is visual web scraping platform with built-in proxies, headless browsers, and AI extraction. A no-code workflow for getting clean data from any site at scale.
API Parrot automatically reverse engineers HTTP APIs by tracing data correlations between requests, building visual flow diagrams, and exporting runnable.
Hyperbrowser spins up hundreds of headless browser sessions in secure isolated environments with sub-second launch times, captcha solving, and residential.
Cloud browsers built for AI agents that need to navigate, scrape, and interact with the web at scale. Handles proxies, stealth detection, and concurrent.