dev-tools
Context.dev – Web Scraping API for AI Agents
A YC S26 API that scrapes any URL to clean markdown or structured data, extracts brand logos and colors, and monitors sites for changes.
#web-scraping#api#ai-tools
Tag
Web Scraping Posts for AI Developers
14 posts tagged #web-scraping
Browse 14 posts tagged Web Scraping, including practical setup notes, reviews, comparisons, and workflow patterns for engineers working with AI tools.
All Posts
dev-tools
Context.dev Review – YC S26 Web Data API for AI Agents
One REST API to scrape, crawl, extract structured data, screenshot, and identify brands from any URL. Free tier included. Built for AI agents.
#web-scraping#api#ai-tools
dev-tools
SnapAPI – Screenshot, PDF and Extraction API
A fast REST API for screenshots, PDFs, web scraping, and content extraction built with Fastify and Playwright. Free tier: 200 requests/month with Go SDK and MCP server.
#api#screenshot#pdf
ai-setup
Context.dev - Web Scraping API for AI Agents
Context.dev (YC S26) converts any URL to clean markdown, extracts brand data, and crawls full sites via one REST API with TypeScript and Python SDKs.
#ai-setup#dev-tools#web-scraping
dev-tools
Orchestra - Visual Browser Automation That Exports Plain Playwright
A desktop studio for browser automation and web scraping. Build flows visually, watch them run live, and export plain Playwright code you own forever.
#browser-automation#playwright#web-scraping
dev-tools
Simplex - Browser Automation Built for Developers
Simplex provides API-first browser automation infrastructure — headless browsers, proxies, and captcha solving without managing your own browser fleet. YC S24.
#browser-automation#dev-tools#yc
ai-setup
Firecrawl – Web Data API for AI Agents
Open-source web scraping API that converts any URL into clean Markdown or structured data for AI agents. Supports search, scrape, crawl, and map endpoints with LLM-ready output.
#ai-tools#web-scraping#llm
dev-tools
Crawlee Python - Web Scraping Library Built for Real Use
Crawlee is an Apify-built open-source web scraping library that handles bot detection, proxy rotation and headless browsers so you focus on data extraction.
#python#web-scraping#automation
ai-setup
Spidra - AI Web Scraper That Adapts to Any Website
Spidra is a no-code AI web scraping platform. Point at any URL, describe what you want in plain text, and get structured data back - no CSS selectors, no proxy management.
#ai-setup#web-scraping#dev-tools
ai-setup
Intuned – Build Reliable Browser Automations as Code
Intuned Agent converts natural language prompts into production-ready Playwright code, fixes flows when sites change, and deploys with built-in stealth, scheduling, and auto-scaling.
#browser-automation#playwright#ai-agent
dev-tools
MrScraper - AI Web Scraper With Built-in Proxies
MrScraper is visual web scraping platform with built-in proxies, headless browsers, and AI extraction. A no-code workflow for getting clean data from any site at scale.
#ai-tools#web-scraping#data-extraction
dev-tools
API Parrot – Reverse Engineer Any HTTP API Automatically
API Parrot automatically reverse engineers HTTP APIs by tracing data correlations between requests, building visual flow diagrams, and exporting runnable.
#dev-tools#api#automation
dev-tools
Hyperbrowser – Scalable Browser Infrastructure for AI Agents
Hyperbrowser spins up hundreds of headless browser sessions in secure isolated environments with sub-second launch times, captcha solving, and residential.
#browser-automation#ai-agents#web-scraping
ai-setup
Hyperbrowser – Scalable Browser Infrastructure for AI Agents
Cloud browsers built for AI agents that need to navigate, scrape, and interact with the web at scale. Handles proxies, stealth detection, and concurrent.
#browser-automation#ai-agents#infrastructure