- Conduid
- Marketplace
- #web-crawler
MCP servers tagged web-crawler
13 live MCP servers tagged "web-crawler", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with web-crawler.
Webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Firecrawl MCP Server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Linkinator
Broken link checker that crawls websites and validates links. Find broken links, dead links, and invalid URLs in websites, documentation, and local files. Perfect for SEO audits a…
Scrapfly MCP
🚀 Official Scrapfly MCP Server - brings enterprise-grade web scraping, extraction, and anti-bot–aware data access to Cursor, Claude, and any MCP-compatible LLM client.
0xMassi/webclaw
configures Claude, Cursor, Windsurf, Codex, OpenCode.
Crawl4ai MCP
Web crawling tool that integrates with AI assistants via the MCP
web-content-pick
A tool for extracting structured content from web pages with customizable selectors and crawling options
Web Scrape
🚀 mcp-web-scrape — Clean, cache-aware web content fetcher for AI agents. Fetch any URL → extract readable content → return Markdown/JSON with citations. ⚡ Fast caching, 🤝 robots.t…
Crawlforge MCP Server
CrawlForge MCP Server - Professional Model Context Protocol server with 19 comprehensive web scraping, crawling, and content processing tools.
Docs To MCP Server
MCP server that exposes documentation search tools for AI assistants
Turbo Surf
Native-speed, browserless web crawler + MCP server for AI agents. A standalone Rust engine (turbo-dom + a V8 JS-render tier) — fetch + parse + extract + run page JS with no headle…
Free Opensource SEO Screaming Toad Not Frog Tool With 100million Url Crawl Potential
DJAI Academy community-built, free open-source technical SEO crawler and Screaming Frog alternative with JavaScript audits, reports, a local dashboard, and an MCP server for AI ag…
Cockroach Crawler
Give AI agents bounded eyes on the public web: crawl, search, and normalize evidence without an unrestricted browser.