- Conduid
- Categories
- Scraping
Scraping MCP servers
Scraping MCP servers indexed by Conduid, ranked by trust score. 1.6K live listings from GitHub, npm, PyPI and the official registry, each with a 0–100 score, security checks, and install commands.
Reddit MCP Server
Model Context Protocol server to search, browse and analyze Reddit in real-time via Playwright web scraping.
Server
Web site crawler, analyzer, and reporter CLI
Crawl4AI MCP
Crawl4AI-MCP: A powerful web crawling and content analysis server that combines targeted web scraping with Claude AI processing. Extract insights from specific websites with custo…
MCP
Model Context Protocol (MCP) server for Windsurf integration with image generation and web scraping capabilities.
MCP
Official MCP server for UnblockingAPI — fetch bot-protected pages and run structured web searches from Claude, Cursor and other AI agents.
Search Stack
Self-hosted search & fetch API with MCP integration — multi-provider (Tavily/Serper/SearXNG), cookie management, TikHub social media, Firecrawl-compatible
Web Scraper
An intelligent MCP Web Scraper that support Consent Dialog Handling and MCP Playwright
Crawl4ai MCP Server
Minimal MCP server with crawl4ai integration for web content extraction
Web Search MCP Server
A Docker-ready MCP server with SearXNG and crawl4ai for LLM web access capabilities.
Agent Browser MCP
A Model Context Protocol (MCP) server wrapping agent-browser CLI, exposing 70+ browser automation tools over Streamable-HTTP transport. Docker-native, headless Chrome, bearer toke…
Webaudits MCP
Official Model Context Protocol (MCP) server for WebAudits.pro: real-time Core Web Vitals (LCP) telemetry, DOM bloat analysis, and AI search crawler (GEO) readiness audits.
Discord MCP
Self-hosted MCP server: full Discord account access for AI assistants, plus a paced archival scraper
Crawl4ai
MCP server implementation for crawl4ai (100% free and opensource)
Spider MCP
Model Context Protocol server for Spider Cloud web scraping API - LinkedIn profiles, anti-bot bypass, and more
Web Search MCP
A comprehensive Model Context Protocol (MCP) server that provides intelligent web search and content extraction capabilities using SearXNG, Trafilatura, and Redis caching.
Seo MCP
MCP server for technical & on-page SEO audits — crawlability, HTTPS, Core Web Vitals, sitemap, robots.txt, structured data, and AI-crawler access
Agent Plugins
Web scraping plugins for AI coding agents (Claude Code, Cursor, Codex, Gemini CLI, OpenCode, Copilot CLI, Factory Droid, Devin) and Dify: the Spicrawl MCP server, packaged. URLs t…
Claude MCP Setup
Claude MCP connector setup for Playwright, Composio, Firecrawl, and Perplexity.
Voice Agent
This project implements a voice agent that combines web search capabilities via Firecrawl with Supabase database operations through MCP (Model Context Protocol).
Finance MCP
💵 Model Context Protocol(MCP) for finance teams.
Research Agent
Strands-based Research Agent using the Firecrawl MCP Server
Firecrawl MCP Server
Apify actor: firecrawl-mcp-server
Edookit Legacy MCP
MCP server for the Edookit parent/student portal (web scraping)
Crawlie
Scan websites for technical SEO and GEO issues using this local crawler, CLI tool, and MCP server.
Webctl
给 AI agent 用的网页控制层：纯 Rust 单静态二进制，零外部进程、零浏览器，内置取回/解析/会话/文档能力，提供 CLI 与 MCP server。
Tavily MCP
Production ready MCP server with real-time search, extract, map & crawl.
ai.exa/exa
Fast, intelligent web search and web crawling. New mcp tool: Exa-code is a context tool for coding
ai.smithery/BadRooBot-test_m
Send quick greetings, scrape website content, and generate text or images on demand. Perform web s…
ai.smithery/ScrapeGraphAI-scrapegraph-mcp
Enable language models to perform advanced AI-powered web scraping with enterprise-grade reliabili…
ai.smithery/blacklotusdev8-test_m
Greet anyone by name with a friendly hello. Scrape webpages to extract content for quick reference…
ai.smithery/oxylabs-oxylabs-mcp
Fetch and process content from specified URLs using the Oxylabs Web Scraper API.
com.apify/apify-mcp-server
Apify MCP Server providing access to thousands of web scraping and automation tools from Apify Store
io.github.Crawleo/Crawleo-MCP
Hosted Crawleo MCP (remote streamable HTTP endpoint).
ShadowCrawl
Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.
io.github.lvpiggyqq/xcatcher
Remote MCP for X/Twitter crawling and XLSX export.
io.github.schemacrawler/schemacrawler-ai
Enables natural language schema queries — explore tables, keys, procedures, and get SQL help fast
CRW Web Scraper
Open-source web scraper for AI agents with scrape, crawl, and map tools
SparkForge — 20+ Utility APIs with x402 Micropayments
20+ pay-per-use APIs: image gen, crypto data, email verify, SSL check, web scraping, and more.
Greg.Xrm.Mcp.AppMaker
A Model Context Protocol (MCP) server for Microsoft Dataverse that enables AI-powered development of forms, views, apps, and sitemaps.
DuckDuckGo & Felo AI Search
Provide fast, privacy-friendly web and AI-powered search capabilities with integrated content and metadata extraction. Enhance your AI assistants by enabling comprehensive web scr…
Firecrawl Web Scraping Server
Enable advanced web scraping, crawling, and content extraction capabilities for your agents. Perform deep research, batch scraping, and structured data extraction with automatic r…
mcp-crew-risk
This framework aims to provide crawler developers and operators with a comprehensive automated compliance detection toolset to evaluate the crawler-friendliness and potential risk…
Tv MCP
A high-performance FastMCP server for programmatically scraping TradingView market data. The server provides unified endpoints for retrieving historical price data, computing tech…
Firecrawl MCP Zed
Firecrawl MCP Server for Zed
Remote MCP Server Authless Scrape And Analyze Website
Analyze and ask questions about an input website using this Cloudflare MCP server
Siteone MCP Server
MCP (Model Context Protocol) server written in TypeScript that wraps the SiteOne Crawler CLI.
Smippo
Command-line website copier and scraper. Create complete offline mirrors with all assets, styles, and dynamic content preserved. Perfect for website duplication, archiving, and of…
Unibrowse
🤨 Advanced browser automation plugin for Claude Code with 5 specialized sub-agents, 57+ macros, and intelligent delegation for web scraping, form filling, e-commerce automation, a…
Shop Server
An MCP server to help you shop online by letting your AI model find the best deals for you.
Firecrawl Power App
Powerful web UI for Firecrawl API + MCP Server docs. Scrape, Crawl, Map, Search, Extract & AI Agent. Built with React 18 + Vite + Claude Code.