1. Conduid
  2. Marketplace
  3. #web-scraping
Tag

MCP servers tagged web-scraping

501 live MCP servers tagged "web-scraping", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with web-scraping.

501
live servers
37
avg trust
99K
most stars
251

Agent Plugins

OfficialSpicrawl

Web scraping plugins for AI coding agents (Claude Code, Cursor, Codex, Gemini CLI, OpenCode, Copilot CLI, Factory Droid, Devin) and Dify: the Spicrawl MCP server, packaged. URLs t…

★ 1updated 2 days ago
34
252

Webctl

Thatgfsj

给 AI agent 用的网页控制层:纯 Rust 单静态二进制,零外部进程、零浏览器,内置取回/解析/会话/文档能力,提供 CLI 与 MCP server。

★ 1updated 21 hours ago
34
253

Unibrowse

🤨 Advanced browser automation plugin for Claude Code with 5 specialized sub-agents, 57+ macros, and intelligent delegation for web scraping, form filling, e-commerce automation, a…

34
254

Firecrawl Power App

Powerful web UI for Firecrawl API + MCP Server docs. Scrape, Crawl, Map, Search, Extract & AI Agent. Built with React 18 + Vite + Claude Code.

34
255

Urltomarkdown MCP

MCP server for converting URLs and HTML to clean Markdown

34
256

Md Succ AI

URL to Markdown API — md.succ.ai

34
257

LlmsTxtKit

A C#/.NET MCP (Model Context Protocol) server and library that implements llms.txt-aware content retrieval, validation, and caching for AI agent systems.

34
258

MikkoParkkola/nab

fingerprinting, browser cookie auth, and 1Password integration. Fetches any URL as clean Markdown for AI context.

34
259

Pinchtab MCP Wrapper

Token-efficient browser automation MCP server for AI agents. Web scraping, monitoring & testing with 12x cost savings vs traditional browsers.

34
260

LeonTing1010/tap

in Chrome, and detects drift via semantic fingerprint diff when sites change. 65+ open community taps on 40+ sites.

34
261

nangman-infra/touch-browser

page session synthesis via MCP.

34
262

Deepspider

智能爬虫工程平台 - 基于 DeepAgents + Patchright 的 AI 爬虫 Agent | Intelligent Web Scraping Platform - AI-powered Crawler Agent built on DeepAgents + Patchright

34
263

Novada Proxy

Residential proxy MCP server for AI agents — bypass Cloudflare/Akamai, geo-target 195+ countries, sticky sessions, Google search. Works with Claude, Cursor, Windsurf. Multi-provid…

34
264

hshintelligence/agent-scrape

just USDC. HTTP + MCP transports.

34
265

Agentic Toolbox MCP

FastMCP gateway for homelab agentic tools: search, fetch (Crawl4AI + Camoufox stealth), doc/PDF/video ingestion, GPU Whisper STT. One endpoint, every agent benefits.

34
266

Purify

Single-binary web scraper for AI agents. Headless Chrome + Readability → clean Markdown. Up to 99% token savings. Zero dependencies. Built-in MCP server.

34
267

Fetchium

Rust-native universal retrieval layer for humans and AI agents — search, extract, rank, and synthesize the web. CLI + REST API + MCP server, with adaptive extraction (CEP), token-…

34
268

Atria Browser Bridge

Give any AI agent eyes and hands in your real, logged-in Chrome — via MCP. Zero dependencies.

34
269

Obscura Plugin

MCP server for Obscura headless browser — CLI wrapper for AI agent integration with web scraping, JavaScript rendering, and browser automation

34
270

Shantycrawl MCP

A lean MCP server for Firecrawl with lazy-loading tool architecture to drastically reduce context token consumption.

34
271

Wikipedia Agent

Query Wikipedia ZIM archives offline with a hybrid RAG system using Llama.cpp. Build local indexes for private, internet-free knowledge retrieval.

34
272

Quimera AI

A Chrome browser shared in real time between you and Claude Code (CDP + Playwright MCP): you clear the captchas/logins, Claude operates and learns each site's navigation. Frugal,…

34
273

Cockroach Crawler

Give AI agents bounded eyes on the public web: crawl, search, and normalize evidence without an unrestricted browser.

34
274

Dompruner MCP

MCP server — 97–99% HTML token reduction via DOM AST extraction. No API key, no Vector DB.

34
275

Rednote Analyzer MCP

MCP server for RedNote (Xiaohongshu) — analyze content, comments, and trends with structured tools for LLM workflows.

34
276

SeekMoney AI

🔍 Discover user pain points on social media with AI-driven clustering and analysis for targeted business opportunities and product ideas.

34
277

WebScraperToolkit

AI-first web scraping engine with stealth bypass, MCP server, and multimodal output (Markdown, JSON, PDF) for agents and automation.

34
278

Tiktok Shop Scraper

TikTok Shop Affiliate Scraper. Find creators promoting any product with verified data (product name, price, sales, creator followers). Apify actor.

34
279

BlackHole

MCP servers for AI agents — Google Maps lead gen, SERP scraper, LinkedIn scraper, CAPTCHA solver, UAE real estate. Free, open-source, no API keys needed.

34
280

Browserbro

Turn any website into an API with BrowserBro.

34
281

Scrapo

AI-native, agent-first web scraping for Python. Cost-aware tiered fetching (HTTP, browser, stealth, agent), model-agnostic LLM extraction with self-healing selector caches, API-fi…

34
282

Source Radar

给 AI 用的可审计信息采集引擎。SearXNG 元搜索聚合、MCP Server、证据卡、自适应质量评估。支持中文互联网搜索、抓取、社区采集。

34
283

Ksei

Unofficial MCP server for AKSes KSEI (akses.ksei.co.id) portfolio data

34
284

Web Agent Comparison

Reproducible 8-dimension benchmark of 7 browser-automation MCP servers (Playwright, Lightpanda, browser-use, Chrome DevTools, Firecrawl, Cloakbrowser, Obscura) against frozen loop…

34
285

Deep Search MCP

Advanced MCP server for deep web research: combines Brave Search with page fetching and readability extraction into a single tool.

34
286

Webharvest

Self-hosted web scraper — convert any URL to agent-friendly markdown/JSON. Anti-bot bypass + autonomous browser agents. Free alternative to Firecrawl.

34
287

Google Maps Scraper MCP

Google Maps Scraper MCP — search businesses, extract reviews, emails, contacts and lead data from Google Maps inside any MCP agent. B2B lead gen, local SEO, competitor research.

34
288

Webmirage

网蜃楼 — MCP 服务器,用浏览器 Cookie + TLS 指纹模拟,让 AI 直接调平台内部 API。支持 Twitter、Reddit、雪球、闲鱼,24 个工具,零 API 费用。

34
289

PageKit

Free Web Search, Web Fetch & Browser Automation for AI Agents — powered by spare Android devices. No API key, no usage fees.

34
290

Lookacrawler

Free, open-source, token-efficient local alternative to Firecrawl with native MCP Server for LLMs (>73% token reduction).

34
291

Trafilatura MCP

Trafilatura MCP Server

34
292

My Obscura MCP

Obscura 헤드리스 브라우저 엔진을 활용한 개인 MCP 서버 — Claude Desktop 연동용

34
293

Fetchr

An open-source HTTP client with browser TLS fingerprinting (JA3/JA4, HTTP/2, QUIC) — a CLI, an MCP server that gives Claude Desktop & Claude Code real HTTP access, and an importab…

34
294

NeuralScraper

Web scraping, analysis & content extraction for AI agents.

34
295

Telegram Channel Scraper

Telegram Channel Scraper - No API Key or Phone Needed. Scrape public Telegram channels for messages, media, and engagement data.

34
296

Google Images API

Python + MCP quick-start for the Google Images API on Apify: bulk image search returning clean JSON.

34
297

NutriSastho AI

NutriShastho AI is a Bangladesh-focused health and nutrition assistant built by 99BugsInCode. It connects household food budget, Bangladeshi meal planning, basic health monitoring…

34
298

Playwright Web Fetcher

Deploy a real browser to the cloud. AI-agent ready web fetching API — bypass Cloudflare, get clean content, persist sessions. curl-friendly, self-hosted, Docker-ready.

34
299

Unified Fetch

Multi-engine web search & scraping MCP server — 4 search engines, 6 scrape engines, tiered fallback, zero API keys

34
300

Stalin

☭ Turn any website into a self-healing, typed JSON API — even parameterized lookups (GET /v1/x?q=…). Local-first, MCP-native. Your scraper never breaks.

34
← Previous Page 6 of 11 Next →