- Conduid
- Marketplace
- #scraping
MCP servers tagged scraping
790 live MCP servers tagged "scraping", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with scraping.
io.github.BoxLab-Ltd/yandex-webmaster-mcp
Query Yandex Webmaster indexing, queries, diagnostics and backlinks, and recrawl, via an AI agent.
io.github.GrabzIt/mcp-server
Official GrabzIt MCP server for AI web scraping, screenshots, and PDF/DOCX generation.
CN Scraper MCP
MCP server for AI agents to search major Chinese internet platforms with local-first login support.
Clawifi
Agent-native internet gateway: typed search, fetch, scrape, crawl, and extract via the Clawifi API.
io.github.terradeed/terradeed-mcp-server
TerraDeed MCP server — x402 web scraping & structured extraction. Pay-per-call with USDC on Base.
Prerender Buddy
Local MCP tools for crawler-readability and discovery-file diagnostics.
io.github.BFAI-1/taskfleet-mcp
Pay-per-call MCP tools: web search, scraping, on-chain wallet intel, extraction. x402 USDC on Base.
io.github.houtini-ai/seo-audit-console
Technical SEO audits in Claude: GSC + first-party crawl + DataForSEO. 93 prioritised checks + fixes.
io.github.Mrshahidali420/gsc-indexer-mcp
Search Console for agents: index status, unindexed-URL discovery, Request Indexing, sitemaps.
io.github.nolindnaidoo/scrape-le
Analyse robots.txt content and report whether a path may be crawled.
io.github.smeet666/mcp-libraryofcongress
Search inside scanned US newspapers and browse the Library of Congress catalogue. No API key.
app.crawlio/crawlio-browser
Bridge a live Chrome browser to your agent: 147 CDP tools for capture, extraction, and recording.
Yandex Webmaster MCP
MCP server for Yandex Webmaster API: indexing, search queries, sitemaps, diagnostics, links.
FineData
FineData web scraping MCP — JavaScript rendering, captcha solving, markdown for AI agents
io.github.amati032-dev/crawlbit
Four free tools to check if AI engines can find, read and recognise a site. No API key.
Spiderbrain
Deterministic context layer for your codebase: change impact, blast radius, answers with receipts.
upAPI
All public upAPI operations as MCP tools: web scraping, search, screenshots, PDF, OCR and more.
scrapewright
Give it a store URL, get structured rows. A model writes the parser once; replays are free.
PyreCrawl
One tool for AI agents to scrape, crawl, extract, map, and search the web. Self-hosted, no API keys.
rasterly
Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.
io.github.mrocker/social-data-mcp
X/Twitter, YouTube and TikTok data tools in one stdio MCP server (Apify-hosted). Pay per result.
io.github.quantumproxies/quanticdata-mcp
Web data for AI agents: scraping, SERP, crawl/map, 74 Collectors, datasets and proxies. 25 tools.
io.github.shufflethis/geo-tool-check
Is this page readable for AI search? Crawler access, structure and citability checks, runs locally.
io.tooltrace/mcp-server
Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps
Seo Auditor
Read-only static SEO audits and bounded crawling for AI agents.
com.see-geo/seegeo
Audit any website for AI visibility: graded report, findings with fixes, AI crawler access check.
Svipall
Read any page past its anti-bot wall, crawl sites, search without an API key, solve captchas locally
io.github.jlucasmcrell/apify-scrapers
Public data extraction MCP tools for Google Maps, SEC EDGAR, Glassdoor, and contractor licenses.
SEO & GEO
Audit a page's SEO and its readiness for AI answer engines: meta, schema, robots, sitemaps, AI bots.
SeleniumBase MCP
Stealthy browser automation, testing, and web-scraping via CDP Mode.
HasData Web Scraping
Fetch any public web page through managed proxies, with optional JS rendering and extraction rules.
io.github.iliasabk/geolint
ESLint for AI search: audits AI-crawler access, llms.txt, schema and citability.
Litescrape
Google, Bing, DuckDuckGo and Google Maps search results, free without an API key.
io.github.NovadaLabs/novada-mcp
Search, extract, crawl, map, research, scrape 16 platforms, browser automation, proxy — one API key.
Apixies Developer API Suite
50 developer utility APIs as tools: SSL, DNS, WHOIS, email checks, HTML to PDF, sitemaps and more.
domscout
domscout browser API as MCP tools: screenshots, Markdown, structured data, page automation, crawls.
io.github.Grubbomatic/crawl-readiness
Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
io.github.mrfentmen/commoncrawl-mcp
Use this MCP server to Common Crawl index discovery for historical web captures. Tools include...
OSINT Toolbox
Run Sherlock, Maigret, Holehe, GHunt, theHarvester, SpiderFoot and more OSINT tools locally
Sifthound
Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.
Hubertino: Google Maps leads
Scrape Google Maps business leads (phones, websites, emails, socials) with Hubertino.
proxy-scraper
Free proxies that actually work: verified HTTP/SOCKS proxies, and pages fetched through them
io.github.JvnnDev/seo-webmaster-mcp
Read-only SEO and GEO audits with Google Search Console, Bing, and website crawling.
Siftdog
Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.
SEO Content Machine
Run SEO Content Machine tasks from an MCP client: scraping, crawls, Google Maps, Workspace pages.
Unrendered: AI Crawler Checker
AI crawler checker: shows which page content GPTBot and ClaudeBot can't read without JavaScript.
io.pagerender/pagerender
What search and AI crawlers extract from any public URL. Five of nine tools need no token.
Scrawly MCP Server
MCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes.
Spicrawl
Web scraping to Markdown and structured data, screenshots, batch jobs and browser sessions.
io.github.SeoScoreAPI/seoscoreapi-mcp
SEO audits, AI readability, accessibility, backlinks and score monitoring from SEO Score API.