- Conduid
- Categories
- Scraping
Scraping MCP servers
Scraping MCP servers indexed by Conduid, ranked by trust score. 1.6K live listings from GitHub, npm, PyPI and the official registry, each with a 0–100 score, security checks, and install commands.
io.tooltrace/mcp-server
Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps
com.see-geo/seegeo
Audit any website for AI visibility: graded report, findings with fixes, AI crawler access check.
Svipall
Read any page past its anti-bot wall, crawl sites, search without an API key, solve captchas locally
io.github.jlucasmcrell/apify-scrapers
Public data extraction MCP tools for Google Maps, SEC EDGAR, Glassdoor, and contractor licenses.
SEO & GEO
Audit a page's SEO and its readiness for AI answer engines: meta, schema, robots, sitemaps, AI bots.
SeleniumBase MCP
Stealthy browser automation, testing, and web-scraping via CDP Mode.
HasData Web Scraping
Fetch any public web page through managed proxies, with optional JS rendering and extraction rules.
io.github.iliasabk/geolint
ESLint for AI search: audits AI-crawler access, llms.txt, schema and citability.
Litescrape
Google, Bing, DuckDuckGo and Google Maps search results, free without an API key.
io.github.NovadaLabs/novada-mcp
Search, extract, crawl, map, research, scrape 16 platforms, browser automation, proxy — one API key.
Crawlio Browser Guide
Companion CLI and read-only MCP server for Crawlio Browser Guide: install the native helper with one command, and let Claude Code or Codex see the browser page the user chose to s…
Apixies Developer API Suite
50 developer utility APIs as tools: SSL, DNS, WHOIS, email checks, HTML to PDF, sitemaps and more.
domscout
domscout browser API as MCP tools: screenshots, Markdown, structured data, page automation, crawls.
io.github.Grubbomatic/crawl-readiness
Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
Web Basics
Web search and URL fetching API with an MCP server
io.github.mrfentmen/commoncrawl-mcp
Use this MCP server to Common Crawl index discovery for historical web captures. Tools include...
OSINT Toolbox
Run Sherlock, Maigret, Holehe, GHunt, theHarvester, SpiderFoot and more OSINT tools locally
Sifthound
Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.
Hubertino: Google Maps leads
Scrape Google Maps business leads (phones, websites, emails, socials) with Hubertino.
proxy-scraper
Free proxies that actually work: verified HTTP/SOCKS proxies, and pages fetched through them
io.github.JvnnDev/seo-webmaster-mcp
Read-only SEO and GEO audits with Google Search Console, Bing, and website crawling.
Siftdog
Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.
SEO Content Machine
Run SEO Content Machine tasks from an MCP client: scraping, crawls, Google Maps, Workspace pages.
Unrendered: AI Crawler Checker
AI crawler checker: shows which page content GPTBot and ClaudeBot can't read without JavaScript.
io.pagerender/pagerender
What search and AI crawlers extract from any public URL. Five of nine tools need no token.
Scrawly MCP Server
MCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes.
Spicrawl
Web scraping to Markdown and structured data, screenshots, batch jobs and browser sessions.
io.github.SeoScoreAPI/seoscoreapi-mcp
SEO audits, AI readability, accessibility, backlinks and score monitoring from SEO Score API.
io.github.77777R7/octocrawl
Web scraper for agents: blocked, empty and wrong pages reported as such, with an Evidence Record.
Atlas Web Compiler & Scraper
Official Model Context Protocol (MCP) server for Atlas - Deterministic Zero-LLM Web Compiler and Scraper for AI Agents
pline.ai
Scrape, crawl, batch-scrape, map, and search the web through the hosted pline.ai API.
io.github.xplormityai/searchdock-cli
Read-only Google Search Console analytics, URL inspection and sitemaps via SearchDock CLI.
polite-crawler
A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.
io.github.redsoukas/402scrape
Fetch a webpage and get clean, agent-ready Markdown. Paid per call via x402 (USDC on Base).
Evascrape
Find business leads with emails from Google Maps, Apollo.io and LinkedIn. Prepaid, API key.
Causabi GEO Optimizer
Audit a site for AI readiness (llms.txt, schema, AI-crawler access) and generate the fixes.
Google Search Console
Google Search Console: 20 read-only tools for Search Analytics, sitemaps and indexing.
MCP Search Console
Multi-account Google Search Console MCP: analytics, URL inspection, sitemaps across named accounts.
Scrapingdog
Model Context Protocol (MCP) server for the Scrapingdog web-scraping and SERP APIs.
web-retrieval-mcp
MCP web search + tiered web fetch for AI agents (Exa, Firecrawl), SSRF-guarded, cross-platform.
HirePulse tools
Apify tools for products, Google ads, company signals, jobs, keywords, SEO and YouTube transcripts.
io.github.ilo415/research
AI research for agents. Company intel, competitor analysis, web scraping, topic dives. Pay via MPP.
smart-web
Web search, direct-URL fetch, crawl, and docs export MCP. smartfetch for URLs.
Google Search Console
Search Console analytics, hourly data, URL inspection and sitemaps, with guards for API quirks.
MCP SEO Auditor
Read-only static SEO audits and bounded crawling for AI agents.
rasterly
Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.
io.github.xsronhou/scrapio-mcp
Fetch, crawl, and search the web: Google, Amazon, Walmart, Booking.com, Agoda, and YouTube data.
Google Search Console MCP
Read-only Google Search Console MCP: Search Analytics, sitemaps, URL inspection. 5 tools.
crawl4ai-mcp-server
A Model Context Protocol server for web crawling using Crawl4ai
gsc-mcp-server
Read-only MCP server for Google Search Console: search performance, URL Inspection, sitemaps and CSV exports.