- Conduid
- Categories
- Scraping
Scraping MCP servers
Scraping MCP servers indexed by Conduid, ranked by trust score. 1.6K live listings from GitHub, npm, PyPI and the official registry, each with a 0–100 score, security checks, and install commands.
Aeo Toolkit
Open-source suite of ten AEO / technical-SEO / AI-visibility tools — a TypeScript monorepo (crawl→parse→score engine + MCP servers + content agents).
Infinity Scraper
High-Performance Dynamic Web Scraping, Headless SPA Rendering & OSINT Intelligence MCP Server for AI Agents.
maccydee/cute-web-scraper
only SQL to keep them out of the context window. 24 tools covering crawls, products, contacts, PDFs and change tracking. MIT, no API key.
Omni Scrape AI
Autonomous multimodal web scraping, motion asset extraction, and background monitoring platform powered by Gemini, OpenAI, and Ollama. Features an AI Copilot, official MCP Server,…
Flights Skill
Free Google Flights API for AI Agents (MCP). Reverse-engineered Protobuf scraper. No API keys required. ✈️
Veda MCP
Caller-agnostic MCP server for public Reddit and web reads — structured JSON from threads, users, rules, and any public URL. No API keys.
Webustler
🌐 Extract clean, LLM-ready markdown from any URL, including Cloudflare-protected sites, with this effective MCP server for web scraping.
Influencer Brand Safety Intelligence MCP
Influencer brand safety screening for AI agents and brand teams — this MCP server delivers automated creator vetting, controversy risk analysis, audience authenticity scoring, and…
Autonomous Cyber Red Team MCP
Autonomous cyber red team intelligence for AI agents — this MCP server gives Claude, GPT-4o, and any MCP-compatible agent the ability to run quantitative attack simulations, synth…
Bluefield
Local first web scraper that turns any URL into clean Markdown or JSON and signs every capture with an offline verifiable Ed25519 provenance manifest called BPM. Git like history…
Advisorsai Check
Lists which machine-readable basics a public page declares, and which it does not. One command, no API key, no account; also a read-only MCP tool.
Anti Bot
Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls. 🕷️ An adaptive Web…
User SWeb Agent MCP
An AI-native browser control layer that turns your existing web session into a programmable interface—enabling agents to navigate, interact, and complete real-world tasks directly…
Reddit Lyr
Reddit MCP server — 56 tools for full Reddit automation via browser cookies + Chrome TLS impersonation
Web Snapshot
MCP server and CLI that turn any web page into clean, readable markdown for LLM agents.
Sats402 Firecrawl
SATS-402 wrapper for Lightning-gated Firecrawl MCP/API response delivery.
Web Agent
Local-first web & desktop automation toolkit: browser automation, video transcription, local OCR & VLM vision, desktop control — 数据全部本地处理，零上传
Bedrock
Verified self-healing web scrapers. Every AI repair is tested against golden fixtures before it ships, and every row carries a provenance receipt with its full heal lineage. Built…
Job Scraper MCP Server
Self-hosted FastMCP server that aggregates tech jobs across India and remote platforms for Gemini Spark. Queries LinkedIn, Indeed, Adzuna, Jooble, and Himalayas. Cleans HTML…
Awesome AI Browser Agents
A curated list of tools, frameworks, and resources for building AI-powered browser agents. Includes cloud browsers, automation frameworks, and MCP integrations.
Naukri MCP
A local MCP server that lets Claude search Naukri.com jobs via the Apify scraper. Two tools: naukri_search_jobs and naukri_get_job_details.
Apify Crunchbase Company API
Python quick-start and MCP install guides for the Crunchbase Company API on Apify: collect firmographics, funding, and investor data as structured JSON.
Apify Workday Careers API
workday api: Python + MCP quick-start for the Workday Careers API on Apify. Call it from Python (uv) or as an MCP tool in Claude and Cursor. Returns structured JSON for workday ap…
Apify Workday Career Sites API
companies using workday: Python + MCP quick-start for the Workday Career Sites API on Apify. Call it from Python (uv) or as an MCP tool in Claude and Cursor. Returns structured JS…
Hypersolutions Codex
Codex plugin for the Hyper Solutions anti-bot API: integrate and debug request-based scrapers for Akamai, Incapsula, DataDome, and Kasada, with live request-capture (powhttp) and…
Crawlinx MCP
Free technical-SEO audit MCP server for AI agents — crawl, 77 checks, LLM-ready reports. Hosted at crawlinx.com, no signup/API key.
Markdown Fetcher MCP
HTML to Markdown Converter MCP Server 2026 - Web Scraper & Clean Markdown Generator
Free Seo MCP
Free keyword research MCP server for Claude and Cursor. Pulls autocomplete, Google Trends, Bing search volume, Reddit threads and competitor sitemaps with no paid API.
Similarweb Scraper Public
Extract website traffic, global rank, country rank, bounce rate, visit duration, and traffic sources from Similarweb. Try out out now on Apify.
Google News Monitor API
Monitor Google News by topic or brand as structured data for AI agents, alerts, and market research. No paid news API. MCP ready.
Websight API
AI-Native Web Intelligence API - extract everything from any URL in one call
Azure MCP Remote Firecrawl
POC for exposing Firecrawl Remote MCP through Azure API Management and API Center
Creatorcrawl Skill
Agent Skill for CreatorCrawl: teach Claude, Cursor, Codex, and 40+ AI agents how to research and extract social media data from TikTok, Instagram, YouTube, LinkedIn, Twitter, and…
Crawl4ai Local
Crawl4ai local MCP server
Adversarial Geopolitical Equilibrium MCP
Adversarial geopolitical equilibrium analysis for AI agents via the Model Context Protocol.
Crawl4ai Local For Windows
Crawl4ai local MCP server for Windows(no WSL)
Ox Browser
Self-hosted web data extraction in Rust: LLM-ready content extraction, SPA recovery via sandboxed JS, robots-aware crawler, extraction quality gates, browser TLS fingerprinting an…
Monocrawl MCP
Monocrawl MCP server and agent skill: live public data from 70+ platforms for AI agents
CSA Obsidian
Python browser automation with Camoufox, session persistence and a 17-tool MCP server. CLI and Python API for authorized QA, accessibility and agent evaluation.
Arkpilot
ZCode plugin that drives HarmonyOS NEXT (ArkTS) development via 30 MCP tools — env check, build, device, UI automation, ArkTS scaffolding, and AppGallery app metadata scraping.
AI Audit Docker
Self-hosted Docker container for AI & GEO Readiness Audit Tool (Next.js + Ubuntu 26.04 + Nginx)
Seoforge
Screaming Frog-grade SEO/AEO crawler, site audit engine & Model Context Protocol (MCP) server
Browser Automation Extension
Browser Bridge — Control your real Chrome from any AI agent. 185 commands, MCP server, smart caching, session profiles, stealth mode. Zero auth friction.
Synoppy MCP
Synoppy MCP server — give your AI agent the whole web. Read, crawl, map, extract, classify & enrich live pages from Claude, Cursor, or any MCP client.
Testmu Browser Agent Public
AI-native browser automation CLI and MCP server for Chrome. 90+ commands. Works with Claude Code, Cursor, Copilot, and 6 more.
Claude Skill Remote Startup Jobs
Agent skill: pull live remote startup jobs from Wellfound as structured rows, with salary and equity parsed into numbers.
SEO Workflow
Evidence-bound SEO and agent-readiness workflow for scanning live sites and producing validated remediation reports.
Lead Gen Playbooks
30 industry and scenario playbooks for building lead lists - where the leads live, how to qualify them, and a runnable ManyPI lead-search brief for each.
Historical Investigator MCP
TypeScript MCP server that integrates with the Library of Congress API, enabling AI assistants to search historical newspapers, maps, photographs, manuscripts, OCR text, and archi…
Linkedin Profile Manager MCP
Local-first MCP server to audit, draft, and plan LinkedIn profile improvements — human-in-the-loop, official API only, no scraping or automation