1. Conduid
  2. Scraping
  3. Craw MCP
MCP server · Scraping

Craw MCP

by · github.com/bilginerdem/craw-mcp

Self-hostable MCP server that lets Claude crawl pages blocked by anti-bot walls, JS challenges, or IP bans, without paid scraping APIs. Bring your own proxies. RabbitMQ queue, Rust crawler, MinIO claim-check.

Unclaimed anti-botclaudecrawlermcpminiomodel-context-protocolrabbitmqrustself-hostedweb-scraping
InstallView source
34Low

Scored a month ago · breakdown

About Craw MCP

Craw MCP is an MCP server published by bilginerdem in the Scraping category: self-hostable MCP server that lets Claude crawl pages blocked by anti-bot walls, JS challenges, or IP bans, without paid scraping APIs. Bring your own proxies. RabbitMQ queue, Rust crawler, MinIO claim-check.

The repository has 1 stars and 0 forks, with the last commit 4 months ago. Recent commit activity is the strongest signal that reported issues will get attention.

Install

From source
git clone https://github.com/bilginerdem/craw-mcp

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Tools (3)

crawl_forget`{ job_id }` → deletes content from MinIO and metadata from Redis (manual/early cleanup)

Parameters not published.

crawl_result`{ job_id, max_length? }` → `pending` / page content (from MinIO) / error

Parameters not published.

crawl_url`{ url }` → writes to RabbitMQ, returns `job_id`

Parameters not published.

Ask AI

✦

Ask AI about Craw MCP

Powered by Claude · Grounded in docs

I know everything about Craw MCP. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Craw MCP

How do I install Craw MCP?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Craw MCP safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Craw MCP still maintained?

Yes — the last commit was 4 months ago. The repository has 1 stars and 0 forks.