1. Conduid
  2. Scraping
  3. Web Crawler
MCP server · Scraping

Web Crawler

by · github.com/xiaomaozjj666/web-crawler

Scrapling 风格隐身爬虫库：自适应选择器 · TLS 指纹 HTTP · JS 渲染 · 回调式 Spider 框架（重试/robots/去重/中间件管道）· JS 逆向 Agent · 验证码识别 · MCP 服务 · 本地 Web UI · 授权渗透侦察 · 默认 SSRF 防护

Unclaimed anti-botbrowser-automationcamoufoxcrawlingdata-extractionhttpxllm-agentmcpmodel-context-protocolplaywrightpythonreverse-engineeringscraperspiderssrf-protectionundetectableweb-crawlerweb-scraping
InstallView source
34Low

Scored yesterday · breakdown

About Web Crawler

Web Crawler is an MCP server published by xiaomaozjj666 in the Scraping category: scrapling 风格隐身爬虫库：自适应选择器 · TLS 指纹 HTTP · JS 渲染 · 回调式 Spider 框架（重试/robots/去重/中间件管道）· JS 逆向 Agent · 验证码识别 · MCP 服务 · 本地 Web UI · 授权渗透侦察 · 默认 SSRF 防护.

The repository has 5 stars and 0 forks, with the last commit 3 days ago. Recent commit activity is the strongest signal that reported issues will get attention.

Install

From source
git clone https://github.com/xiaomaozjj666/web-crawler

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Ask AI

✦

Ask AI about Web Crawler

Powered by Claude · Grounded in docs

I know everything about Web Crawler. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Web Crawler

How do I install Web Crawler?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Web Crawler safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Web Crawler still maintained?

Yes — the last commit was 3 days ago. The repository has 5 stars and 0 forks.