1. Conduid
  2. Scraping
  3. Site Crawler MCP
MCP server · Scraping

Site Crawler MCP

by · github.com/coolaigit/site-crawler-mcp

Site-wide crawler MCP server: BFS crawl of all internal links with time/title/URL filters, page operations (summarize/click/download), SQLite persistence. Built on crawl4ai.

Unclaimed crawl4aicrawlermcpweb-scraping
InstallView source
34Low

Scored 21 days ago · breakdown

About Site Crawler MCP

Site Crawler MCP is an MCP server published by coolaigit in the Scraping category: site-wide crawler MCP server: BFS crawl of all internal links with time/title/URL filters, page operations (summarize/click/download), SQLite persistence. Built on crawl4ai.

Install

From source
git clone https://github.com/coolaigit/site-crawler-mcp

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Ask AI

✦

Ask AI about Site Crawler MCP

Powered by Claude · Grounded in docs

I know everything about Site Crawler MCP. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Site Crawler MCP

How do I install Site Crawler MCP?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Site Crawler MCP safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Site Crawler MCP still maintained?

Conduid hasn't recorded a commit date for this repository yet. Check the repository directly for recent activity.