1. Conduid
  2. Scraping
  3. CrawlIt
MCP server · Scraping

CrawlIt

by · github.com/FBR65/CrawlIt

A web crawling and conversion system that uses FastAPI and MCP to crawl websites and convert them into markdown.

Unclaimed apiconversionfastapimarkdownmcpplaywrightscrapingweb-crawler
InstallView source
34Low

Scored 20 days ago · breakdown

About CrawlIt

CrawlIt is an MCP server published by FBR65 in the Scraping category: a web crawling and conversion system that uses FastAPI and MCP to crawl websites and convert them into markdown.

Install

From source
git clone https://github.com/FBR65/CrawlIt

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Ask AI

✦

Ask AI about CrawlIt

Powered by Claude · Grounded in docs

I know everything about CrawlIt. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About CrawlIt

How do I install CrawlIt?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is CrawlIt safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is CrawlIt still maintained?

Conduid hasn't recorded a commit date for this repository yet. Check the repository directly for recent activity.