1. Conduid
  2. Scraping
  3. Crawlie
MCP server · Scraping

Crawlie

· github.com/spronta/crawlie

Scan websites for technical SEO and GEO issues using this local crawler, CLI tool, and MCP server.

Unclaimed aeobeautifulsoupcrawlerelixirelixir-librarygenstagegeomarketing-toolsmcppythonrequestsseleniumseotkinter-gui
InstallView source
44Fair

Scored 6 days ago · breakdown

About Crawlie

Crawlie is an MCP server in the Scraping category: scan websites for technical SEO and GEO issues using this local crawler, CLI tool, and MCP server.

The repository has 1 stars and 0 forks.

Install

From source
git clone https://github.com/spronta/crawlie

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Tools (5)

audit_urlAudit a single page

Parameters not published.

audit_urlsAudit an explicit list of pages

Parameters not published.

crawl_siteCrawl + audit a whole site (SEO + GEO), returns scores, issues, per-page data

Parameters not published.

explain_issueWhy a rule matters + how to fix it

Parameters not published.

list_rulesThe full catalogue of checks

Parameters not published.

Ask AI

✦

Ask AI about Crawlie

Powered by Claude · Grounded in docs

I know everything about Crawlie. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Crawlie

How do I install Crawlie?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Crawlie safe to use with an AI agent?

Its trust score is 44 out of 100 (fair). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Crawlie still maintained?

Conduid hasn't recorded a commit date for this repository yet. Check the repository directly for recent activity.