1. Conduid
  2. Scraping
  3. Better Crawler4agent
MCP server · Scraping

Better Crawler4agent

by · github.com/TC635807/better-crawler4agent

When I was using agents, I found that most agents rely on curl commands to scrape web pages, which has a very low success rate and is slow, so I made this.

Unclaimed crawlerdshdsh-pluginmcpplaywrighturl-to-text
InstallView source
34Low

Scored 14 days ago · breakdown

About Better Crawler4agent

Better Crawler4agent is an MCP server published by TC635807 in the Scraping category: when I was using agents, I found that most agents rely on curl commands to scrape web pages, which has a very low success rate and is slow, so I made this.

The repository has 2 stars and 0 forks.

Install

From source
git clone https://github.com/TC635807/better-crawler4agent

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Ask AI

✦

Ask AI about Better Crawler4agent

Powered by Claude · Grounded in docs

I know everything about Better Crawler4agent. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Better Crawler4agent

How do I install Better Crawler4agent?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Better Crawler4agent safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Better Crawler4agent still maintained?

Conduid hasn't recorded a commit date for this repository yet. Check the repository directly for recent activity.