About io.github.nolindnaidoo/scrape-le
io.github.nolindnaidoo/scrape-le is an MCP server in the Scraping category: analyse robots.txt content and report whether a path may be crawled.
Install
claude mcp add io-github-nolindnaidoo-scrape-le -- npx -y scrape-le-mcpnpx -y scrape-le-mcpThis server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.
Ask AI
Ask AI about io.github.nolindnaidoo/scrape-le
Powered by Claude · Grounded in docs
Security checks
6 checks have not been run yet.