About Crawler
Crawler is an MCP server in the Scraping category.
Install
git clone https://github.com/evinhua/mcp_crawlerThis server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.
Tools (6)
add_server_endpointAdd a new MCP server endpoint to the crawler
Parameters not published.
crawl_all_known_serversCrawl and index all known MCP servers
Parameters not published.
crawl_serverCrawl and index a specific MCP server
Parameters not published.
discover_servers_from_registryDiscover MCP servers from a registry service
Parameters not published.
get_server_detailsGet detailed information about an indexed server
Parameters not published.
search_serversSearch indexed servers by name, description, or capability
Parameters not published.
Ask AI
Ask AI about Crawler
Powered by Claude · Grounded in docs
Security checks
6 checks have not been run yet.