1. Conduid
  2. Scraping
  3. Web Scrape
MCP server ยท Scraping

Web Scrape

ยท github.com/mukul975/mcp-web-scrape

๐Ÿš€ mcp-web-scrape โ€” Clean, cache-aware web content fetcher for AI agents. Fetch any URL โ†’ extract readable content โ†’ return Markdown/JSON with citations. โšก Fast caching, ๐Ÿค robots.txt compliant, ๐Ÿ“ Markdown-ready output, ๏ฟฝ๏ฟฝ works with ChatGPT/Claude Desktop.

Unclaimed agentaiapicachechatgptcitationsclaudecontent-extractionllmmarkdownmcpmodel-context-protocolnodejsscraperssestdiotypescriptweb-crawlerweb-scraping
InstallView source
39Low

Scored 4 months ago ยท breakdown

About Web Scrape

Web Scrape is an MCP server in the Scraping category: ๐Ÿš€ mcp-web-scrape โ€” Clean, cache-aware web content fetcher for AI agents. Fetch any URL โ†’ extract readable content โ†’ return Markdown/JSON with citations. โšก Fast caching, ๐Ÿค robots.txt compliant, ๐Ÿ“ Markdown-ready output, ๏ฟฝ๏ฟฝ works with ChatGPT/Claude Desktop.

Install

From source
git clone https://github.com/mukul975/mcp-web-scrape

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Tools (13)

batch_extractProcess multiple URLs efficiently

Parameters not published.

check_url_statusVerify URL accessibility

Parameters not published.

clear_cacheManage cached content

Parameters not published.

compare_contentCompare two pages for changes

Parameters not published.

extract_contentConvert HTML to clean Markdown with citations

Parameters not published.

extract_imagesExtract images with alt text and dimensions

Parameters not published.

extract_linksGet all links with filtering options

Parameters not published.

extract_structured_dataParse JSON-LD, microdata, RDFa

Parameters not published.

get_cache_statsView cache performance metrics

Parameters not published.

get_page_metadataExtract title, description, author, keywords

Parameters not published.

Show all 13 tools
search_contentSearch within page content

Parameters not published.

summarize_contentAI-powered content summarization

Parameters not published.

validate_robotsCheck robots.txt compliance

Parameters not published.

Ask AI

✦

Ask AI about Web Scrape

Powered by Claude · Grounded in docs

I know everything about Web Scrape. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Web Scrape

How do I install Web Scrape?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Web Scrape safe to use with an AI agent?

Its trust score is 39 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Web Scrape still maintained?

Conduid hasn't recorded a commit date for this repository yet. Check the repository directly for recent activity.