1. Conduid
  2. Documentation
  3. doc-scraper
MCP server · Documentation

doc-scraper

by · github.com/Sriram-PR/doc-scraper

Crawl documentation sites into local corpora agents can search, read, and diff fully offline.

Unclaimed docs
InstallView source
34Low

Scored a month ago · breakdown

About doc-scraper

doc-scraper is an MCP server published by Sriram-PR in the Documentation category: crawl documentation sites into local corpora agents can search, read, and diff fully offline.

The repository has 107 stars and 17 forks, with the last commit 9 hours ago. Recent commit activity is the strongest signal that reported issues will get attention.

Install

From source
git clone https://github.com/Sriram-PR/doc-scraper

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Tools (11)

cancel_crawlCancel a running or pending crawl job by job ID

Parameters not published.

crawl_siteStart a background crawl for a site (returns job ID)

Parameters not published.

describe_serverOrientation manifest: server identity + sites + recent jobs in one call (call this first)

Parameters not published.

diff_crawlReport pages added, removed, or changed since a given timestamp

Parameters not published.

get_freshnessReport how stale a site's latest crawl is, from the crawl-history index

Parameters not published.

get_job_statusCheck the status of a background crawl job

Parameters not published.

get_pageFetch a single URL live over the network and return content as markdown

Parameters not published.

list_pagesEnumerate crawled pages for a site (paginated, metadata only)

Parameters not published.

list_sitesList all configured sites from config file

Parameters not published.

read_pageReturn a crawled page's markdown from the stored output, without network access

Parameters not published.

search_docsFull-text search across crawled docs (BM25, stemming, snippets), without network access

Parameters not published.

Ask AI

✦

Ask AI about doc-scraper

Powered by Claude · Grounded in docs

I know everything about doc-scraper. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About doc-scraper

How do I install doc-scraper?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is doc-scraper safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is doc-scraper still maintained?

Yes — the last commit was 9 hours ago. The repository has 107 stars and 17 forks.