1. Conduid
  2. Scraping
  3. io.github.Decodo/mcp-web-scraper
MCP server · Scraping

io.github.Decodo/mcp-web-scraper

Enable your AI agents to scrape and parse web content dynamically, including geo-restricted sites

Unclaimed scraping
37Low

Scored 6 months ago · breakdown

About io.github.Decodo/mcp-web-scraper

io.github.Decodo/mcp-web-scraper is an MCP server published by Decodo in the Scraping category: enable your AI agents to scrape and parse web content dynamically, including geo-restricted sites.

Install

Claude Code
claude mcp add io-github-decodo-mcp-web-scraper -- npx -y @decodo/mcp-server
npx
npx -y @decodo/mcp-server

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Tools (30)

amazon_bestsellersScrapes Amazon Bestsellers list.

Parameters not published.

amazon_pricingScrapes Amazon Product pricing information.

Parameters not published.

amazon_productScrapes Amazon Product page.

Parameters not published.

amazon_searchScrapes Amazon Search for a given query, and returns parsed results.

Parameters not published.

amazon_sellersScrapes Amazon Seller information.

Parameters not published.

bing_searchScrapes Bing Search results.

Parameters not published.

chatgptSearch and interact with ChatGPT for AI-powered responses and conversations.

Parameters not published.

google_adsScrapes Google Ads search results.

Parameters not published.

google_ai_modeScrapes Google AI Mode (Search with AI) results.

Parameters not published.

google_lensScrapes Google Lens image search results.

Parameters not published.

Show all 30 tools
google_searchScrapes Google Search for a given query, and returns parsed results.

Parameters not published.

google_travel_hotelsScrapes Google Travel Hotels search results.

Parameters not published.

perplexitySearch and interact with Perplexity for AI-powered responses and conversations.

Parameters not published.

reddit_postScrapes a specific Reddit post.

Parameters not published.

reddit_subredditScrapes Reddit subreddit results.

Parameters not published.

reddit_userScrapes a Reddit user profile and their posts/comments.

Parameters not published.

scrape_as_markdownScrapes any target URL, expects a URL to be given via prompt. Returns results in Markdown.

Parameters not published.

screenshotCaptures a screenshot of any webpage and returns it as a PNG image.

Parameters not published.

target_productScrapes Target Product page.

Parameters not published.

target_searchScrapes Target Search for a given query, and returns parsed results.

Parameters not published.

tiktok_postScrapes a TikTok post URL for structured data (e.g. engagement, caption, hashtags).

Parameters not published.

tiktok_shop_productScrapes TikTok Shop Product page.

Parameters not published.

tiktok_shop_searchScrapes TikTok Shop Search for a given query, and returns parsed results.

Parameters not published.

tiktok_shop_urlScrapes TikTok Shop page by URL.

Parameters not published.

walmart_productScrapes Walmart Product page.

Parameters not published.

walmart_searchScrapes Walmart Search for a given query, and returns parsed results.

Parameters not published.

youtube_channelScrapes YouTube channel videos.

Parameters not published.

youtube_metadataScrapes YouTube video metadata.

Parameters not published.

youtube_searchSearch YouTube videos.

Parameters not published.

youtube_subtitlesScrapes YouTube video subtitles.

Parameters not published.

Ask AI

✦

Ask AI about io.github.Decodo/mcp-web-scraper

Powered by Claude · Grounded in docs

I know everything about io.github.Decodo/mcp-web-scraper. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

  • ✓README presentThe repository ships documentation.

5 checks have not been run yet.

README

Decodo MCP Server

Install MCP Server smithery badge

This repository provides a Model Context Protocol (MCP) server that connects LLMs and applications to Decodo's platform. The server facilitates integration between MCP-compatible clients and Decodo's services, streamlining access to our tools and capabilities.

Features

  • Easy web data access. Simplified retrieval of information from websites and online sources.
  • Geographic flexibility. Access content regardless of regional restrictions.
  • Enhanced privacy. Browse and collect data while maintaining anonymity.
  • Reliable scraping. Advanced techniques to avoid detection and blocks.
  • Simple integration. Seamless setup with popular MCP clients like Claude Desktop, Cursor, and Windsurf.

Connecting to Decodo's MCP server

  1. Go to decodo.com and start a Web Scraping API plan (free trials available).

  2. Once your plan has started, obtain a Web Scraping API basic authentication token from the dashboard.

  3. Open your preferred MCP client and add the following configuration:

{
  "Decodo": {
    "url": "https://mcp.decodo.com/mcp",
    "headers": {
      "Authorization": "Basic <basic_auth_token>"
    }
  }
}

Running the MCP server locally

Prerequisites

Step-by-step guide

  1. Clone this repository:
git clone https://github.com/Decodo/decodo-mcp-server
  1. Run the following commands in the terminal:
cd decodo-mcp-server
npm install
npm run build
  1. Take note of your build location:
cd build/
pwd

Adding index.js to the end of this directory, your build file location should look something like this:

/Users/your.user/projects/decodo-mcp/build/index.js
  1. Update your MCP client with the server information:

Toolsets

Tools are organized into toolsets. You can selectively enable specific toolsets by passing a comma-separated list via the toolsets query parameter:

    "Decodo MCP Server": {
      "url": "https://mcp.decodo.com/mcp?toolsets=web,ai",
      "headers": {
        "Authorization": "Basic <your_auth_token>"
      }
    }

When no toolsets are specified, all tools are registered.

Toolset Tools
web scrape_as_markdown, screenshot
search google_search_parsed
ecommerce amazon_search_parsed
social_media reddit_post, reddit_subreddit
ai chatgpt, perplexity

Tools

The server exposes the following tools:

Tool Description Example prompt
scrape_as_markdown Scrapes any target URL, expects a URL to be given via prompt. Returns results in Markdown. Scrape peacock.com from a US IP address and tell me the pricing.
screenshot Captures a screenshot of any webpage and returns it as a PNG image. Take a screenshot of github.com from a US IP address.
google_search_parsed Scrapes Google Search for a given query, and returns parsed results. Scrape Google Search for shoes and tell me the top position.
amazon_search_parsed Scrapes Amazon Search for a given query, and returns parsed results. Scrape Amazon Search for toothbrushes.
reddit_post Scrapes a specific Reddit post for a given query, and returns parsed results. Scrape the following Reddit post: https://www.reddit.com/r/horseracing/comments/1nsrn3/
reddit_subreddit Scrapes a specific Reddit subreddit for a given query, and returns parsed results. Scrape the top 5 posts on r/Python this week.
chatgpt Search and interact with ChatGPT for AI-powered responses and conversations. Ask ChatGPT to explain quantum computing in simple terms.
perplexity Search and interact with Perplexity for AI-powered responses and conversations. Ask Perplexity what the latest trends in web development are.

Parameters

The following parameters are inferred from user prompts:

Parameter Description
jsRender Renders target URL in a headless browser.
geo Sets the country from which the request will originate.
locale Sets the locale of the request.
tokenLimit Truncates the response content up to this limit. Useful if the context window is small.
prompt Prompt to send to AI tools (chatgpt, perplexity).
search Activates ChatGPT's web search functionality (chatgpt only).

Examples

Scraping geo-restricted content

Query your AI agent with the following prompt:

Scrape peacock.com from a German IP address and tell me the pricing.

This prompt will say that peacock.com is geo-restricted. To bypass the geo-restriction:

Scrape peacock.com from a US IP address and tell me the pricing.

Limiting number of response tokens

If your agent has a small context window, the content returned from scraping will be automatically truncated, in order to avoid context-overflow. You can increase the number of tokens returned within your prompt:

Scrape hacker news, return 50k tokens.

If your agent has a big context window, tell it to return full content:

Scrape hacker news, return full content.

Related repositories

Web Scraping API

Google Maps scraper

Amazon scraper

License

All code is released under the MIT License.

README copy captured when this server was indexed; it may lag the repository. The original is authoritative.

Questions

About io.github.Decodo/mcp-web-scraper

How do I install io.github.Decodo/mcp-web-scraper?

Run claude mcp add io-github-decodo-mcp-web-scraper -- npx -y @decodo/mcp-server, then add the server to your MCP client's configuration.

Is io.github.Decodo/mcp-web-scraper safe to use with an AI agent?

Its trust score is 37 out of 100 (low). It passes 1 of the 1 static security checks run so far. It has no ConduID identity yet, so agent calls to it are not receipted.

Is io.github.Decodo/mcp-web-scraper still maintained?

Conduid hasn't recorded a commit date for this repository yet. Check the repository directly for recent activity.