About MolmoWeb MCP Server
MolmoWeb MCP Server is an MCP server in the Browser category: enables autonomous web automation through Playwright browser control integrated with MolmoWeb's vision model for pixel-level action prediction. Supports end-to-end task execution via an orchestrator LLM that decomposes natural language instructions into browser actions.
Install
git clone https://github.com/ArashNasr/molmoweb-mcpThis server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.
Tools (7)
browser_execute_actionExecute click/type/scroll/press_key/hover/navigate/wait
Parameters not published.
browser_get_page_infoGet current URL and title
Parameters not published.
browser_navigateOpen URL in Playwright browser
Parameters not published.
browser_screenshotCapture JPEG screenshot (returns base64 image)
Parameters not published.
molmoweb_check_statusHealth check for MolmoWeb backend
Parameters not published.
molmoweb_predictAsk MolmoWeb vision model what action to perform
Parameters not published.
run_web_taskFull autonomous agent loop (orchestrator + MolmoWeb + execution)
Parameters not published.
Ask AI
Ask AI about MolmoWeb MCP Server
Powered by Claude · Grounded in docs
Security checks
- ✓README presentThe repository ships documentation.
5 checks have not been run yet.
README
molmoweb-mcp
MCP server that exposes MolmoWeb web automation as tools for Claude (or any MCP client). Uses Playwright for browser control.
Architecture
Claude / MCP Client
↓ stdio (MCP protocol)
molmoweb-mcp (this server)
↓ ↓
Playwright browser MolmoWeb API (localhost:8001)
Tools
| Tool | Description |
|---|---|
molmoweb_check_status |
Health check for MolmoWeb backend |
browser_navigate |
Open URL in Playwright browser |
browser_screenshot |
Capture JPEG screenshot (returns base64 image) |
browser_get_page_info |
Get current URL and title |
browser_execute_action |
Execute click/type/scroll/press_key/hover/navigate/wait |
molmoweb_predict |
Ask MolmoWeb vision model what action to perform |
run_web_task |
Full autonomous agent loop (orchestrator + MolmoWeb + execution) |
Setup
npm install
npx playwright install chromium
Start the MolmoWeb backend
The MolmoWeb vision model must be running at http://127.0.0.1:8001. On Windows with WSL:
# Using the provided script:
run_molmoweb.bat
Configure in Claude Code
Add to your ~/.mcp.json (global) or project .mcp.json:
{
"mcpServers": {
"molmoweb": {
"command": "node",
"args": ["/path/to/molmoweb-mcp/server.js"]
}
}
}
Run standalone
npm start
Orchestrator LLM Support
The run_web_task tool uses an LLM orchestrator to decompose tasks into step-by-step browser actions. Supported providers:
- OpenAI: gpt-4o, gpt-4o-mini, gpt-4-turbo, gpt-4
- Anthropic: claude-opus-4-6, claude-sonnet-4-6, claude-haiku-4-5-20251001
- Custom: Any OpenAI-compatible endpoint (e.g., Ollama)
How It Works
- User provides a high-level task (e.g., "Search Google for AI news")
- The orchestrator LLM decomposes it into atomic browser instructions
- MolmoWeb vision model translates each instruction into pixel-level actions
- Playwright executes the actions in a visible Chromium browser
- Loop repeats until the task is complete or max steps reached
License
MIT
README copy captured when this server was indexed; it may lag the repository. The original is authoritative.