About Interact
Interact is an MCP server in the Browser category: mCP server for browser interaction and desktop window analysis.
Install
git clone https://github.com/AlanBlanchet/interactThis server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.
Tools (11)
get_interactive_elementsList what's clickable as numbered `ref`s — DOM scan in the browser, vision / AT-SPI on the desktop.
Parameters not published.
get_page_stateURL, title, accessibility tree, visible text and the `ref` list. No model call.
Parameters not published.
list_desktop_windowsList drivable targets — monitors, open windows, sandbox windows.
Parameters not published.
measure_uiMeasure deterministically — exact WCAG contrast with AA/AAA, dominant colours, largest uniform band. No VLM, no spend.
Parameters not published.
navigateOpen a URL; returns title + visible text, or a vision answer with `query`.
Parameters not published.
recordRecord a browser or desktop interaction to video, then `query` the video model about the sequence.
Parameters not published.
review_uiFind defects — a severity-sorted critique (contrast, overflow, truncation, misalignment). Pass a `reference` image to judge how a build diverges from a target.
Parameters not published.
run_actionsThe workhorse — click, type, scroll, drag, key-press, `evaluate_js`, batched in one call, each step reporting what changed.
Parameters not published.
screenshotCapture a page, window or screen. Add `query` for an interpretation, `return_image` for raw pixels.
Parameters not published.
transcribeHear a local audio *or* video file — transcript back, or `query` it about the sound.
Parameters not published.
verify_uiAccept against your checklist — one PASS / FAIL / UNCLEAR per literal requirement, each naming the element judged.
Parameters not published.
Ask AI
Ask AI about Interact
Powered by Claude · Grounded in docs
Security checks
6 checks have not been run yet.