1. Conduid
  2. Blockchain
  3. Jwrede/llmprobe
MCP server · Blockchain

Jwrede/llmprobe

· github.com/Jwrede/llmprobe

Synthetic monitoring for LLM inference endpoints. Measure TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and local servers (vLLM, SGLang, Ollama). CLI + MCP server with Prometheus and OpenTelemetry export.

Unclaimed anthropicgolangllmllmopsobservabilityopenaiprometheussresynthetic-monitoringvllm
InstallView source
34Low

Scored 4 months ago · breakdown

About Jwrede/llmprobe

Jwrede/llmprobe is an MCP server in the Blockchain category: synthetic monitoring for LLM inference endpoints. Measure TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and local servers (vLLM, SGLang, Ollama). CLI + MCP server with Prometheus and OpenTelemetry export.

Install

From source
git clone https://github.com/Jwrede/llmprobe

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Tools (4)

get_configReturn the full parsed configuration including defaults, providers, models, and thresholds.

Parameters not published.

list_providersList all providers and models in the config file with their thresholds. Use this to discover available models before probing.

Parameters not published.

probe_allProbe all configured endpoints from `probes.yml`. Returns TTFT, latency, throughput, and health status for every model. Accepts an optional `config` parameter for a custom config path.

Parameters not published.

probe_modelProbe a single model without a config file. Requires `provider`, `model`, and `api_key_env`. Supports optional `base_url` for OpenAI-compatible endpoints and optional `label` for display.

Parameters not published.

Ask AI

✦

Ask AI about Jwrede/llmprobe

Powered by Claude · Grounded in docs

I know everything about Jwrede/llmprobe. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Jwrede/llmprobe

How do I install Jwrede/llmprobe?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Jwrede/llmprobe safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Jwrede/llmprobe still maintained?

Conduid hasn't recorded a commit date for this repository yet. Check the repository directly for recent activity.