L

MCP-сервер

llmprobe

Автор: Jwrede · AI и LLM

Описание из исходного каталога

Synthetic monitoring for LLM inference endpoints. Measure TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and local servers (vLLM, SGLang, Ollama). CLI + MCP server with Prometheus and OpenTelemetry export

Категория
AI и LLM