inferwatch

Real-time and historical metrics for locally served LLMs (Ollama and vLLM) — dashboard, HTTP API and MCP server. One process, one SQLite file, never in the request path.

GitHub

Official source

Start locally with the CLI guide