inferscope

Rust profiler for OpenAI-compatible LLM inference engines. Per-token timing correlated with /proc and NVML on one clock — per-device GPU metrics, NVML energy (tokens/joule), KV-cache hit-rate, per-step attribution on agentic trajectories. Apache-2.0.

GitHub

Official source

Start locally with the CLI guide