otelcol-genai-sketches

Track LLM token usage by user, session and model without a metric label for every user. Prometheus or any OTLP metrics backend.

GitHub

Official source

Start locally with the CLI guide