llm-visuals

Live truecolor terminal dashboard for a locally running LLM: tok/s, TTFT, GPUs, context, MTP acceptance, layer and real expert routing (llama.cpp)

GitHub

Official source

Start locally with the CLI guide

Back to catalog
My interests내 관심 주제

Tools

Sort

Loading catalog…카탈로그를 불러오는 중…