llm-server-benchmark

Reproducible benchmarking for local LLM servers with llama.cpp and vLLM, including GPU telemetry, stress tests, hardware comparison and HTML/PDF/CSV/JSON reports.

GitHub

Official source

Start locally with the CLI guide