model-lab

A desktop benchmarking environment for comparing local AI models. Run repeatable, deterministic evaluations on your own machine and compare quality, speed, reliability and safety behaviour — nothing leaves your computer.

GitHub

Official source

Start locally with the CLI guide