phantom

"We don't promise 70B real-time chat on an SSD because physics says no. We give you real 13 tok/s on 30B MoE and 3.5 tok/s on 32B coding models on an everyday 6GB laptop—no hype, no crashes, just real engineering."

GitHub

Official source

Start locally with the CLI guide