FastLocalExperts

FLE – Fast Local Experts: a llama.cpp fork for large Mixture-of-Experts models. Qwen3.8-Flash-Next (89 GB) at ~90 tokens/s on one 32 GB GPU with an expert cache and MTP speculative decoding. MIT.

GitHub

Official source

Start locally with the CLI guide