crow-nest

Rust + CUDA inference engine for Crow on one RTX 5090: GLM-5.3-Flash, Qwen3.8-Flash-Next (MoE) and the dense Qwen3.8-27B as CNQ containers, own kernels, MTP speculative decoding, vision, OpenAI-compatible serve. Windows and Linux.

GitHub

Official source

Start locally with the CLI guide