Glacier.Inference

High-performance pure C# .NET 10 LLM & MoE inference engine. Bare-metal NVIDIA SASS, Direct3D 12 Wave32 compute, AVX-512 SIMD, zero-copy GGUF, speculative decoding & distributed fleet orchestration. Zero external C++ dependencies.

GitHub

Official source

Start locally with the CLI guide