synaptix

Native Rust engine for neural network inference and training: LLM, image, video, speech and music models on hand-written CUDA kernels JIT-compiled via NVRTC for any NVIDIA sm_80+ GPU (native NVFP4/MXFP8 on Blackwell sm_120+). .syn bundles in NVFP4/MXFP8/SQ1–SQ8, GGUF loads directly. No PyTorch, no Python.

GitHub

Official source

Start locally with the CLI guide