glq

Lattice and trellis-coded quantization for LLM weights — 2–8 bpw, mixed-precision, fused CUDA tensor-core inference on vLLM + HF

GitHub

Official source

Start locally with the CLI guide

Back to catalog
My interests내 관심 주제

Tools

Sort

Loading catalog…카탈로그를 불러오는 중…