Yunshu

Fast local LLM / VLM inference engine for Apple Silicon (MLX). OpenAI- and Anthropic-compatible, lossless speculative decoding (DFlash2 / MTP), hybrid-model prefix cache with RAM/SSD tiers, native Claude Code / Codex / opencode support. Qwen3.8-27B tuned first.

GitHub

Official source

Start locally with the CLI guide

Back to catalog
My interests내 관심 주제

Tools

Sort

Loading catalog…카탈로그를 불러오는 중…