marbor

The control plane for self-hosted AI inference. Warm-state GPU routing, multi-runtime orchestration across Ollama, vLLM, llama.cpp, TGI and MLX . Single Go binary. Apache-2.0.

GitHub

Official source

Start locally with the CLI guide

Back to catalog
My interests내 관심 주제

Tools

Sort

Loading catalog…카탈로그를 불러오는 중…