slotserve

Book GPU time slots and serve llama.cpp models behind an OpenAI-compatible API. 预约 GPU 时段,OpenAI 兼容的 llama.cpp 网关。

GitHub

Official source

Start locally with the CLI guide

Back to catalog
My interests내 관심 주제

Tools

Sort

Loading catalog…카탈로그를 불러오는 중…