InferMux

llama-swap with a GPU warden: one endpoint for local models that yields the card to games and ComfyUI without killing interactive requests

GitHub

Official source

Start locally with the CLI guide

Back to catalog
My interests내 관심 주제

Tools

Sort

Loading catalog…카탈로그를 불러오는 중…