lama-caravan

LAMA CARAVAN — Local And Multi-backend Adaptive Computation And Routing Across Various AI Nodes. Self-hosted control plane for llama.cpp fleets and AI agents: hybrid local/cloud token routing with queues & schedules, remote server cells, HF model browser, usage accounting. Stdlib Python.

GitHub

Official source

Start locally with the CLI guide