lim

Stateful local LLM inference manager with persistent KV-cache, native filesystem tools, and instant undo: built in C++ on llama.cpp

GitHub

Official source

Start locally with the CLI guide