LLM-EdgeFlow

High-performance C++ pipeline & heterogeneous inference framework for Edge AI & LLMs, featuring fixed-batch DMA scheduling, multi-modal DAG orchestration, and pure C ABI isolation.

GitHub

Official source

Start locally with the CLI guide