mjolnir

Mjölnir — faster, bigger-context LLM serving on the Jetson AGX Thor: a dedicated decode kernel, a tuned vLLM image and a CLI that serves, benchmarks and documents it.

GitHub

Official source

Start locally with the CLI guide