xllama

Local LLM inference on Xbox Series S|X in Dev Mode: llama.cpp (GGUF) + ONNX Runtime GenAI, opt-in OpenAI-compatible LAN endpoint, diffusion and on-device training. Measured models are listed in a Hugging Face collection. Independent research project, not affiliated with Microsoft.

GitHub

Official source

Start locally with the CLI guide