mini-LLM

Building and studying small language models from pretraining to DPO alignment, with reproducible experiments and detailed research documentation.

GitHub

Official source

Start locally with the CLI guide