Text-LLM-Training-from-scratch — A from-scratch implementation of the language-model training pipeline in PyTorch: tokenization, pretraining, SFT, and pr
This is a PyTorch implementation of an LLM training pipeline. It covers tokenization, pretraining, SFT, and preference-based alignment from scratch, offering a hands-on educational resource for developers.