Soup CLI is an open-source command-line tool for fine-tuning 8-billion-parameter language models on low-end consumer hardware. It streams frozen base models layer-by-layer from system RAM to dramatically reduce peak VRAM consumption, enabling Llama-3.1-8B training at nearly 120 tokens per second on a 4 GB laptop GPU. The Apache-2.0 tool supports supervised fine-tuning, DPO, GRPO, and KTO alongside built-in evaluation, gating, and export capabilities.
Opening Kapyn…