kapynOpen Source

AbliteratedOutTheBox: llama.cpp fork that abliterates at inference

AbliteratedOutTheBox is a llama.cpp fork that eliminates the model from memory during inference. The C++ project has 25 GitHub stars and focuses on abliteration to reduce RAM usage. It targets developers needing lightweight, low‑memory LLM inference on edge devices.

GitHub·Oct 21, 2026

Opening Kapyn…