kapynOpen Source

microgpt: A from-scratch, dependency-free GPT implementation in pure NumPy...

MicroGPT is a pure NumPy implementation of a GPT model from scratch. It includes a byte‑level tokenizer, multi‑head self‑attention, an Adam trainer, and a top‑k sampler, all without external dependencies. The repo has 51 GitHub stars and targets Python developers interested in low‑level LLM research.

GitHub·Nov 5, 2026

Opening Kapyn…