kapynOpen Source

llm-engineering-platform — A production-oriented LLM engineering platform with OpenAI-compatible serving, streaming, observability, evaluation, rep

llm-engineering-platform is an open-source LLMops toolkit for production-grade AI applications. It offers OpenAI-compatible serving, streaming, observability, evaluation pipelines, reproducible experiments, and deterministic retrieval-augmented generation out of the box. Built with Python and FastAPI, it helps developers quickly bootstrap reliable LLM infrastructure without relying on heavyweight proprietary platforms.

GitHub·Jul 26, 2026

Opening Kapyn…