rag-ci — Regression testing and configuration sweeps for RAG pipelines, with the statistics to know whether a change actually hel

rag-ci is a CLI tool for regression testing and configuration sweeps in RAG pipelines. It provides statistical validation to help developers determine whether code or data changes genuinely improve retrieval-augmented generation quality. The tool addresses a major pain point in LLMOps by moving beyond anecdotal evals into rigorous pipeline comparison.

Opening Kapyn…