A new report reveals a significant "evaluation gap" in enterprise AI, where organizations trust automated tests less than the autonomy they grant AI agents. Half of surveyed companies have shipped agents that failed in production after passing internal evaluations, highlighting a misalignment between current testing and real-world outcomes. Despite this, two-thirds of companies are moving towards deploying agent changes to production without human oversight based on automated tests alone.
Opening Kapyn…