Meta builds a system that uses idle inference capacity to improve ads recommendations. The design adds two elasticity levers so recommendation workloads can scale across opportunistic compute without hurting baseline performance. The approach is now running at Meta’s scale, boosting ad relevance while keeping cost and latency in check.
Opening Kapyn…