Introducing container caching in Amazon SageMaker AI for faster model scaling
SageMaker now offers container image caching for faster AI model scaling. This optimization cuts end-to-end latency by up to 2x during scale-out events for generative AI models.