EKS Node Autoscaling With Large Container Images and a Warm Pool

Our journey through improving autoscaling

Photo by Ed Robertson on Unsplash (a warm pool! ha ha)

Imagine you’re trying to scale GPU-based workloads up and down quickly in an EKS cluster. You have some constraints, mostly that the images you’re pulling have CUDA drivers that are GB in size.