Karpenter: a third off the compute bill
Node provisioning ran on Cluster Autoscaler: slow to react — around five minutes for capacity to arrive — and chronically over-provisioned, because node groups can't right-size to what pods actually request.
I migrated provisioning to Karpenter: just-in-time nodes sized to the pending pods, with workload consolidation packing the fleet tighter as demand moves. Workloads are split across NodePools — spot instances for general workloads, on-demand for critical cluster operations — enforced with taints and tolerations so nothing critical lands on capacity that can disappear.
The fleet went from roughly 200 nodes to 140 — about 30% off compute spend — and node scale-up dropped from ~5 minutes to ~45 seconds, which is the difference developers actually feel.
- Karpenter
- EKS
- Terraform
- EC2 Spot