In-person + Virtual
November 6-9
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon North America 2023 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Central Standard Time (UTC -6). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change.
Back To Schedule
Tuesday, November 7 • 2:30pm - 3:05pm
Sustainable Scaling of Kubernetes Workloads with In-Place Pod Resize and Predictive AI - Vinay Kulkarni, eBay & Haoran Qiu, UIUC

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Accurately guessing CPU & memory requirements for workloads is hard! So, it is common for users to over-provision pods which leads to under-utilized clusters, and the need to scale up cluster size to accommodate workloads. Recently added in-place pod resize feature brings the ability to right-size over-provisioned pods without restarting them. In this talk, Vinay will discuss how cluster autoscaler currently handles pods pending due to insufficient resources, then introduce a change to the autoscaling workflow that right-sizes over-provisioned pods, and show how it can help schedule pending pods more quickly while lowering costs & carbon footprint. Haoran will talk about the latest research that leverages machine learning and reinforcement learning techniques to achieve multi-dimensional autoscaling, and discuss how this cutting-edge work can help proactively scale workloads to achieve optimal cluster utilization while meeting application SLOs by more precisely provisioning the pods.

avatar for Vinay Kulkarni

Vinay Kulkarni

Principal MTS & Director, eBay
Vinay helps solve Kubernetes networking challenges using eBPF in large-scale clusters with globally distributed workloads at eBay Cloud. Before eBay, Vinay worked on advanced research projects in Kubernetes compute & networking @ Huawei, network stack features for systemd & PhotonOS... Read More →
avatar for Haoran Qiu

Haoran Qiu

PhD Student, UIUC
Haoran Qiu is a final year PhD student at UIUC working with Prof. Ravishankar Iyer. His research interest is in machine learning and distributed systems, with a focus on performance and sustainability. His recent research has been focused on designing novel ML/RL-based solutions and... Read More →

Tuesday November 7, 2023 2:30pm - 3:05pm CST
W184 (Ground Level)
  Emerging + Advanced