Loading…
In-person + Virtual
November 6-9
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon North America 2023 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Central Standard Time (UTC -6). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change.
Back To Schedule
Tuesday, November 7 • 2:30pm - 3:05pm
Sustainable Scaling of Kubernetes Workloads with In-Place Pod Resize and Predictive AI - Vinay Kulkarni, eBay & Haoran Qiu, UIUC

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Accurately guessing CPU & memory requirements for workloads is hard! So, it is common for users to over-provision pods which leads to under-utilized clusters, and the need to scale up cluster size to accommodate workloads. Recently added in-place pod resize feature brings the ability to right-size over-provisioned pods without restarting them. In this talk, Vinay will discuss how cluster autoscaler currently handles pods pending due to insufficient resources, then introduce a change to the autoscaling workflow that right-sizes over-provisioned pods, and show how it can help schedule pending pods more quickly while lowering costs & carbon footprint. Haoran will talk about the latest research that leverages machine learning and reinforcement learning techniques to achieve multi-dimensional autoscaling, and discuss how this cutting-edge work can help proactively scale workloads to achieve optimal cluster utilization while meeting application SLOs by more precisely provisioning the pods.
Speakers
avatar for Vinay Kulkarni

Vinay Kulkarni

Principal MTS & Director, eBay
Vinay helps solve Kubernetes networking challenges using eBPF in large-scale clusters with globally distributed workloads at eBay Cloud. Before eBay, Vinay worked on advanced research projects in Kubernetes compute & networking @ Huawei, network stack features for systemd & PhotonOS... Read More →
avatar for Haoran Qiu

Haoran Qiu

PhD Student, UIUC
Haoran Qiu is a final year PhD student at UIUC working with Prof. Ravishankar Iyer. His research interest is in machine learning and distributed systems, with a focus on performance and sustainability. His recent research has been focused on designing novel ML/RL-based solutions and... Read More →

SustainableAutoscaling pdf
kubeadm ca demo 540p mp4
kubeadm ca demo smush 720p mp4
Tuesday November 7, 2023 2:30pm - 3:05pm CST
W184 (Ground Level)
  Emerging + Advanced