DevelopersTV

Integrating Stateful Load Balancing At Scale In Envoy - Suyog Soti & Gaurav Nanda, Databricks

Envoy proxy Stateful load balancing Databricks Kubernetes Microservices Cache optimization Service mesh Extproc filter Rust Dicer Cloud native Distributed systems
CNCF
AI summary

This talk details Databricks' implementation of stateful load balancing using Envoy with the Dicer autosharder, achieving 90-95% cache hit rates while maintaining 99.95% availability. It covers the evolution from ExtProc+sidecar architecture to Envoy dynamic modules, including upstream contributions to the Envoy ExtProc filter and Rust SDK. The content is designed for platform engineers and infrastructure developers working with large-scale distributed systems.

Related videos