Preventing S3 Cost Storms: Applying Cortex’s Efficiency Lessons to I/O-Heav... A. Fishman-Lichterman

CNCF
AI summary

This session explores how naive S3 usage can transform cheap storage into expensive API bill storms, using Cortex (CNCF's Prometheus time-series database) as a blueprint for efficiency. Developers and platform engineers learn concrete strategies including bucket indexes, shared caches, and batched writes to optimize I/O-heavy workloads across Spark, Airflow, and Kubernetes environments.