Lessons From Five+ Years of Fluent Bit: Building a Global-Scale Observability Agent - Hiroshi Hatake
Fluent bit Cncf Observability Telemetry agent Character encoding Log processing Logs metrics traces Edge computing Utf 8 Gbk Shift Jis Cloud native Open telemetry Data pipeline
This session presents lessons learned from maintaining Fluent Bit as a CNCF project over five years of production use in global observability pipelines. It covers the architectural challenges of handling non-UTF-8 log encoding (GBK, Shift-JIS), multi-telemetry support design trade-offs, and performance constraints in resource-constrained edge environments. The talk is targeted at platform engineers, DevOps practitioners, and developers building or maintaining observability systems who need to handle diverse character encodings in production logs.