Vaultaire: a data vault for system metrics, backed onto Ceph

Why watch

Andrew Cowie presents Vaultaire, a distributed metrics storage system built directly on Ceph using the librados library. The talk covers the architectural decisions behind storing raw time-series data (not averaged/aggregated) for production analytics, how to interface with Ceph at the library level rather than through S3 or RBD, lessons learned from production deployment handling thousands of metrics per second, and approaches to building predictive modelling tools on top of a metrics store that preserves all raw data.