vault
Scaling Inference to 9.8M Events/sec: From XGBoost to Memory-Efficient Layouts
MLOps optimization journey scaling real-time anomaly detection from 100K to 9.8M events/sec through model optimization, batching, and memory layout improvements.
July 20, 2025•4 min read