What Makes Open Models Fast in Production — Sujee Maniyam, Nebius

Why watch

A technical deep-dive on optimizing open-source LLM inference for production, covering GPU optimization (NVFP4), caching strategies, speculative decoding, and KV cache management. Ideal for ML engineers and platform teams building LLM serving infrastructure.