Inside Azure innovations with Mark Russinovich | BRK226
Azure Azure boost Rdma Confidential computing Llm inference Kv cache Serverless Azure container instances Hyper V isolation Microsoft build Cloud infrastructure Ai inference optimization
Mark Russinovich presents advanced Azure innovations covering RDMA networking extended to VMs via Azure Boost, serverless infrastructure with Azure Container Instances, and confidential computing protecting data during processing. The session demonstrates VM-to-VM RDMA for AI inference and explores KV cache optimization for LLMs. Targeted at experienced cloud architects and engineers seeking in-depth understanding of Azure's cutting-edge infrastructure capabilities.