Orchestrating ML/AI workloads with TPUs on GKE
Google kubernetes engine Gke Tpu Tensor processing unit Machine learning Ml infrastructure Ai training Distributed training Kubernetes Google cloud Mlops
This video explores how to orchestrate machine learning workloads using Tensor Processing Units (TPUs) on Google Kubernetes Engine, featuring a Product Manager discussion on scaling 7th generation TPUs for ML training and inference. Viewers will learn about TPU architecture options, GKE integration patterns, and practical considerations for running large-scale ML workloads on managed Kubernetes infrastructure.
Related videos
Evolving KServe: The Unified Model Inference Platform for Both Predictive and... F. Spolti & J. Lee
Building production ready full stack apps with AI
From systems of intelligence to systems of action: Yasmeen Ahmad on the agentic data cloud
MLOps Explained - What It Is, Why You Need It and How It Works
The ABCs of agent building
Building distributed multi-agent systems
The future of Cloud AI: Mastering MCP servers, Gemini, and agentic workflows
Keynote: Rules of the Road for Shared GPUs: AI Inference Scheduling at Wa... M. Muralikrishnan (ASL)
Keynote: From Inference to Agents: Where Open Source AI Is Headed - Panel (ASL)
Self host Gemma 4: Deploy LLMs on Cloud Run GPUs
How to scale to 60 million requests (with ZERO ops team) using Cloud Run
