Inference

Beyond VLLM: Distributed LLM Inferencing With Llm-d on Kubernetes - Ravindra Patil, Red Hat

2w

Llm inference Vllm Llm D

Engineering the future of Kubernetes for AI at scale

3w

Kubernetes Google Cloud Ai Infrastructure

What the SpaceX IPO Says About the Future of AI Infrastructure

1mo

Ai infrastructure Cloud native Inference workloads

Azure Storage for AI workloads​ | OD870

1mo

Azure storage Ai inference Azure ai

Inside Azure innovations with Mark Russinovich | BRK226

1mo

Azure Azure boost Rdma

Stop routing docstrings to 70B models with on-device AI on Snapdragon | BRKSP90

1mo

On Device AI Edge AI Inference routing

How to Run LLMs Locally (5 Easy Ways)

1mo

Llm Local llm Ollama

Fireworks AI quick take: Live from Microsoft Build | LIVESP125

1mo

Fireworks ai Ai inference Microsoft build 2026

Understand and fix Agent Framework apps with observability and evals | DEM361

1mo

Microsoft agent framework Observability Llm evaluation

Local models, developer control, and the future of AI runtimes | BRK235

1mo

Local AI models Hybrid AI execution Microsoft Build 2026

Scale agentic AI from on-device to cloud orchestration | BRKSP92

1mo

Agentic AI Microsoft Azure Azure Kubernetes Service

Shipping custom models at scale from fine-tuning to inference | BRK234

1mo

Machine learning Fine Tuning Model serving

Engineering the future of Kubernetes for AI at scale

3w

Beyond VLLM: Distributed LLM Inferencing With Llm-d on Kubernetes - Ravindra Patil, Red Hat

2w