Beyond VLLM: Distributed LLM Inferencing With Llm-d on Kubernetes - Ravindra Patil, Red Hat 2mo Llm inference Vllm Llm D
Policy-as-Code for LLM Inference: Cost & Security Guardrails - Sakalya Deshpande, SAP Labs 3mo Kyverno Policy As Code Llm inference
Evolving KServe: The Unified Model Inference Platform for Both Predictive and... F. Spolti & J. Lee 4mo Kserve Model serving Kubernetes
