Beyond VLLM: Distributed LLM Inferencing With Llm-d on Kubernetes - Ravindra Patil, Red Hat 2w Llm inference Vllm Llm D
Policy-as-Code for LLM Inference: Cost & Security Guardrails - Sakalya Deshpande, SAP Labs 1mo Kyverno Policy As Code Llm inference
Evolving KServe: The Unified Model Inference Platform for Both Predictive and... F. Spolti & J. Lee 2mo Kserve Model serving Kubernetes
