KV Cache-Aware Routing and P/D Disaggregation on Kubernetes — Yuchen Fama & Ashish Kamra, Red Hat
Learn how KV Cache-Aware Routing and P/D Disaggregation optimize LLM inference for agentic workloads. Discover strategies to reduce P99 latency from 900ms to 100ms using advanced Kubernetes patterns.
Read article