Title

A vLLM PagedAttention KV Cache Corruption issue caused a 14720 RPS peak, resulting in system downtime. The root cause was a simple fix in the Dockerfile. To prevent similar incidents, three Grafana alerts were added to detect NCCL comms thread failures and all_reduce latency issues. Engineers should review their Dockerfiles and consider adding similar alerts.