vLLM: Cross-User Data Leak Vulnerability
vllm-project vllm
Affected versions
| Product | Affected | Fixed in |
|---|---|---|
| vllm PyPI |
|
|
Original description
vLLM is an inference and serving engine for large language models. Prior to 0.27.0, an integer overflow in blockIdx.x * 2 * d in activation_kernels.cu can cause act_and_mul_kernel to consume another batched user's input, allowing a request processed in the same inference batch to receive a partial or complete copy of another user's inference result. This issue is fixed in version 0.27.0.
From the CVE record · GitHub_M