vLLM: Incomplete CVE-2025-62164 remediation can be bypassed by concurrent prompt parts
vllm-project vllm
Affected versions
| Product | Affected | Fixed in |
|---|---|---|
| vllm PyPI |
|
|
Original description
vLLM is an inference and serving engine for large language models. From 0.20.2rc0 until 0.26.0, safe_load_prompt_embeds in vllm/renderers/embed_utils.py uses torch.sparse.check_sparse_tensor_invariants, whose process-global save, enable, and restore state can be raced by concurrent prompt_embeds parts submitted to POST /v1/chat/completions through AsyncMultiModalItemTracker.resolve_items, asyncio.gather, and the default executor, allowing an invalid sparse tensor to reach tensor.to_dense despite the CVE-2025-62164 guard when enable_prompt_embeds is enabled. This issue is fixed in version 0.26.0.
From the CVE record · GitHub_M