vLLM denial of service via invalid gRPC prompt token IDs
vllm-project vllm
Affected versions
| Product | Affected | Fixed in |
|---|---|---|
| vllm-project vllm |
|
|
Original description
vLLM from 0.22.0 before 0.24.0 contains an improper input validation vulnerability in the Rust gRPC Generate and GenerateStream service that forwards unchecked prompt token IDs to EngineCore. Attackers can submit requests with out-of-vocabulary prompt.token_ids values to trigger a fatal embedding lookup failure that terminates EngineCore and leaves the server unhealthy.
From the CVE record · VulnCheck