vLLM denial of service via gRPC logprob token IDs
vllm-project vllm
Affected versions
| Product | Affected | Fixed in |
|---|---|---|
| vllm PyPI |
|
|
Original description
vLLM from 0.22.0 before 0.24.0 contains a denial of service vulnerability that allows remote attackers to terminate EngineCore by bypassing logprob_token_ids limits in the Rust gRPC frontend. Attackers can send Generate or GenerateStream requests with output_logprobs enabled and more than 128 output_candidates.token_ids, triggering a fatal sampler exception that crashes the engine.
From the CVE record · VulnCheck