CVE-2026-44223
MEDIUMvLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters
Title source: cnaDescription
vLLM is an inference and serving engine for large language models (LLMs). From to before 0.20.0, the extract_hidden_states speculative decoding proposer in vLLM returns a tensor with an incorrect shape after the first decode step, causing a RuntimeError that crashes the EngineCore process. The crash is triggered when any request in the batch uses sampling penalty parameters (repetition_penalty, frequency_penalty, or presence_penalty). A single request with a penalty parameter (e.g., "repetition_penalty": 1.1) is sufficient to crash the server. This vulnerability is fixed in 0.20.0.
References (2)
Core 2
Core References
X_Refsource_Confirm x_refsource_confirm
https://github.com/vllm-project/vllm/security/advisories/GHSA-83vm-p52w-f9pw
X_Refsource_Misc x_refsource_misc
https://github.com/vllm-project/vllm/pull/38610
Scores
CVSS v3
6.5
EPSS
0.0001
EPSS Percentile
3.5%
Attack Vector
NETWORK
CVSS:3.1/AV:N/AC:L/PR:L/UI:N/S:U/C:N/I:N/A:H
CISA SSVC
Vulnrichment
Exploitation
poc
Automatable
no
Technical Impact
partial
Details
CWE
CWE-131
CWE-704
Status
published
Products (3)
pypi/vllm
0.18.0 - 0.20.0PyPI
vllm/vllm
0.18.0 - 0.20.0
vllm-project/vllm
>= 0.18.0, < 0.20.0
Published
May 12, 2026
Tracked Since
May 13, 2026