Database/AI/ML frameworks & serving
vLLM: rejected requests leak decode-worker metadata until the worker exhausts memory
Impact
In prefill/decode disaggregated deployments vLLM does not clean up decode-side metadata for requests it rejects, so a client that submits requests with max_tokens=0 grows worker memory without bound until the process dies or is restarted. The requests are cheap to send and are rejected, so ordinary request accounting and token quotas do not see them. On a GPU node this takes out the decode workers holding the KV cache for live sessions, and the GPUs stay idle for the duration of the restart. Confidentiality and integrity are unaffected - this is availability only.
Who can reach it
Any client that can reach the vLLM API endpoint; the record indicates no authentication is needed, so in practice any tenant or anything on the network path to the inference endpoint.
What to do
Affected through 0.29.0; the fix is upstream PR 55677 - upgrade to a release that contains it once published, then restart the affected vLLM workers. In the meantime reject or normalize max_tokens=0 at the gateway in front of vLLM and alert on decode-worker RSS growth. Remediation is a serving-process restart per node, not a reboot.
References
Related entries
- Gradio (`/queue/join`): SSRFCVE-2024-4325 · Gradio (`/queue/join`)High
- ONNX: Security-control bypass through 1.20.1CVE-2026-28500 · ONNXHigh
- ONNX (`ExternalDataInfo`): Security control bypass in external-data path handlingCVE-2026-34445 · ONNX (`ExternalDataInfo`)High
- JupyterLab: saved HTML cell output can run arbitrary JupyterLab commands on one user clickCVE-2026-42557 · JupyterLab (HTML sanitizer / CommandLinker command dispatch)High
- LocalAI (`/models/apply`): Unauthenticated SSRF fetching arbitrary internal URLsCVE-2026-59707 · LocalAI (`/models/apply`)High
- Text Generation Inference (TGI): SSRF in the OpenAI-compatible multimodal chat endpointCVE-2026-63086 · Text Generation Inference (TGI)High
This entry is curated: imported from vendor advisories with machine assistance, not yet individually verified. Confirm against your vendor's advisory before acting, and report anything wrong.