Database/AI/ML frameworks & serving
vLLM: out-of-vocabulary stop_token_ids crash the engine and write past the V2 runner logits buffer
Impact
Any client allowed to submit a request to a vLLM server can terminate the engine process by passing stop_token_ids outside the model vocabulary, and on the V2 runner the same input writes outside the logits buffer. On a GPU node this takes down the whole serving replica, not one request: the engine holds the model in device memory, so a restart means reloading weights and a cold-start window for every tenant sharing that replica. Repeated requests make the denial of service persistent. The out-of-bounds write is in GPU-adjacent buffers, so memory corruption of in-flight state cannot be ruled out, though the advisory claims no confidentiality or integrity impact.
Who can reach it
Any authenticated caller of the chat, completion, generate or batch endpoints - the CVSS vector requires low privileges, meaning an ordinary API user, reachable over the network. No operator access to the node is needed.
What to do
Upgrade vLLM to 0.29.0 or later and restart each serving process; model weights reload on restart, so schedule it per replica to keep capacity. No kernel or firmware work is involved. Until then, validate or clamp stop_token_ids at the gateway in front of vLLM.
References
Related entries
- NVIDIA TensorRT-LLM: server-side request forgery lets a local user make the serving process issue arbitrary requestsCVE-2026-24269 · NVIDIA TensorRT-LLM (server-side request forgery in the serving component)High
- vLLM (`MediaConnector`): SSRF, recurrence of CVE-2025-6242CVE-2026-24779 · vLLM (`MediaConnector`)High
- vLLM (`load_from_url_async`): Bypass of the CVE-2026-24779 SSRF fixCVE-2026-25960 · vLLM (`load_from_url_async`)High
- LangSmith SDK: pulling a public Hub prompt deserializes attacker-controlled LangChain objectsCVE-2026-45134 · LangSmith SDK (pull_prompt / pullPrompt manifest deserialization)High
- picklescan: `scan_pytorch` bypass via forged magic numbersCVE-2026-53875 · picklescanHigh
- NVIDIA Megatron-LM: hash collisions in the inference cache let one request's data reach anotherCVE-2026-65104 · NVIDIA Megatron-LM (inference request cache)High
This entry is curated: imported from vendor advisories with machine assistance, not yet individually verified. Confirm against your vendor's advisory before acting, and report anything wrong.