Database/AI/ML frameworks & serving
vLLM: unbounded prompt array in /v1/completions lets one request exhaust the engine
Impact
The CompletionRequest.prompt field accepts an unbounded list of strings or token-id lists, and the serving path creates one engine generator and one response slot per element. A single accepted request can therefore consume all request slots, CPU, host memory and async scheduling capacity on the replica, stalling or dropping every other tenant's inference on that GPU. On a shared inference node this is a cheap way for one API client to take the accelerator out of service for everyone behind the same endpoint, and recovery means restarting the server and reloading model weights. No data disclosure is described - the effect is availability only.
Who can reach it
Any client that can authenticate to the vLLM OpenAI-compatible HTTP endpoint (an API key, or network reach where the endpoint is deployed without auth). No special privileges beyond ordinary inference access.
What to do
Upgrade to vLLM 0.26.0 and restart each serving process; that drops in-flight requests and re-loads model weights on every replica, so roll it replica by replica behind the load balancer. Until then, cap request body size and reject oversized prompt arrays at the gateway in front of vLLM. Affected from 0.19.0 up to 0.26.0.
References
Related entries
- vLLM: MiMo-V2-Omni processor bypasses media allowlists, enabling SSRF and local file readsCVE-2026-73560 · vLLM MiMoV2OmniMultiModalProcessor (media fetching in transformers_utils/processors/mimo_v2_omni.py)Medium
- OpenShift AI dashboard: unauthorized Secret read exposes the cluster NGC API key and NIM pull secretCVE-2026-86332 · Red Hat OpenShift AI odh-dashboard (GET /api/nim-serving/:nimResource)Medium
- Keras: malicious .keras/.h5 weights file reads arbitrary local files via HDF5 ExternalLinksCVE-2026-9335 · Keras (KerasFileEditor and keras.saving.load_weights HDF5 ExternalLink handling)Medium
- vLLM OpenAI-compatible server (chat_template / chat_template_kwargs): NOISY-NEIGHBOUR DENIAL OF SERVICE: one tenantNCVD-2025-018-vllm-openai-compatible-server-ch · vLLM OpenAI-compatible server (chat_template / chat_template_kwargs)Medium
- Ray (GCS Redis credential handling / logging): When the Redis password is passed on the Ray command line it getsCVE-2025-1979 · Ray (GCS Redis credential handling / logging)Medium
- KServe ModelMesh: Group-writable `/etc/passwd` in the container imageCVE-2025-57852 · KServe ModelMeshMedium
This entry is curated: imported from vendor advisories with machine assistance, not yet individually verified. Confirm against your vendor's advisory before acting, and report anything wrong.