Database/AI/ML frameworks & serving
vLLM: out-of-range stop_token_ids trigger a CUDA device assertion and wedge EngineCore
Impact
stop_token_ids are checked only for being integers, not for being inside the model vocabulary. With min_tokens > 0 an out-of-range id is used as a logits index and hits a CUDA device-side assertion. One malformed request puts EngineCore into a fatal state: every subsequent request fails until the service is restarted. The GPUs stay allocated to a dead replica, so a single authenticated tenant can park a GPU node's worth of capacity with one HTTP call, repeatedly.
Who can reach it
Any authenticated API user of the inference endpoint - in a multi-tenant serving cluster, any tenant with a key for that model.
What to do
Upgrade to vLLM 0.29.0 and restart each serving process. If you cannot upgrade now, reject or clamp stop_token_ids at a gateway in front of vLLM, and make sure the process supervisor restarts the server on the fatal-state condition so the outage is short rather than open-ended.
References
Related entries
- vLLM: malformed IAMF audio upload reaches FFmpeg heap overflow and crashes the inference serverCVE-2026-109311 · vLLM (/v1/audio/transcriptions PyAV/FFmpeg audio decode path)High
- vLLM: forged multimodal uuid desynchronizes the processor cache and kills the serving instanceCVE-2026-114050 · vLLM (multimodal processor cache, client-supplied uuid)High
- vLLM: one request with oversized min_tokens kills the EngineCore input thread while /health stays 200CVE-2026-114051 · vLLM (/inference/v1/generate min_tokens validation, EngineCore input thread)High
- vLLM: caller-controlled EXIF ImageID and cache_salt collide cache keys across requestsCVE-2026-114054 · vLLM (multimodal media cache and prefix KV cache key derivation)High
- Flexible GraphRAG: Cypher injection through ingested document content on the FalkorDB backendCVE-2026-114510 · Flexible GraphRAG FalkorDBAdapter (_escape / add_graph_documents Cypher assembly)High
- vLLM: audio decompression bomb via input_audio or audio_url exhausts serving node memoryCVE-2026-116175 · vLLM (AudioMediaIO load_audio, missing max_duration_s limit)High
This entry is curated: imported from vendor advisories with machine assistance, not yet individually verified. Confirm against your vendor's advisory before acting, and report anything wrong.