Database/AI/ML frameworks & serving
vLLM: out-of-range prompt token ids crash the shared EngineCore when tokenizer init is skipped
Impact
When vLLM runs with --skip-tokenizer-init, the vocabulary range check on prompt token ids is skipped. A single request carrying a large positive token id to /v1/completions, /v1/embeddings or /pooling causes a fatal embedding index error in the shared EngineCore. Every client served by that engine loses service, and the GPUs behind it sit idle until the server is restarted. Only deployments that use --skip-tokenizer-init are affected.
Who can reach it
Anyone who can send requests to the vLLM API endpoint. No authentication is needed unless the operator puts it in front.
What to do
Upgrade vLLM to 0.33.0 or later and restart the serving process. Until then, drop --skip-tokenizer-init where you can, or validate token ids against the model vocabulary in a gateway in front of the server.
References
Related entries
- vLLM: no per-request media budget lets one request with many image URLs exhaust the frontendCVE-2026-130686 · vLLM OpenAI-compatible server (multimodal remote image fetching)High
- KubeAI (Ollama engine controller): Injection in `ollamaStartupProbeScript()`CVE-2026-34940 · KubeAI (Ollama engine controller)High
- Flowise: public chatflow endpoints return raw flowData including plaintext API keysCVE-2026-41278 · Flowise (GET /api/v1/public-chatflows/:id and public-chatbotConfig response sanitization)High
- Nocturne Memory: empty API_TOKEN disables auth, exposing the agent knowledge graph to the LANCVE-2026-44830 · Nocturne Memory (BearerTokenAuthMiddleware when API_TOKEN is unset)High
- vLLM: user-supplied structured-output regex compiles with no timeout, hanging an inference workerCVE-2026-55574 · vLLM structured_outputs.regex (xgrammar / outlines grammar compilation)High
- Hugging Face Datasets: pickle-backed pandas builder executes code from a dataset file on loadCVE-2026-57845 · Hugging Face Datasets (deprecated pandas packaged builder, Pandas._generate_tables)High
This entry is curated: imported from vendor advisories with machine assistance, not yet individually verified. Confirm against your vendor's advisory before acting, and report anything wrong.