Intel Gaudi / vLLM hardware plugin: Malformed input to the Gaudi vLLM plugin crashes or wedges the serving process

Impact

Malformed input to the Gaudi vLLM plugin crashes or wedges the serving process. On an inference fleet this is a request-triggered outage of the model server rather than a data-confidentiality problem, but a single tenant can repeatedly take down a shared endpoint that is pinned to expensive accelerators.

Who can reach it

Anyone who can reach the vLLM endpoint with an authenticated request - so any tenant of a shared inference service, or any workload inside the cluster if the endpoint is not network-segmented.

What to do

Upgrade the vLLM hardware plugin for Gaudi to 0.16.0 or later. Pure Python/userspace package update - restart the serving process, no node reboot, no firmware.

References

Related entries

• NVIDIA Windows GPU Display Driver (nvlddmkm.sys): The driver loads Windows system DLLs without validating pathCVE-2019-5676 · NVIDIA Windows GPU Display Driver (nvlddmkm.sys)Medium
• NVIDIA NVFlash / NVUFlash / GPUModeSwitch kernel driver (nvflash.sys, nvflsh32/64.sys): NVIDIA's signed flashing driverCVE-2019-5688 · NVIDIA NVFlash / NVUFlash / GPUModeSwitch kernel driver (nvflash.sys, nvflsh32/64.sys)Medium
• NVIDIA DGX A100 - SBIOS / SMM firmware: An out-of-bounds write in the SmbiosPei module gives a highly privileged localCVE-2022-31601 · NVIDIA DGX A100 - SBIOS / SMM firmwareMedium
• NVIDIA DGX A100 - SBIOS / SMM firmware: An out-of-bounds write in the FsRecovery module reaches firmware code executionCVE-2022-42281 · NVIDIA DGX A100 - SBIOS / SMM firmwareMedium
• GPU Display Driver: DoS / data tampering (integer underflow)CVE-2023-0185 · GPU Display DriverMedium
• NVIDIA DGX-2 - SBIOS / SMM firmware: An out-of-bounds write in the Bds phase gives a privileged local user firmwareCVE-2023-0201 · NVIDIA DGX-2 - SBIOS / SMM firmwareMedium