Aller au contenu
6.5 Moyenne

CVE-2026-115916 vLLM is an inference and serving engine for large language models

Description

vLLM is an inference and serving engine for large language models. Prior to 0.32.0, vllm/tokenizers/hf.py computes max_token_id with an off-by-one upper bound, allowing a pre-tokenized prompt ID equal to the vocabulary size to pass validation. For a tensor-parallel size of one and an exact multiple-of-64 vocabulary, VocabParallelEmbedding.forward does not mask that value before F.embedding uses it, causing a CUDA device-side assertion and terminating the engine. This issue is fixed in version 0.32.0.

Produits et versions touchés

Produit Versions touchées Corrigé en
vllm 0.32 premières → < 0.32.0 0.32.0

Références

Chronologie

  1. Publiée
  2. Dernière modification
Les 121 CVE de vllm →
Suivre cette CVE