IA Squad
SearchPT
python · vllmHeads-up

vllm: Temperature validation silently passes NaN and +Inf values

Temperature validation in sampling_params.

18 Jun 2026Read 1 minSeverity: schedule it

What changed

Temperature validation in sampling_params.py uses comparison operators that silently pass NaN and +Inf values, leading to undefined behavior or CUDA errors in GPU sampling kernels.

Who it affects

All vllm users who allow user-supplied temperature values without proper validation.

What to do today

Apply the fix from PR #45116 to add math.isfinite() check in _verify_args() and reject non-finite float values.

The trail
Collected Audited Written Published