error running this model on vllm 0.10.2

by koushd - opened 25 days ago

25 days ago

•

vllm-distributed | ERROR 09-15 12:28:53 [launch.py:516] Error occurred while running method 'determine_available_memory': CUDA error: no kernel image is available for execution on the device

rtx 6000 pro

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment