Skip to content

Commit 9b7152d

Browse files
authored
fix: Fix CUDA_VISIBLE_DEVICES for agg_multimodal_epd.sh (#4888)
1 parent c6b440e commit 9b7152d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/backends/vllm/launch/agg_multimodal_epd.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,7 @@ python -m dynamo.vllm --multimodal-processor --enable-multimodal --model $MODEL_
8080

8181
# run E/P/D workers
8282
CUDA_VISIBLE_DEVICES=0 python -m dynamo.vllm --multimodal-encode-worker --enable-multimodal --model $MODEL_NAME &
83-
CUDA_VISIBLE_DEVICES=0 python -m dynamo.vllm --multimodal-worker --enable-multimodal --enable-mm-embeds --model $MODEL_NAME $EXTRA_ARGS &
83+
CUDA_VISIBLE_DEVICES=1 python -m dynamo.vllm --multimodal-worker --enable-multimodal --enable-mm-embeds --model $MODEL_NAME $EXTRA_ARGS &
8484

8585
# Wait for all background processes to complete
8686
wait

0 commit comments

Comments
 (0)