Skip to content

Commit 262cce7

Browse files
authored
fix: Update agg_kvbm_router.sh to run workers on two gpus (#4643)
1 parent 01a634d commit 262cce7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/backends/vllm/launch/agg_kvbm_router.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ CUDA_VISIBLE_DEVICES=0 DYN_KVBM_CPU_CACHE_GB=2 \
3232
DYN_KVBM_LEADER_ZMQ_PUB_PORT=56003 \
3333
DYN_KVBM_LEADER_ZMQ_ACK_PORT=56004 \
3434
VLLM_NIXL_SIDE_CHANNEL_PORT=20097 \
35-
CUDA_VISIBLE_DEVICES=0 DYN_KVBM_CPU_CACHE_GB=2 \
35+
CUDA_VISIBLE_DEVICES=1 DYN_KVBM_CPU_CACHE_GB=2 \
3636
python3 -m dynamo.vllm \
3737
--model $MODEL \
3838
--enforce-eager \

0 commit comments

Comments
 (0)