Skip to content

Commit a6504db

Browse files
gtbaiGuangtong Bai
authored andcommitted
Install runai dep for vllm
1 parent fe10dbf commit a6504db

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

container/deps/vllm/install_vllm.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -126,7 +126,7 @@ git checkout $VLLM_REF
126126
echo "\n=== Installing vLLM & FlashInfer ==="
127127
echo "Installing vLLM $VLLM_REF from PyPI..."
128128

129-
uv pip install vllm[flashinfer]==$VLLM_REF --torch-backend=${TORCH_BACKEND}
129+
uv pip install vllm[flashinfer,runai]==$VLLM_REF --torch-backend=${TORCH_BACKEND}
130130
uv pip install flashinfer-cubin==$FLASHINF_REF
131131
uv pip install flashinfer-jit-cache==$FLASHINF_REF --extra-index-url https://flashinfer.ai/whl/${TORCH_BACKEND}
132132

pyproject.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ trtllm =[
5656
vllm = [
5757
"uvloop",
5858
"nixl[cu12]<=0.7.1",
59-
"vllm[flashinfer]==0.12.0",
59+
"vllm[flashinfer,runai]==0.12.0",
6060
]
6161

6262
sglang = [

0 commit comments

Comments
 (0)