Commit bff07b5
committed
fix: Set TRTLLM_USE_UCX_KVCACHE=1 for reducing gpu mem usage
Signed-off-by: Jacky <[email protected]>1 parent 8c37f8e commit bff07b5
1 file changed
+1
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
81 | 81 | | |
82 | 82 | | |
83 | 83 | | |
| 84 | + | |
84 | 85 | | |
85 | 86 | | |
86 | 87 | | |
| |||
0 commit comments