We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent a37800c commit ea47bd7Copy full SHA for ea47bd7
tests/fault_tolerance/cancellation/test_trtllm.py
@@ -7,7 +7,7 @@
7
- test_request_cancellation_trtllm_decode_cancel: ~65s (gpu_1)
8
- test_request_cancellation_trtllm_prefill_cancel: ~65s (gpu_1)
9
- test_request_cancellation_trtllm_kv_transfer_cancel: ~65s (gpu_1)
10
-- Total: ~460s (0:07:40) for both nats and tcp request planes
+- Total: ~240s x2 request planes = ~480s (0:08:00)
11
"""
12
13
import logging
0 commit comments