Skip to content

Commit 64779d0

Browse files
committed
chore: Update request token count for 8192 model size
Signed-off-by: Jacky <[email protected]>
1 parent 9fb5f03 commit 64779d0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/fault_tolerance/migration/utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -57,7 +57,7 @@ def start_completion_request() -> tuple:
5757

5858
def send_request():
5959
prompt = "Tell me a long long long story about yourself?"
60-
max_tokens = 8192
60+
max_tokens = 8000
6161
timeout = 240 # Extended timeout for long request
6262

6363
payload = {

0 commit comments

Comments
 (0)