Commit 2c6e4bf
committed
fix: warn when engine_args in OpenAIServerConfig are ignored
Add a runtime warning when users pass engine-initialization-only
arguments (max_logprobs, gpu_memory_utilization, tensor_parallel_size,
max_model_len) via OpenAIServerConfig.engine_args.
These arguments are silently ignored because the vLLM engine is
initialized by Unsloth before OpenAIServerConfig is applied.
The warning guides users to use TrainableModel._internal_config
instead.1 parent a0ae38a commit 2c6e4bf
1 file changed
+18
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
1 | 2 | | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
5 | 6 | | |
6 | 7 | | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
7 | 15 | | |
8 | 16 | | |
9 | 17 | | |
| |||
35 | 43 | | |
36 | 44 | | |
37 | 45 | | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
38 | 56 | | |
39 | 57 | | |
40 | 58 | | |
| |||
0 commit comments