-
Notifications
You must be signed in to change notification settings - Fork 45
Pull requests: llm-d/llm-d-inference-sim
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
feat(metrics): add generation_tokens_total and prompt_tokens_total metrics
#268
opened Dec 4, 2025 by
googs1025
Loading…
pkg: add ability to provide number of choices sampled.
#262
opened Nov 29, 2025 by
MadhavJivrajani
Loading…
feat: add max-num-batched-tokens configuration and implement request handling constraints (#83)
#97
opened Jul 15, 2025 by
mohitpalsingh
Loading…
6 tasks done
ProTip!
What’s not been updated in a month: updated:<2025-11-11.