feat: add max-num-batched-tokens configuration and implement request handling constraints (#83)#97

mohitpalsingh wants to merge 2 commits intollm-d:mainllm-d/llm-d-inference-sim:mainfrom

mohitpalsingh:mainmohitpalsingh/llm-d-inference-sim:mainCopy head branch name to clipboard