Skip to content

Pull requests: alibaba/rtp-llm

New pull request New
57 Open 252 Closed
57 Open 252 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: support return raw prompt and input ids by parameters
#421 opened Dec 2, 2025 by soaringk Loading…
feat: [rocm] support online ptpc quantization for python
#420 opened Dec 2, 2025 by muse-coder Loading…
[wip]refactor: optimize token reorder impl
#419 opened Dec 2, 2025 by MMadhatter Loading…
test: fix openai_response_test
#418 opened Dec 2, 2025 by Vinkle-hzt Loading…
1
feature - add viztracer for inference api
#417 opened Dec 2, 2025 by jianglan89 Loading…
2
feat: [rocm] support online ptpc quantization and reuse cache for python
#416 opened Dec 2, 2025 by muse-coder Loading…
1
Support DeepSeek v3.2 encoding module
#415 opened Dec 2, 2025 by soaringk Loading…
1
refactor gemm
#414 opened Dec 1, 2025 by fff-2013 Loading…
feat: optimize prefill invokeAddFusedQKVBiasTranspose
#413 opened Nov 29, 2025 by Bruce-Lee-LY Loading…
28
fix: fix max context batch size
#412 opened Nov 28, 2025 by JackTan25 Loading…
Performance Optimization for Beam Search
#411 opened Nov 28, 2025 by zhangjianning-zjn Loading…
fix: hold host buffer util next forward
#410 opened Nov 28, 2025 by Vinkle-hzt Loading…
2
feat: deepep default config
#407 opened Nov 26, 2025 by JackTan25 Loading…
10
feat: handle cuda oom error for py model
#406 opened Nov 26, 2025 by MMadhatter Loading…
fix: fix custom_ar bug for rocm
#402 opened Nov 25, 2025 by liaocz Loading…
8
feat: update ar & fuse mla reuse cache
#399 opened Nov 25, 2025 by Nancheng-11 Loading…
Feature/refactor fmha
#397 opened Nov 25, 2025 by alibaba-miji Loading…
fix: remove fallback and fastgen
#393 opened Nov 24, 2025 by xinfei-shi Loading…
3
fix bug: insert to cache only when stream's kv cache is computed
#391 opened Nov 24, 2025 by xinfei-shi Loading…
10
feat: raw request support logprobs
#390 opened Nov 22, 2025 by yinjuncheng Loading…
2
feat: support long seq when pdfusion
#387 opened Nov 20, 2025 by kitaharatomoyo Loading…
feat: replace cuda allocator with virtual memory allocator
#385 opened Nov 20, 2025 by ZhangZhiPku Loading…
refactor: kv cache manager
#382 opened Nov 19, 2025 by SJTUGavinLiu Loading…
48
feat: add remote_connector
#381 opened Nov 19, 2025 by MMeecatfish Loading…
4
feat: frontend support ssl
#380 opened Nov 19, 2025 by dhb010 Loading…
1
ProTip! Filter pull requests by the default branch with base:main.