Skip to content

feat: deepep default config #407

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Dec 3, 2025
Merged

feat: deepep default config #407

merged 3 commits into from
Dec 3, 2025

Conversation

@JackTan25
Copy link
Collaborator

@JackTan25 JackTan25 commented Nov 26, 2025 •
edited
Loading

如果开启了USE_ALL_GATHER的话（一般纯TP的情况下，TP=EP才开启），USE_DEEPEP_MOE，USE_DEEPEP_LOW_LATENCY，USE_DEEPEP_INTERNODE这三个就是无脑为0，否则执行下面的决策:

角色 节点类型 规格 USE_DEEPEP_MOE USE_DEEPEP_LOW_LATENCY USE_DEEPEP_INTERNODE
非PD分离 Inference 节点 单卡：1TP 0 0 0
非PD分离 Inference 节点 单机多卡：> 1TP 1 0 0
非PD分离 Inference 节点 多机多卡 1 0 1
PD分离 Prefill 节点 单机单卡 1TP 0 0 0
PD分离 Decode 节点 单机单卡 1TP 0 0 0
PD分离 Prefill 节点 单机多卡（2卡～8卡） 1 0 0
PD分离 Decode 节点 单机多卡（2卡～8卡） 1 1 0
PD分离 Prefill 节点 多机多卡（>= 9卡） 1 0 1
PD分离 Decode 节点 多机多卡（>= 9卡） 1 1 1

@JackTan25 JackTan25 requested a review from LLLLKKKK as a code owner November 26, 2025 12:48
@JackTan25 JackTan25 requested a review from jianglan89 November 26, 2025 12:48
@JackTan25 JackTan25 force-pushed the feature/default_deep_ep_settings branch 2 times, most recently from 8b18772 to c4f4b76 Compare November 28, 2025 06:11
@JackTan25 JackTan25 force-pushed the feature/default_deep_ep_settings branch from c4f4b76 to 9ecfef2 Compare November 28, 2025 08:04
@github-actions
Copy link

github-actions bot commented Nov 30, 2025

internal source has been updated, please review the changes!

@JackTan25 JackTan25 force-pushed the feature/default_deep_ep_settings branch 6 times, most recently from c10886d to 0e67835 Compare December 2, 2025 02:44
@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

@JackTan25 JackTan25 force-pushed the feature/default_deep_ep_settings branch from 0e67835 to 470f681 Compare December 2, 2025 06:09
@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

9 similar comments
@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 2, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 3, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 3, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 3, 2025

internal source has been updated, please review the changes!

2 similar comments
@github-actions
Copy link

github-actions bot commented Dec 3, 2025

internal source has been updated, please review the changes!

@github-actions
Copy link

github-actions bot commented Dec 3, 2025

internal source has been updated, please review the changes!

@LLLLKKKK LLLLKKKK merged commit 0387600 into main Dec 3, 2025
7 of 9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@LLLLKKKK LLLLKKKK LLLLKKKK approved these changes

@jianglan89 jianglan89 Awaiting requested review from jianglan89

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@JackTan25 @LLLLKKKK