-
Notifications
You must be signed in to change notification settings - Fork 589
Initial draft for Inference submission guide #2378
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
|
MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅ |
|
|
||
| For questions or clarifications: | ||
|
|
||
| - Join the [MLPerf Inference mailing list](). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could anyone point me towards where to find the link to the MLPerf Inference mailing list?
| This document provides a step-by-step overview of the **MLPerf Inference submission process**. | ||
|
|
||
| --- | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Consider adding a "Happy path" first at the top, with end to end minimal flow (model → dataset → LoadGen run → results bundle → submission checker → upload) and then link to detailed sections
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
hi @tanvi-mlcommons, do you mean something like a table of contents?
| <placeholder_for_model_download_link> | ||
|
|
||
| 4. **Configure Environment** | ||
| Set up the required dependencies, environment variables, and system configurations for benchmarking. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We have a automation scrip that helps with some of system config right? Can we add - how to do this with that script steps?
| --- | ||
|
|
||
| ## 7. Support | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should have a Troubleshooting section with common failure scenarios and detailed steps to troubleshoot
This PR intends to give a brief instruction about doing a MLPerf Inference Submission for new submitters as well as ones with limited prior knowledge. Some of the contents are taken from the previous round submission orientation slides and from policies repo.