[VitisAI] Add support compiled model compatibility information retrieval and validation #26699
+96
−0
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ompatibility information retrieval and validation - Implemented GetCompiledModelCompatibilityInfo to collect compatibility info from execution providers. - Added ValidateCompiledModelCompatibilityInfo to validate compatibility info against the runtime environment. - Updated global API to include new functions for compatibility info handling. Refactor Vitis AI EP API: Update compatibility info functions to return status codes - Changed return types of get_compiled_model_compatibility_info and validate_compiled_model_compatibility_info to int for better error handling. - Updated function calls to check status codes before processing compatibility information. - Adjusted parameters in validate_compiled_model_compatibility_info to accommodate device information handling.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Adds support for compiled model compatibility information retrieval and validation in the VitisAI EP. This enables runtime validation of compiled models against the execution environment to prevent failures and provide clear compatibility feedback.
Key Changes:
GetCompiledModelCompatibilityInfoto collect and serialize compatibility metadata during model compilationValidateCompiledModelCompatibilityInfoto validate compatibility at runtime against the current environmentMotivation and Context
Compiled models may fail at runtime due to missing backend plugins, version mismatches, or hardware platform differences.
The ONNXRuntime add 2 API for support compiled model compatibility validation system . Ref PRs:
#25841
#25749
This PR implements a compatibility validation system for Vitis AI EP that: