Skip to content

Conversation

@edgchen1
Copy link
Contributor

@edgchen1 edgchen1 commented Nov 18, 2025

Description

Upgrade cpuinfo version.
Update ARM64 Windows feature detection to use cpuinfo functions which are now implemented.
Add helper function MlasIsDynamicQGemmAvailable() to abstract away platform-specific checks.

Motivation and Context

Additional ARM64 Windows feature detection was implemented in cpuinfo in this commit. Update ORT to use the newly implemented feature detection.

#if defined(USE_KLEIDIAI) && !defined(_MSC_VER)
return ArmKleidiAI::UseSME2;
#else
return false;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we add a TODO here with relevant commentary and a reminder to adjust these checks once KAI support for Windows is added ?

@edgchen1 edgchen1 changed the title Upgrade cpuinfo version. Update ARM64 Windows feature detection to use cpuinfo functions which are now implemented. Upgrade cpuinfo version and update some CPU feature detection code Nov 19, 2025
// Note:
// cpuinfo is using IsProcessorFeaturePresent(PF_ARM_V82_FP16_INSTRUCTIONS_AVAILABLE):
// https://github.com/pytorch/cpuinfo/blob/403d652dca4c1046e8145950b1c0997a9f748b57/src/arm/windows/init.c#L224-L225
// However, on some systems (notably, a Windows ARM64 CI build agent), cpuinfo_has_arm_neon_fp16_arith() started to
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should cpuinfo be notified to treat this as a regression in detection of fp16 support in their newer implementation if their new way (seemingly) doesn't detect fp16 reliably on certain Windows versions ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah, it would be good to fix it there

Copy link
Contributor Author

@edgchen1 edgchen1 Nov 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

created a PR: pytorch/cpuinfo#348

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants