[QNN-EP] Add GPU to QNN EP factory - #26085
Merged
HectorSVC merged 1 commit intoSep 19, 2025
Merged
Conversation
Contributor
|
@adrianlizarraga @HectorSVC This is the GPU enablement for V2 EP selection that I mentioned in last weeks meeting. Please approve. Thanks. |
Contributor
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
qti-mattsinc
force-pushed
the
dev/mattsinc/enable-gpu-in-qnn-factory
branch
from
September 18, 2025 22:23
810c0e0 to
d4c11fc
Compare
Contributor
Author
|
CI was failing for one of the added autoep tests. Looks like the CI environment does not have the appropriate hardware for running tests on QNN HTP / GPU (judging from default_providers.cc:L253 and from all the Qnn{HTP,GPU}BackendTests skipping), so I've removed it. |
- Enables the GPU backend to be picked up through WinML
qti-mattsinc
force-pushed
the
dev/mattsinc/enable-gpu-in-qnn-factory
branch
from
September 18, 2025 22:30
d4c11fc to
220fc7d
Compare
Contributor
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline |
|
Azure Pipelines successfully started running 4 pipeline(s). |
HectorSVC
approved these changes
Sep 19, 2025
fs-eire
pushed a commit
that referenced
this pull request
Oct 24, 2025
## Description Make the GPU backend visible to users of the WinML API. The V2 EP selection mechanism will now expose the GPU device for QNN. The GPU can be picked when: * The device list contains only GPU * The execution policy is set to PREFER_GPU If multiple devices (e.g. HTP and GPU) are provided to `AppendExecutionProviders_V2`, whichever device was provided last in the list will be used. ## Motivation and Context Required to enable WinML usage with the QNN GPU backend
naomiOvad
pushed a commit
to naomiOvad/onnxruntime
that referenced
this pull request
Nov 2, 2025
## Description Make the GPU backend visible to users of the WinML API. The V2 EP selection mechanism will now expose the GPU device for QNN. The GPU can be picked when: * The device list contains only GPU * The execution policy is set to PREFER_GPU If multiple devices (e.g. HTP and GPU) are provided to `AppendExecutionProviders_V2`, whichever device was provided last in the list will be used. ## Motivation and Context Required to enable WinML usage with the QNN GPU backend
jaholme
pushed a commit
that referenced
this pull request
Nov 13, 2025
## Description Make the GPU backend visible to users of the WinML API. The V2 EP selection mechanism will now expose the GPU device for QNN. The GPU can be picked when: * The device list contains only GPU * The execution policy is set to PREFER_GPU If multiple devices (e.g. HTP and GPU) are provided to `AppendExecutionProviders_V2`, whichever device was provided last in the list will be used. ## Motivation and Context Required to enable WinML usage with the QNN GPU backend
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Make the GPU backend visible to users of the WinML API.
The V2 EP selection mechanism will now expose the GPU device for QNN. The GPU can be picked when:
If multiple devices (e.g. HTP and GPU) are provided to
AppendExecutionProviders_V2, whichever device was provided last in the list will be used.Motivation and Context
Required to enable WinML usage with the QNN GPU backend