Skip to content

[WebNN EP] Create MLGraphBuilder for every model builder - #21514

Merged
fdwr merged 2 commits into
microsoft:mainfrom
Honry:dont-reuse-builder
Aug 1, 2024
Merged

[WebNN EP] Create MLGraphBuilder for every model builder#21514
fdwr merged 2 commits into
microsoft:mainfrom
Honry:dont-reuse-builder

Conversation

@Honry

@Honry Honry commented Jul 26, 2024

Copy link
Copy Markdown
Contributor

Currently WebNN spec only allows MLGraphBuilder.build() to be called once, we need to create new builder for every subgraph in WebNN EP.

Spec change: webmachinelearning/webnn#717

@Honry

Honry commented Jul 26, 2024

Copy link
Copy Markdown
Contributor Author

@fdwr, @guschmue, @huningxin, PTAL, thanks!

@huningxin huningxin left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with a comment.

BTW, you may want to refer to the spec change PR: webmachinelearning/webnn#717

Comment thread onnxruntime/core/providers/webnn/builders/model_builder.h Outdated

@huningxin huningxin left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@fdwr fdwr left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@fdwr fdwr added the ep:WebNN WebNN execution provider label Jul 26, 2024
@fdwr

fdwr commented Jul 26, 2024

Copy link
Copy Markdown
Contributor

/azp run ONNX Runtime Web CI Pipeline,Windows GPU CI Pipeline,Linux Android Emulator QNN CI Pipeline

@fdwr

fdwr commented Jul 26, 2024

Copy link
Copy Markdown
Contributor

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

@fdwr

fdwr commented Jul 26, 2024

Copy link
Copy Markdown
Contributor

/azp run Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline,Big Models

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 3 pipeline(s).

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 7 pipeline(s).

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 9 pipeline(s).

@fdwr

fdwr commented Jul 30, 2024

Copy link
Copy Markdown
Contributor

/azp run Windows GPU TensorRT CI Pipeline

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@Honry
Honry force-pushed the dont-reuse-builder branch from 5a7c92b to c7b3eae Compare July 30, 2024 06:47
@fdwr

fdwr commented Jul 30, 2024

Copy link
Copy Markdown
Contributor

/azp run ONNX Runtime Web CI Pipeline,Windows GPU CI Pipeline,Linux Android Emulator QNN CI Pipeline

@fdwr

fdwr commented Jul 30, 2024

Copy link
Copy Markdown
Contributor

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

@fdwr

fdwr commented Jul 30, 2024

Copy link
Copy Markdown
Contributor

/azp run Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline,Big Models

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 2 pipeline(s).

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 7 pipeline(s).

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 9 pipeline(s).

@fdwr

fdwr commented Jul 31, 2024

Copy link
Copy Markdown
Contributor

@Honry Merge with your most recent change for the Web CI failures?

Honry added 2 commits August 1, 2024 08:19
Currently WebNN spec only allows MLGraphBuilder.build() to be called
once, we need to create builder for every subgraph in WebNN EP.
@Honry
Honry force-pushed the dont-reuse-builder branch from c7b3eae to 57dbebb Compare August 1, 2024 00:23
@Honry

Honry commented Aug 1, 2024

Copy link
Copy Markdown
Contributor Author

@Honry Merge with your most recent change for the Web CI failures?

Sure, done, pls. help retrigger the CI. Thanks!

@fdwr

fdwr commented Aug 1, 2024

Copy link
Copy Markdown
Contributor

/azp run ONNX Runtime Web CI Pipeline,Windows GPU CI Pipeline,Linux Android Emulator QNN CI Pipeline

@fdwr

fdwr commented Aug 1, 2024

Copy link
Copy Markdown
Contributor

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

@fdwr

fdwr commented Aug 1, 2024

Copy link
Copy Markdown
Contributor

/azp run Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline,Big Models

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 2 pipeline(s).

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 7 pipeline(s).

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 9 pipeline(s).

@fdwr
fdwr merged commit 8c2ee7b into microsoft:main Aug 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ep:WebNN WebNN execution provider

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants