Skip to content

Introduce output type/shape validation - #17301

Merged
yuslepukhin merged 12 commits into
mainfrom
yuslepukhin/check_user_supplied_outputs_simple
Sep 5, 2023
Merged

Introduce output type/shape validation#17301
yuslepukhin merged 12 commits into
mainfrom
yuslepukhin/check_user_supplied_outputs_simple

Conversation

@yuslepukhin

@yuslepukhin yuslepukhin commented Aug 25, 2023

Copy link
Copy Markdown
Contributor

Description

Validate outputs type and shapes. Make sure sparse initializers are taken into account.

Motivation and Context

ORT currently does not validate output types or shapes. Further, neither inputs or outputs take into account sparse initializers that are converted from dense.

It is currently possible to pre-allocate a wrong type/shape buffer for output.

Cc: @Craigacp

Comment thread onnxruntime/test/shared_lib/test_inference.cc
Comment thread onnxruntime/core/session/inference_session.cc
Comment thread onnxruntime/core/session/inference_session.cc Outdated
Comment thread onnxruntime/core/session/inference_session.cc Outdated
Comment thread onnxruntime/core/session/inference_session.cc Outdated
Comment thread onnxruntime/core/session/inference_session.cc Outdated
Comment thread onnxruntime/core/session/inference_session.h Outdated
Comment thread onnxruntime/core/session/inference_session.h Outdated
skottmckay
skottmckay previously approved these changes Aug 31, 2023

@skottmckay skottmckay left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

edgchen1
edgchen1 previously approved these changes Aug 31, 2023
Comment thread onnxruntime/test/framework/execution_frame_test.cc
Comment thread onnxruntime/core/session/inference_session.cc Outdated
Comment thread onnxruntime/core/session/inference_session.cc Outdated
@yuslepukhin
yuslepukhin dismissed stale reviews from edgchen1 and skottmckay via 30a8ba3 September 5, 2023 18:43
@yuslepukhin
yuslepukhin merged commit dbcc60b into main Sep 5, 2023
@yuslepukhin
yuslepukhin deleted the yuslepukhin/check_user_supplied_outputs_simple branch September 5, 2023 22:25
yuslepukhin added a commit that referenced this pull request Nov 16, 2023
### Description
Allow empty shapes and do not validate them for inputs/outputs at the
InferenceSession::ValidateInputsOutputs().

### Motivation and Context
#17301 disallowed empty
shapes.
However, many models depend on them as a way to pass shapes of different
ranks.
kleiti pushed a commit to kleiti/onnxruntime that referenced this pull request Mar 22, 2024
### Description
Validate outputs type and shapes. Make sure sparse initializers are
taken into account.

### Motivation and Context
ORT currently does not validate output types or shapes. Further, neither
inputs or outputs take into account sparse initializers that are
converted from dense.

It is currently possible to pre-allocate a wrong type/shape buffer for
output.

Cc: @Craigacp
kleiti pushed a commit to kleiti/onnxruntime that referenced this pull request Mar 22, 2024
…soft#18442)

### Description
Allow empty shapes and do not validate them for inputs/outputs at the
InferenceSession::ValidateInputsOutputs().

### Motivation and Context
microsoft#17301 disallowed empty
shapes.
However, many models depend on them as a way to pass shapes of different
ranks.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants