Skip to content

Improve error handling in benchmarks#6675

Merged
cirego merged 1 commit into
MaterializeInc:mainfrom
cirego:chris/improve-benchmark-error-handling
May 7, 2021
Merged

Improve error handling in benchmarks#6675
cirego merged 1 commit into
MaterializeInc:mainfrom
cirego:chris/improve-benchmark-error-handling

Conversation

@cirego
Copy link
Copy Markdown
Contributor

@cirego cirego commented May 6, 2021

If we fail to create views, or if any kgen process exits with
error, then we know the benchmark won't be valid. Ensure that
we exit with error to make sure that the benchmark fails at the
right point instead of timing out or presenting another inscrutable
error.

If we fail to create views, or if any kgen process exits with
error, then we know the benchmark won't be valid. Ensure that
we exit with error to make sure that the benchmark fails at the
right point instead of timing out or presenting another inscrutable
error.
@cirego cirego requested review from aljoscha and sploiselle May 6, 2021 23:42
@cirego cirego self-assigned this May 6, 2021
Copy link
Copy Markdown
Contributor

@aljoscha aljoscha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This makes a lot of sense. Thanks for the changes!

I had one inline question.


for view_file in *.sql; do
psql -h perf-dash-metrics -p 8675 -U materialize -f "${view_file}" materialize
psql -v ON_ERROR_STOP=1 -h perf-dash-metrics -p 8675 -U materialize -f "${view_file}" materialize
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will this also make the scripts exit with 1 or does it just stop psql on the first error it encouters?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Both the script and mzcompose will also exit with error!

@cirego cirego merged commit f441a25 into MaterializeInc:main May 7, 2021
@cirego cirego deleted the chris/improve-benchmark-error-handling branch May 7, 2021 16:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants