Skip to content

ELE 518 Don't add details of Passed tests in Warnings#751

Closed
RoiTabach wants to merge 49 commits intomasterfrom
ele-518-passed-tests-are-listed-with-the
Closed

ELE 518 Don't add details of Passed tests in Warnings#751
RoiTabach wants to merge 49 commits intomasterfrom
ele-518-passed-tests-are-listed-with-the

Conversation

@RoiTabach
Copy link
Copy Markdown
Contributor

No description provided.

@linear
Copy link
Copy Markdown

linear bot commented Mar 15, 2023

ELE-518 Passed tests are listed with the Warnings in edr monitor report slack summary

Describe the bug
In the slack message that is sent with the report, we count correctly which of the tests are passed/failed/warning. However, when creating the details section, we count passed tests along with the warnings.

To Reproduce
Steps to reproduce the behavior:

  1. Run dbt and have a small number of Passing tests. (I added a not_null test on the one model from our integration tests and ran dbt build -s one
  2. Run edr monitor send-report
  3. Look at the summary numbers
  4. See the passed tests are counted properly but listed with the Warnings.

Expected behavior
No details for passed tests.

Screenshots

Environment (please complete the following information):

  • edr Version: [e.g. 0.5.3], can be found by running pip show elementary-data
  • dbt package Version: [e.g. 0.4.1], can be found in packages.yml file

Additional context
Raised in Slack thread https://elementary-community.slack.com/archives/C02CTC89LAX/p1678878540310359
I believe the fact we truncate the report on Slack if it's got too many items caused us to not see it even tho it was there for a long time - since we usually test with 100+ issues so the details view is usually not seen.

@github-actions
Copy link
Copy Markdown
Contributor

👋 @RoiTabach
Thank you for raising your pull request.
Please make sure to add tests and document all user-facing changes.
You can do this by editing the docs files in this pull request.

Copy link
Copy Markdown
Contributor

@IDoneShaveIt IDoneShaveIt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved with one small comment 🙂

failed_tests_details.extend(
self._get_test_result_details_block(test, include_description)
)
elif test.status == "pass":
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it will be better to replace the elif pass with elif warning and the rest will be skipped :)

@RoiTabach
Copy link
Copy Markdown
Contributor Author

opened #767 instead of this one

@RoiTabach RoiTabach closed this Mar 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ELE-518] Passed tests are listed with the Warnings in edr monitor report slack summary

6 participants