Skip to content

openlineage: notify that logged exception was caught#39493

Merged
mobuchowski merged 1 commit intomainfrom
notify-exception-caught
May 8, 2024
Merged

openlineage: notify that logged exception was caught#39493
mobuchowski merged 1 commit intomainfrom
notify-exception-caught

Conversation

@mobuchowski
Copy link
Copy Markdown
Contributor

As part of OL listener we catch any exceptions generated by OL implementation: most important feature of OL integration should be to not impact user code. However, we log any potential exceptions.

There's a common issue of people looking at some errors, for example overloaded or buggy OL backend 502ing, which causes the exception stack trace to be written, and assuming it impacts their jobs.

This PR adds warning explaining it's not the case.

Signed-off-by: Maciej Obuchowski <obuchowski.maciej@gmail.com>
Copy link
Copy Markdown
Collaborator

@kacpermuda kacpermuda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mobuchowski mobuchowski merged commit 02ce7f1 into main May 8, 2024
pateash pushed a commit to pateash/airflow that referenced this pull request May 13, 2024
Signed-off-by: Maciej Obuchowski <obuchowski.maciej@gmail.com>
@eladkal eladkal deleted the notify-exception-caught branch June 29, 2024 17:31
romsharon98 pushed a commit to romsharon98/airflow that referenced this pull request Jul 26, 2024
Signed-off-by: Maciej Obuchowski <obuchowski.maciej@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants