Skip to content

Fix WorkflowTrigger to work with TaskSDK#48819

Merged
gopidesupavan merged 12 commits into
apache:mainfrom
gopidesupavan:fix-workflow-trigger-deferrabe
Apr 9, 2025
Merged

Fix WorkflowTrigger to work with TaskSDK#48819
gopidesupavan merged 12 commits into
apache:mainfrom
gopidesupavan:fix-workflow-trigger-deferrabe

Conversation

@gopidesupavan

Copy link
Copy Markdown
Member

closes: #48425

image

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@gopidesupavan

Copy link
Copy Markdown
Member Author

@ashb @kaxil i have see that even for WorkflowTrigger, when multiple tasks in deferrable, the messages are mixing up. This happens only when continuously tasks entering into trigger.

image

@gopidesupavan

Copy link
Copy Markdown
Member Author

Also this is ready for review..

Comment thread task-sdk/src/airflow/sdk/execution_time/context.py
@kaxil

kaxil commented Apr 8, 2025

Copy link
Copy Markdown
Member

@gopidesupavan Could you resolve the coflicts please?

@gopidesupavan
gopidesupavan force-pushed the fix-workflow-trigger-deferrabe branch from 27382f3 to 54d8231 Compare April 8, 2025 16:10
@gopidesupavan

Copy link
Copy Markdown
Member Author

@gopidesupavan Could you resolve the coflicts please?

Yeah rebased now..

Comment thread providers/standard/src/airflow/providers/standard/sensors/external_task.py Outdated
@gopidesupavan
gopidesupavan force-pushed the fix-workflow-trigger-deferrabe branch 2 times, most recently from 583c828 to b02352e Compare April 8, 2025 21:43

@kaxil kaxil left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure of the task group thing, rest lgtm

@kaxil
kaxil force-pushed the fix-workflow-trigger-deferrabe branch from b02352e to 177234d Compare April 9, 2025 13:37
@kaxil

kaxil commented Apr 9, 2025

Copy link
Copy Markdown
Member

(I rebased on main since the failures are fixed in main already I think)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

WorkflowTrigger does not work with direct db access

3 participants