Adding example dag for task state store with mapped tasks#68670
Merged
amoghrajesh merged 2 commits intoJun 18, 2026
Conversation
(cherry picked from commit 0112455111834a52de6824be7fc8084def992bcd)
jroachgolf84
approved these changes
Jun 17, 2026
vincbeck
approved these changes
Jun 17, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Was generative AI tooling used to co-author this PR?
What
example_task_state_store.pyshows the crash-recovery pattern for a single task instance. There was no example showing howtask_state_storebehaves with mapped tasks, specifically that eachmap_indexgets its own isolated store, so sibling instances cannot collide on keys.Change
Adding a new dag:
example_task_state_store_mapped.py.get_tablestask produces a list of table names,process_tableis expanded over that list.table,status,row_count, andresultkeys totask_state_store, demonstrating that the store is scoped per(dag_id, run_id, task_id, map_index)and not shared across sibling instances.Observe the differences of map_index in the screenshots below:
{pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.