Skip to content

Add use_rest_api parameter for CloudComposerDAGRunSensor for pulling dag_runs using the Airflow REST API#56138

Merged
shahar1 merged 1 commit into
apache:mainfrom
VladaZakharova:add-use-rest-api-param
Oct 9, 2025
Merged

Add use_rest_api parameter for CloudComposerDAGRunSensor for pulling dag_runs using the Airflow REST API#56138
shahar1 merged 1 commit into
apache:mainfrom
VladaZakharova:add-use-rest-api-param

Conversation

@MaksYermak

Copy link
Copy Markdown
Contributor

In this PR I have added the use_rest_api parameter for CloudComposerDAGRunSensor. This parameter can control usage of the Airflow REST API for pulling dag_runs. It can be useful for users because the current command for pulling dag_runs based on gcloud, consumes quota and scales poorly.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborg boring-cyborg Bot added area:providers provider:google Google (including GCP) related issues labels Sep 26, 2025
Comment thread providers/google/src/airflow/providers/google/cloud/hooks/cloud_composer.py Outdated
Comment thread providers/google/src/airflow/providers/google/cloud/hooks/cloud_composer.py Outdated
@MaksYermak
MaksYermak force-pushed the add-use-rest-api-param branch from 183eaa0 to 6bc9f61 Compare September 29, 2025 09:05
@VladaZakharova

Copy link
Copy Markdown
Contributor

@eladkal @potiuk
Can you please check this PR? :)

@VladaZakharova

Copy link
Copy Markdown
Contributor

@shahar1 Hi there! can you please check this PR? :)

@shahar1 shahar1 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@shahar1
shahar1 merged commit fcc28a5 into apache:main Oct 9, 2025
80 checks passed
dabla pushed a commit to dabla/airflow that referenced this pull request Oct 12, 2025
TyrellHaywood pushed a commit to TyrellHaywood/airflow that referenced this pull request Oct 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers provider:google Google (including GCP) related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants