Skip to content

Expose count of scheduled tasks in metrics#38899

Merged
potiuk merged 1 commit intoapache:mainfrom
jonshea:expose-scheduled-task-count-in-metrics
Apr 22, 2024
Merged

Expose count of scheduled tasks in metrics#38899
potiuk merged 1 commit intoapache:mainfrom
jonshea:expose-scheduled-task-count-in-metrics

Conversation

@jonshea
Copy link
Copy Markdown
Contributor

@jonshea jonshea commented Apr 10, 2024

This pull request introduces a new metric that tracks the number of tasks in the SCHEDULED state. This can help with monitoring and debugging situations where tasks are stuck or otherwise accumulate in the SCHEDULED state.

@boring-cyborg boring-cyborg bot added area:Scheduler including HA (high availability) scheduler kind:documentation labels Apr 10, 2024
@jonshea jonshea force-pushed the expose-scheduled-task-count-in-metrics branch from 30725fe to 2dd8091 Compare April 10, 2024 15:17
@jonshea jonshea force-pushed the expose-scheduled-task-count-in-metrics branch from 2dd8091 to 1f2a538 Compare April 22, 2024 07:49
This pull request introduces a new metric that tracks the number of
tasks in the SCHEDULED state. This can help with monitoring and
debugging situations where tasks are stuck or otherwise accumulate in
the `SCHEDULED` state.
@jonshea jonshea force-pushed the expose-scheduled-task-count-in-metrics branch from 1f2a538 to 3ba77c8 Compare April 22, 2024 07:55
@jonshea
Copy link
Copy Markdown
Contributor Author

jonshea commented Apr 22, 2024

I have rebased on top of main to fix merge conflicts in test_pool.py. The conflicts were just that the pattern for creating a test task instance had changed from TI(task=op1, execution_date=DEFAULT_DATE) to TI(task=op1, run_id=dr.run_id).

@potiuk potiuk merged commit 667ee1b into apache:main Apr 22, 2024
@rawwar rawwar mentioned this pull request May 25, 2024
2 tasks
@utkarsharma2 utkarsharma2 added the type:improvement Changelog: Improvements label Jun 3, 2024
@utkarsharma2 utkarsharma2 added this to the Airflow 2.10.0 milestone Jun 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Scheduler including HA (high availability) scheduler kind:documentation type:improvement Changelog: Improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants