Skip to content

GlueJobOperator in verbose mode do not pull logs correctly #56535

@adamgorkaextbi

Description

@adamgorkaextbi

Apache Airflow Provider(s)

amazon

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==9.10.0 up to newest at current time 9.15.0

Apache Airflow version

2.11.0

Operating System

Debian GNU/Linux 12

Deployment

Official Apache Airflow Helm Chart

Deployment details

official helm chart

What happened

GlueJobOperator in dereferable mode, wait_for_completion=true, verbose=true mode is not pulling logs
newly introduced
waiter_with_logging is not working correctly
[2025-10-09, 22:25:23 UTC] {waiter_with_logging.py:158} INFO - Status of AWS Glue job is: RUNNING

What you think should happen instead

I should see glue logs in airflow UI i task details log section

How to reproduce

run GlueJobOperator in dereferable mode,
wait_for_completion=true, verbose=true

Anything else

all the time

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions