Apache Airflow version
Other Airflow 2 version (please specify below)
What happened
I tested BigQueryInsertJobOperator with deferrable mode enabled.
I used Google Cloud Composer 2.4.0 with airflow version 2.4.3
The BigQuery's region is asia-northeast1 region. The operator ran fine before but I got Job not found error after enabling deferrable mode. At first I thought it was because I didn't specify location parameter in BigQueryInsertJobOperator. However, even after changing it, I still got the Job not found error.
After taking a quick look at the source code, I guess maybe the cause is BigQuery Trigger doesn't include location in it's parameters.
The code
|
job_status = await hook.get_job_status(job_id=self.job_id, project_id=self.project_id) |
BigQuery get job API doc

What you think should happen instead
No response
How to reproduce
Execute BigQueryInsertJobOperator using asia-northeast1 BigQuery region
Operating System
It's not OS. I used Google Cloud Composer 2.4.0 with airflow version 2.4.3
Versions of Apache Airflow Providers
No response
Deployment
Google Cloud Composer
Deployment details
No response
Anything else
No response
Are you willing to submit PR?
Code of Conduct
Apache Airflow version
Other Airflow 2 version (please specify below)
What happened
I tested
BigQueryInsertJobOperatorwith deferrable mode enabled.I used Google Cloud Composer 2.4.0 with airflow version 2.4.3
The BigQuery's region is
asia-northeast1region. The operator ran fine before but I gotJob not founderror after enabling deferrable mode. At first I thought it was because I didn't specifylocationparameter inBigQueryInsertJobOperator. However, even after changing it, I still got theJob not founderror.After taking a quick look at the source code, I guess maybe the cause is BigQuery Trigger doesn't include
locationin it's parameters.The code
airflow/airflow/providers/google/cloud/triggers/bigquery.py
Line 90 in 0e157b3
BigQuery get job API doc

What you think should happen instead
No response
How to reproduce
Execute
BigQueryInsertJobOperatorusingasia-northeast1BigQuery regionOperating System
It's not OS. I used Google Cloud Composer 2.4.0 with airflow version 2.4.3
Versions of Apache Airflow Providers
No response
Deployment
Google Cloud Composer
Deployment details
No response
Anything else
No response
Are you willing to submit PR?
Code of Conduct