airflow db clean - Dag cleanup won't run if dag is tagged

[jrggggg]

Apache Airflow version

2.3.0 (latest released)

What happened

When running airflow db clean, if a to-be-cleaned dag is also tagged, a foreign key constraint in dag_tag is violated. Full error:

sqlalchemy.exc.IntegrityError: (psycopg2.errors.ForeignKeyViolation) update or delete on table "dag" violates foreign key constraint "dag_tag_dag_id_fkey" on table "dag_tag"
DETAIL:  Key (dag_id)=(some-dag-id-here) is still referenced from table "dag_tag".

What you think should happen instead

No response

How to reproduce

No response

Operating System

Debian GNU/Linux 11 (bullseye)

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==3.3.0
apache-airflow-providers-cncf-kubernetes==4.0.1
apache-airflow-providers-ftp==2.1.2
apache-airflow-providers-http==2.1.2
apache-airflow-providers-imap==2.2.3
apache-airflow-providers-microsoft-mssql==2.1.3
apache-airflow-providers-oracle==2.2.3
apache-airflow-providers-postgres==4.1.0
apache-airflow-providers-samba==3.0.4
apache-airflow-providers-slack==4.2.3
apache-airflow-providers-sqlite==2.1.3
apache-airflow-providers-ssh==2.4.3

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template!

[ephraimbuddy]

Related: #23206

[nirutgupta]

I am seeing the same issue in 2.3.0
[2022-06-27, 12:27:29 UTC] {subprocess.py:92} INFO - sqlalchemy.exc.IntegrityError: (psycopg2.errors.ForeignKeyViolation) update or delete on table "dag" violates foreign key constraint "dag_tag_dag_id_fkey" on table "dag_tag" [2022-06-27, 12:27:29 UTC] {subprocess.py:92} INFO - DETAIL: Key (dag_id)=(test_base_config) is still referenced from table "dag_tag".

[ephraimbuddy]

I am seeing the same issue in 2.3.0 [2022-06-27, 12:27:29 UTC] {subprocess.py:92} INFO - sqlalchemy.exc.IntegrityError: (psycopg2.errors.ForeignKeyViolation) update or delete on table "dag" violates foreign key constraint "dag_tag_dag_id_fkey" on table "dag_tag" [2022-06-27, 12:27:29 UTC] {subprocess.py:92} INFO - DETAIL: Key (dag_id)=(test_base_config) is still referenced from table "dag_tag".

It's fixed in 2.3.2

[anka0618]

I see the same issue when i run start task in one of my dags. I am using airflow 2.4.3 version.

sqlalchemy.exc.IntegrityError: (psycopg2.errors.ForeignKeyViolation) update or delete on table "dag_run" violates foreign key constraint "task_instance_dag_run_fkey" on table "task_instance"

[swathida-byte]

same, I still see this error
sqlalchemy.exc.IntegrityError: (psycopg2.errors.ForeignKeyViolation) update or delete on table "dag" violates foreign key constraint "dag_tag_dag_id_fkey" on table "dag_tag"
Key (dag_id)=(status_notify_QATS) is still referenced from table "dag_tag".

[anka0618]

Any suggestions would be appreciated.

[ephraimbuddy]

If you are still seeing this issue, please create a new issue and describe your setup and how to reproduce it. Thanks