Abort a DAG Run

[fbertos]

Description

It would be great having a option to abort a DAG Runs through the REST API.

Use case / motivation

The proposed input params would be:

• DAG_ID
• DAG_RUN_ID

The DAG Run should abort all its tasks running and mark them as "failed".

Are you willing to submit a PR?

Related Issues

[alexing]

I still can't believe this hasn't been implemented yet, seems like a no brainer.

I am currently in need of this feature, and the only workaround i found is modifying the DB and marking the relevant task instances as failed. Seems like overkill for such a small task.

[fbertos]

Hi @alexing,

We tried a different approach through the REST API to avoid touching the DB, this a code example:

    run_id = str(sys.argv[2])

    # We get first the task instance of the DAG run
    r = requests.get('http://localhost:8081/api/v1/dags/' + dag_id + '/dagRuns/' + str(run_id) + '/taskInstances?state=running', 
        auth=HTTPBasicAuth('admin', 'admin'))

    print(r.json()['task_instances'][0])
    task_id = r.json()['task_instances'][0]['task_id']
    execution_date = r.json()['task_instances'][0]['execution_date']

    # We set the tasks to failed
    r = requests.post('http://localhost:8081/api/v1/dags/' + dag_id + '/updateTaskInstancesState', 
        json={"dry_run": False,
            "task_id": str(task_id), 
            "execution_date": str(execution_date),
            "include_upstream": False,
            "include_downstream": False,
            "include_future": False,
            "include_past": False,
            "new_state": "failed" 
        },
        auth=HTTPBasicAuth('admin', 'admin'))

    if r.status_code == 200:
        print("Dag aborted")

I hope it helps.

[alexing]

Well, we thought similar solutions for sure. Yours is a bit better designed! Thanks! I'll take into account.

Still, this is a basic feature that should have been implemented by apache a long time ago!

[eladkal]

I still can't believe this hasn't been implemented yet, seems like a no brainer.

Still, this is a basic feature that should have been implemented by apache a long time ago!

Many needed features and capabilities hasn't been implemented yet.
It's a community based project so what we have is what the community contribute.

We welcome PRs :)

[potiuk]

I still can't believe this hasn't been implemented yet, seems like a no brainer.

Still, this is a basic feature that should have been implemented by apache a long time ago!

Many needed features and capabilities hasn't been implemented yet.
It's a community based project so what we have is what the community contribute.

We welcome PRs :)

Indeed. We even will run workshop for first-time contributors at the Airflow Summit in July. More info soon. @alexing - would you be interested in taking part and contributing? It will be very cheap (all proceedings go to Apache Software Foundation). Happy to keep place for you. Contributing back is the best way to thank all the contributors who make the software available for free for you!