[Python] How to re-rerun the dag which was already executed using TriggerDagrunoperator?

Discussão em 'Python' iniciado por Stack, Setembro 16, 2024.

  1. Stack

    Stack Membro Participativo

    I have a dag,where i'm using list of below operators

    • TriggerDagrunoperator-to trigger another dag
    • ExternalTaskSensor-Get the status of triggered dag

    My use case: Say for instance, if entire flow completed successfully, and i found some issue with processing of data in between. I want to re-run the job for that particular execution date from point of issue. I cleared the downstream and it makes the job to re-run. But, TriggerDagrunoperator fails with below issue.

    airflow.exceptions.DagRunAlreadyExists: Run id triggered_ : already exists for dag id

    I want to clear that and need to re-run the dag again for that particular execution date. Any better way to accomplish that?

    Continue reading...

Compartilhe esta Página