[Python] Airflow latency between tasks

As you can see in the image : airflow is making too much time between tasks execution ? it almost represents 30% of the DAG execution time. I've changed the airflow.cfg file to:

job_heartbeat_sec = 1
scheduler_heartbeat_sec = 1


but I still have the same latency rate.

Why does it behave this way ?

Continue reading...