Apache Airlfow is a python Flask app that is meant for handling data pipelines. It’s currently in the incubation stage with the Apache Foundation to determine if it should be adopted as a full-fledged Apache project.
The developer mailing list gets JIRA notifications and Github notifications and can be noisy. If you join I recommend setting up labels/filters/rules. The Gitter is great for asking questions live, but you have to scroll back through a lot or watch it consistently to learn from it.
Here are useful posts to reference:
- Getting started developing workflows with Apache Airflow - Mar. 17, 2017
- Airflow Lessons from the Data Engineering Front in Chicago - Nov. 13, 2017 (by me )