Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
How Sift Science Trains Thousands of Models Using Apache Airflow (siftscience.com)
14 points by noodlesoup on March 20, 2018 | hide | past | favorite | 1 comment


I'm a big fan of Airflow. Used it to replace our "Python script run on a cron" batch ETL process - you have to conform to Airflow's model of DAGs and operators, but it's really good for monitoring a workflow and restarting it from a failed task etc.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: