Airbnb Creates Hadoop Workflow System: Airflow - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Data Management // Big Data Analytics
News
6/11/2015
10:03 AM
Connect Directly
Twitter
RSS
E-Mail

Airbnb Creates Hadoop Workflow System: Airflow

Airflow workflow system for managing tasks is Airbnb's answer to monitoring the progress of jobs and ensuring that batches run properly in Hadoop.

(Image: Nastco/iStockphoto)

(Image: Nastco/iStockphoto)

Comment  | 
Print  | 
Comments
Newest First  |  Oldest First  |  Threaded View
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
6/12/2015 | 7:44:07 PM
Ah, you didn't approve....?
It was odd at the Hadoop Summit how Beuchemin's first questioner seemed to resent Airbnb creating a new workflow system. He thought the ones already available were fine and Airbnb shouild have invested its efforts in extending one of them. That's somewhat contrary to the spirit of open source code, where a free market fueled by developer choice decides what's worth doing.
News
Top 10 Data and Analytics Trends for 2021
Jessica Davis, Senior Editor, Enterprise Apps,  11/13/2020
Commentary
Where Cloud Spending Might Grow in 2021 and Post-Pandemic
Joao-Pierre S. Ruth, Senior Writer,  11/19/2020
Slideshows
The Ever-Expanding List of C-Level Technology Positions
Cynthia Harvey, Freelance Journalist, InformationWeek,  11/10/2020
White Papers
Register for InformationWeek Newsletters
Video
Current Issue
Why Chatbots Are So Popular Right Now
In this IT Trend Report, you will learn more about why chatbots are gaining traction within businesses, particularly while a pandemic is impacting the world.
Slideshows
Flash Poll