Comments
Google I/O: Hello Dataflow, Goodbye MapReduce
Newest First  |  Oldest First  |  Threaded View
senorcarbone
50%
50%
senorcarbone,
User Rank: Apprentice
7/3/2014 | 9:56:10 AM
Re: Dataflow implications for Hadoop community?
You can take a look on the following Apache incubator projects as the open source equivalents on parallel dataflow processing

- Apache Tez (https://tez.incubator.apache.org/)

- Apache Flink (former Stratosphere) (https://github.com/apache/incubator-flink
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
6/27/2014 | 8:15:00 PM
Google's goal: a competitive service
Agreed, many implications for Hadoop and other open source communities, Doug. There was no discussion on those issues that I got to witness at Google I/O. The thing I see is Google using its data handling expertise to build a competitive cloud service, let the chips fall where they may.
D. Henschen
50%
50%
D. Henschen,
User Rank: Author
6/27/2014 | 11:38:02 AM
Dataflow implications for Hadoop community?
Charlie, this Dataflow announcement would seem to have huge implications for the Hadoop community, given that that platform was inspired by Google's technologies and white papers. With the introduction of YARN, the Hadoop community, too, has been moving away from MapReduce, but what's the Hadoop world's equivalent of Dataflow? Was anybody drawing parallels/similarities to Apache Spark or Apache Storm, for example?


Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest, Nov. 10, 2014
Just 30% of respondents to our new survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives?
Video
Slideshows
Twitter Feed
InformationWeek Radio
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.