Comments
Google I/O: Hello Dataflow, Goodbye MapReduce
Newest First  |  Oldest First  |  Threaded View
senorcarbone
50%
50%
senorcarbone,
User Rank: Apprentice
7/3/2014 | 9:56:10 AM
Re: Dataflow implications for Hadoop community?
You can take a look on the following Apache incubator projects as the open source equivalents on parallel dataflow processing

- Apache Tez (https://tez.incubator.apache.org/)

- Apache Flink (former Stratosphere) (https://github.com/apache/incubator-flink
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
6/27/2014 | 8:15:00 PM
Google's goal: a competitive service
Agreed, many implications for Hadoop and other open source communities, Doug. There was no discussion on those issues that I got to witness at Google I/O. The thing I see is Google using its data handling expertise to build a competitive cloud service, let the chips fall where they may.
D. Henschen
50%
50%
D. Henschen,
User Rank: Author
6/27/2014 | 11:38:02 AM
Dataflow implications for Hadoop community?
Charlie, this Dataflow announcement would seem to have huge implications for the Hadoop community, given that that platform was inspired by Google's technologies and white papers. With the introduction of YARN, the Hadoop community, too, has been moving away from MapReduce, but what's the Hadoop world's equivalent of Dataflow? Was anybody drawing parallels/similarities to Apache Spark or Apache Storm, for example?


The Business of Going Digital
The Business of Going Digital
Digital business isn't about changing code; it's about changing what legacy sales, distribution, customer service, and product groups do in the new digital age. It's about bringing big data analytics, mobile, social, marketing automation, cloud computing, and the app economy together to launch new products and services. We're seeing new titles in this digital revolution, new responsibilities, new business models, and major shifts in technology spending.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest - August 20, 2014
CIOs need people who know the ins and outs of cloud software stacks and security, and, most of all, can break through cultural resistance.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.