Does Hadoop Have a Speed Problem? - InformationWeek
Does Hadoop Have a Speed Problem?
Newest First  |  Oldest First  |  Threaded View
User Rank: Apprentice
11/22/2013 | 6:19:31 PM
Re: How fast is too fast?
Thomas, I don't think that fast data is the problem here; it's the automated responses that can become problematic. The data speed is simply an enabler.

Wall Street experienced problems because their automated trading systems not only recommend actions but also execute them – all without human interjection.

To obviate any complications, and until these automated systems learn to think about the consequences of their actions, we can rely on the recommendations but should always have decision-makers involved in the execution.
User Rank: Moderator
11/21/2013 | 3:30:33 PM
Re: Big Data
Jeff, HPCC Systems is an open source data-intensive supercomputing platform to process and solve Big Data analytical problems and is extremely good at what it was designed to do - Massive ingestion of semi structured (or unstructured) data, converting to a normalized form (like RDBMS tables) and performing analytics in an easy to use SQL like language (much more powerful than SQL). In addition, it cleanly integrates with Apache Kafka to provide near real time analytics. More info at
User Rank: Strategist
11/21/2013 | 6:56:55 AM
Re: How fast is too fast?
I agree you Samicksha, but for Hadoop fans one thing to be noted is, Hadoop provides no security model, i.e. it cannot detect a man in the middle attack between nodes.
User Rank: Strategist
11/21/2013 | 2:59:57 AM
Re: How fast is too fast?
Impressive part of Hadoop, it is flexible and you can design the cluster size to make task done accordingly.
Thomas Claburn
Thomas Claburn,
User Rank: Author
11/20/2013 | 4:34:46 PM
How fast is too fast?
Given the problems Wall Street has had with automated trades, I wonder whether web sites that rely on rapid-fire analytics data and automated responses will self-optimize too quickly, magnifying problems rather than solving them.

2018 State of the Cloud
2018 State of the Cloud
Cloud adoption is growing, but how are organizations taking advantage of it? Interop ITX and InformationWeek surveyed technology decision-makers to find out, read this report to discover what they had to say!
Register for InformationWeek Newsletters
Current Issue
The Next Generation of IT Support
The workforce is changing as businesses become global and technology erodes geographical and physical barriers.IT organizations are critical to enabling this transition and can utilize next-generation tools and strategies to provide world-class support regardless of location, platform or device
White Papers
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll