Comments
Real-Time Analytics: Ready For Its Close-Up?
Newest First  |  Oldest First  |  Threaded View
Hoganator
100%
0%
Hoganator,
User Rank: Apprentice
2/10/2014 | 5:32:48 PM
Real-Time Analytics
Hadoop opened people's eyes to the value found in large pools of data, but the delay imposed by batch processing dilutes that value considerably. Real-time (or near real-time) analytics are far more valuable. Stream processors (like Twitter Storm, Linkedin Samza, Yahoo S4, Amazon Kinesis, Microsoft StreamInsight, etc.) provide the ability to process/filter/count/transform the data in real-time but the window of data visibility is limited and fleeting. Think of it as looking out the side window of a car doing 100MPH. You can count things and do limited "processing" but only in looking back do you get the true lay of the land. Stream processors require persistence, to enable historical analytics. The problem is: (a) in-memory systems are far to expensive given the huge data volume; and (b) disk-based systems cannot keep up with the flood of fast data, causing an impedance mismatch. Further, like Hadoop, in order to spur corporate adoption it requires SQL support. Hadoop+YARN is interesting, but the underlying large grain file system is incompatible to smaller "block-sized" data found in streams.

Resources: 

http://scaledb.blogspot.com/2014/01/stream-processors-and-dbms-persistence.html

http://scaledb.com/high-velocity-data.php

 

 

 


The Business of Going Digital
The Business of Going Digital
Digital business isn't about changing code; it's about changing what legacy sales, distribution, customer service, and product groups do in the new digital age. It's about bringing big data analytics, mobile, social, marketing automation, cloud computing, and the app economy together to launch new products and services. We're seeing new titles in this digital revolution, new responsibilities, new business models, and major shifts in technology spending.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest September 18, 2014
Enterprise social network success starts and ends with integration. Here's how to finally make collaboration click.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
The weekly wrap-up of the top stories from InformationWeek.com this week.
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.