Data Management // Big Data Analytics
04:50 PM
Connect Directly

What's On Your Big Data Analytics Wish List?

Companies want more than they're getting from their big data analysis. Big and small vendors are working on some key big data problems.

InformationWeek Green -  Mar. 25, 2013 InformationWeek Green
Download the entire March 25, 2013, issue of InformationWeek, distributed in an all-digital format (registration required).

Analytics Wish List

Are we rising to the peak of the big data hype cycle, or are we headed into the trough of disillusionment?

Your position on that Gartner curve depends on your own company's progress. Has your company identified any use cases for big data analytics? Have you kicked the tires on new platforms such as Hadoop? If you've gotten this far, it's a good bet you've also developed a wish list of big data capabilities or of problems you've yet to solve. It's this wish list that stands between just storing a pile of useless information and unlocking valuable business insights.

The techniques discussed here -- distributed computing, stream processing, machine learning, graph analysis -- promise to increase analytics performance, affordability and accessibility. With distributed computing and stream processing, companies are taking on analytics work that demands unprecedented scale and speed -- like a bank sizing up every bit of data it has on a customer in a split second in order to serve more relevant ads on a website. We're seeing machine learning taking on complex analyses. For example, Memorial Sloan-Kettering Cancer Center is experimenting with machine learning to continually monitor medical literature and offer cancer treatment suggestions to supplement doctors' assessments.

And we're witnessing the emergence of open source technologies, including Apache Hadoop and R, that let companies use larger and more diverse data types, and apply them to new business analysis problems. Mutual fund company American Century, for example, is writing its own R-based models that use graph analysis techniques to map connections among companies -- much like Facebook studies connections among people -- to improve its forecasts of financial results.

Report Cover
Our in-depth report on business intelligence, analytics and information management has 35 pages of research and analysis by Doug Henschen, with an emphasis on predictive analytics.

Get This And All Our Reports

At this point, IT's wish list for the next-generation analytics market is long. Most companies still want to see proven analytical tools and methods rather than beta-stage projects. They want easy and familiar SQL or SQL-style analysis, not limited query capabilities and batchy, far-from-real-time performance. The piles of data keep growing, and the variety of data sources companies want to make sense of keeps expanding. Meantime, analytics startups are trying to address the shortcomings of emerging big data platforms such as Hadoop. So what follows is but an interim report on the latest and most-promising efforts to make sense of the data.

Open Source Filling The Gaps

Apache Hadoop, the distributed data processing framework now synonymous with big data, is widely accepted as a platform for building high-scale, distributed computing applications. Hadoop lets organizations store huge volumes and varieties of data quickly without all the management work demanded by relational databases. Still to be worked out, however, are the best use cases and techniques for running analytics on top of Hadoop.

To read the rest of the article,
download the March 25, 2013, issue of InformationWeek.

Comment  | 
Print  | 
More Insights
Threaded  |  Newest First  |  Oldest First
6 Tools to Protect Big Data
6 Tools to Protect Big Data
Most IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Register for InformationWeek Newsletters
White Papers
Current Issue
Top IT Trends to Watch in Financial Services
IT pros at banks, investment houses, insurance companies, and other financial services organizations are focused on a range of issues, from peer-to-peer lending to cybersecurity to performance, agility, and compliance. It all matters.
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on for the week of October 9, 2016. We'll be talking with the editors and correspondents who brought you the top stories of the week to get the "story behind the story."
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll