Big Data // Big Data Analytics
04:50 PM
Connect Directly
Repost This

What's On Your Big Data Analytics Wish List?

Companies want more than they're getting from their big data analysis. Big and small vendors are working on some key big data problems.

InformationWeek Green -  Mar. 25, 2013 InformationWeek Green
Download the entire March 25, 2013, issue of InformationWeek, distributed in an all-digital format (registration required).

Analytics Wish List

Are we rising to the peak of the big data hype cycle, or are we headed into the trough of disillusionment?

Your position on that Gartner curve depends on your own company's progress. Has your company identified any use cases for big data analytics? Have you kicked the tires on new platforms such as Hadoop? If you've gotten this far, it's a good bet you've also developed a wish list of big data capabilities or of problems you've yet to solve. It's this wish list that stands between just storing a pile of useless information and unlocking valuable business insights.

The techniques discussed here -- distributed computing, stream processing, machine learning, graph analysis -- promise to increase analytics performance, affordability and accessibility. With distributed computing and stream processing, companies are taking on analytics work that demands unprecedented scale and speed -- like a bank sizing up every bit of data it has on a customer in a split second in order to serve more relevant ads on a website. We're seeing machine learning taking on complex analyses. For example, Memorial Sloan-Kettering Cancer Center is experimenting with machine learning to continually monitor medical literature and offer cancer treatment suggestions to supplement doctors' assessments.

And we're witnessing the emergence of open source technologies, including Apache Hadoop and R, that let companies use larger and more diverse data types, and apply them to new business analysis problems. Mutual fund company American Century, for example, is writing its own R-based models that use graph analysis techniques to map connections among companies -- much like Facebook studies connections among people -- to improve its forecasts of financial results.

Report Cover
Our in-depth report on business intelligence, analytics and information management has 35 pages of research and analysis by Doug Henschen, with an emphasis on predictive analytics.

Get This And All Our Reports

At this point, IT's wish list for the next-generation analytics market is long. Most companies still want to see proven analytical tools and methods rather than beta-stage projects. They want easy and familiar SQL or SQL-style analysis, not limited query capabilities and batchy, far-from-real-time performance. The piles of data keep growing, and the variety of data sources companies want to make sense of keeps expanding. Meantime, analytics startups are trying to address the shortcomings of emerging big data platforms such as Hadoop. So what follows is but an interim report on the latest and most-promising efforts to make sense of the data.

Open Source Filling The Gaps

Apache Hadoop, the distributed data processing framework now synonymous with big data, is widely accepted as a platform for building high-scale, distributed computing applications. Hadoop lets organizations store huge volumes and varieties of data quickly without all the management work demanded by relational databases. Still to be worked out, however, are the best use cases and techniques for running analytics on top of Hadoop.

To read the rest of the article,
download the March 25, 2013, issue of InformationWeek.

Comment  | 
Print  | 
More Insights
InformationWeek Elite 100
InformationWeek Elite 100
Our data shows these innovators using digital technology in two key areas: providing better products and cutting costs. Almost half of them expect to introduce a new IT-led product this year, and 46% are using technology to make business processes more efficient.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Elite 100 - 2014
Our InformationWeek Elite 100 issue -- our 26th ranking of technology innovators -- shines a spotlight on businesses that are succeeding because of their digital strategies. We take a close at look at the top five companies in this year's ranking and the eight winners of our Business Innovation awards, and offer 20 great ideas that you can use in your company. We also provide a ranked list of our Elite 100 innovators.
Twitter Feed
Audio Interviews
Archived Audio Interviews
GE is a leader in combining connected devices and advanced analytics in pursuit of practical goals like less downtime, lower operating costs, and higher throughput. At GIO Power & Water, CIO Jim Fowler is part of the team exploring how to apply these techniques to some of the world's essential infrastructure, from power plants to water treatment systems. Join us, and bring your questions, as we talk about what's ahead.