Real-Time Analytics: 10 Ways To Get It Right - InformationWeek
IoT
IoT
Data Management // Big Data Analytics
News
8/20/2015
12:06 PM
Lisa Morgan
Lisa Morgan
Slideshows
100%
0%
RELATED EVENTS
Moving UEBA Beyond the Ground Floor
Sep 20, 2017
This webinar will provide the details you need about UEBA so you can make the decisions on how bes ...Read More>>

Real-Time Analytics: 10 Ways To Get It Right

While real-time analytics is getting more affordable, it's still not right for everything. Here are 10 ways to get the most from real time, near real time, and batch use cases.
Previous
1 of 11
Next

(Image: alan8197 via Pixabay)

(Image: alan8197 via Pixabay)

Real time, near real time, batch. Organizations need actionable insights faster than ever before to stay competitive, reduce risks, meet customer expectations, and capitalize on time-sensitive opportunities.

CIOs have been pummeled with requests for real-time analytics because people in the organization think they need it -- in marketing, IT, security, fraud prevention, customer support, and other areas -- and some of them actually do need it. In the not-so-distant past, very few reasons justified the expense of real-time analytics, but with the cloud, a new generation of solutions, and open source projects like Apache Hadoop and Spark, the economics have changed. As a result, the scope of the use cases is expanding.

Whether to choose real time, near real time, or batch "depends on the use case and how important it is to get an up-to-the-second response. It's all about the response," said John Bates, CMO and former CTO for intelligent business operations and big data at Software AG, in an interview. "Reports that used to be available at the end of the month or in a week are now available intraday, and then you're getting into 5, 10, 15 minutes. That's fine for people who want dashboards, but if you're doing high-frequency trading or trying to stop a security or compliance threat before it causes damage, it's critical to receive the lowest latency response."

While it's clear that the time-to-insights window is collapsing, it's less clear what individuals or companies mean when they talk about real time and near real time, since the definition can vary depending on the need, the industry, and an individual's point of view. Real time is often defined in microseconds, milliseconds, or seconds, and near real time in seconds, minutes, or hours -- although the definitions can vary even more than that. More important than a universal definition of the categories is the business need, viewed in terms of cost and benefits (usually capitalizing on opportunities, minimizing risks, and satisfying customers).

"We talk about 'just in time' to help [customers understand their] cycles and how they perceive that changing, because it goes to the type of investment," said Keith Collins, CIO at analytics and business intelligence (BI) solution provider SAS, in an interview. "Is it the speed of making the decision, or how fast you want to look at your historical basis? Most people aren't going to change their models quickly."

For one thing, there are hurdles to overcome, such as adopting new technologies, making architectural adjustments, and grappling with data integration issues. Accelerating insights may also require business process adjustments, some of which may be met with resistance by users. The progression to real time and near real time is often gradual, meaning there is a speed improvement of one or two orders of magnitude, such as hours to minutes or seconds, and then further refinement as necessary, driven by business need.

"[Companies] understand the need to analyze real-time and historical data together to identify system or application-level patterns as they occur, as well as to generate meaningful business impact and deliver value to their own customer base," said Ankur Goyal, vice president of engineering at MemSQL, in an interview. "Because end users have come to expect short load times, personalization, and updates in real time, it is vital to replace legacy architectures with a real-time data pipeline to capture, process, analyze, and serve massive amounts of data to millions of users."

In today's dynamic business environment, companies must be more nimble than ever. Here's how the time element is playing out in analytics across enterprises and industries.

Lisa Morgan is a freelance writer who covers big data and BI for InformationWeek. She has contributed articles, reports, and other types of content to various publications and sites ranging from SD Times to the Economist Intelligent Unit. Frequent areas of coverage include ... View Full Bio

Previous
1 of 11
Next
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
GinaA474
50%
50%
GinaA474,
User Rank: Apprentice
9/3/2015 | 12:15:30 PM
Great examples of real use case scenarios
The customer experience example with iHeart radio really shows the power of analytics. 
shamika
50%
50%
shamika,
User Rank: Ninja
8/27/2015 | 7:07:01 AM
Re: Real time analytics
"Online customers are notoriously impatient". Correct. I am one of them too. They expect the solution to be on their fingertips. In my opinion this is especially applicable for financial institutes.
shamika
50%
50%
shamika,
User Rank: Ninja
8/27/2015 | 6:57:53 AM
Real time analytics
I agree with the concept that bank uses. However as you said batch processing will take place towards the close of business which is a concern at the moment. I think there will be a solutions for this soon.  
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
IT Strategies to Conquer the Cloud
Chances are your organization is adopting cloud computing in one way or another -- or in multiple ways. Understanding the skills you need and how cloud affects IT operations and networking will help you adapt.
Video
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll