Big Data Survey: Trouble Brewing For IT - InformationWeek
IoT
IoT
Data Management // Big Data Analytics
News
11/10/2014
11:40 AM
Connect Directly
LinkedIn
Twitter
RSS
E-Mail
50%
50%
RELATED EVENTS
Using Threat Data to Improve Your Cyber Defense
Aug 10, 2017
Attend this webinar to learn how you can determine which threats pose the greatest danger to your ...Read More>>

Big Data Survey: Trouble Brewing For IT

Just 30% of respondents say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives?

Download the entire November issue of InformationWeek Tech Digest, distributed in an all-digital format (registration required).

The more you know, the more you know what you don't know. This year's InformationWeek Big Data and Analytics Survey stands as a prime example of that adage

We see companies moving in a positive direction on some fronts -- they're integrating more with external data sets, expanding their use of analysis tools, and focusing more on customer data. However, this progress is tempered by a disturbing shift. When we asked survey respondents (266 in all, at organizations with 50 or more employees) to rate how effectively their organizations identify and use data, more characterize their approaches as "limited and siloed" than "holistic and inclusive." Only 30% of respondents say they're very or extremely effective at identifying critical data and using it to make decisions -- that's down from 42% in 2013. A whopping 63% say they're only moderately to slightly effective, with the remaining 7% throwing in the towel and claiming defeat.

Add it up, data jockeys: 70% admit their companies are below par when it comes to data effectiveness, an increase of 12 points over 2013.

It's not as if businesses don't get what big data can do for them. In fact, the areas cited as most ripe for improvement are critical for any enterprise: competitive intelligence, business security, customer service, and product development. And we see good momentum in some key areas, especially pulling in external data sources such as Web analytics. And more than 55% of respondents plan to expand their analytics tool capabilities in 2015.

The right priorities, the right data, the right tools. Why are we faltering?

First, with new data sets and better tools come a (sometimes painful) realization of how far most of us have to go to become truly digital enterprises. Sure, we can develop a better Web presence, create an Internet of Things strategy, and expand our social footprint. But most survey respondents lack a commitment to using all the data they can now tap into. Very few orgs are pulling in all the sources needed to get a 360-degree view of customers, for example.

Lack of budget is the top barrier to successful use of big data, cited by 31% of respondents. But let's be real: Funding complaints always rate No. 1. In second place? Fourteen percent have the guts to say there are more important IT priorities, up three points from last year. We think that response gets at the root cause of big data dawdling: IT is often saying, if not in so many words: "Hey, CMO. You want to own big data and digital? Fine, have fun. Don't call us, we'll call you."

This "stepping away" of IT from a pivotal role in data analysis is confirmed by looking at who pushes new ideas for data analysis. Only 19% of the respondents to our survey say IT is the primary driver, down from 26% in 2013.

Enterprises are faltering in their ability to comprehensively analyze big data, and IT has opted to walk away.

Look, for years IT organizations have been told they don't own enterprise data, the business does. Lately we've heard about the rise of the CMO and how it takes that mindset to really know what data matters and how to mine it. So the message too many IT teams seem to be taking away: "This isn't an IT problem. We build the systems, keep the lights on, try to keep attackers out. We don't own big data. Our input isn't wanted."

Big data is tied to digital transformation, which is inextricably linked with the e-commerce, social, IoT, and mobile movements redefining how businesses operate. These are all becoming "non-IT" functions, so why hold on to big data responsibilities?

Simple -- because your organization doesn't have the skills outside of IT to handle this tsunami of data. Deloitte Consulting called the insurance industry "information rich, knowledge poor." But it's not just insurance. This moniker applies to almost every industry. You may have a crack team of business analysts, data scientists, and Excel jockeys, but they simply can't do the heavy lifting needed to bring in all the information needed to yield real knowledge.

Our survey shows that almost everyone is pulling in their key financial, sales, and product data. That's old-school stuff; no surprise there. Lots of companies are also tapping their server logs, email files, and CRM software. However, the wheels start to come off when it comes to unstructured data and data sources that aren't linked easily, such as phone logs, smartphone data, and partner sales data.

All of these sources probably are accessible and won't blow up your security model, so why haven't they been tapped? Because doing so would require IT -- not data analysis -- skills.

This pattern pops up again in response to our questions about external data. More than half of enterprises in our survey analyze Web and social data, and an increasing percentage analyze public records. Again, this is relatively clean data than any analyst can pull. Enterprises are struggling with data that requires developer time (translation: IT resources).

In fact, some of the richest, newest big data is sitting idle. We're talking sentiment analytics (aka analysis of brand chatter) -- only half of survey respondents do it. Geolocation, sensor, and RFID data? Also left out of the loop, as well as third-party intelligence services such as Dun & Bradstreet's. Even unstructured data stored in the cloud is getting the short end of the stick when it comes to analysis. IT organizations have helped fuel the explosive growth of Google Docs, Office 365, Box.com, yet only 42% of enterprises in our survey actually analyze that data.

This is what happens when IT bows out of big data. It's not a pretty picture.

To read the rest of this story,
download the November issue of InformationWeek Tech Digest.

 

Mike Healey is the president of Yeoman Technology Group, an engineering and research firm focusing on maximizing technology investments for organizations, and an InformationWeek contributor. He has more than 25 years of experience in technology integration and business ... View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
pfretty
50%
50%
pfretty,
User Rank: Ninja
11/13/2014 | 12:30:51 PM
A lot of room for growth
This echoes the results of a recent IDG SAS survey that showed that most organizations fail to do many of the crucial big data tasks including forming questions, and turning insights into action.  The same survey showed that a holistic data strategy is quite rare.  It may be time to focus on developing the plan as well as the skills. 

 

Peter Fretty
Stratustician
50%
50%
Stratustician,
User Rank: Ninja
11/10/2014 | 1:22:35 PM
Re: Become indespensible without owning the data
I agree, IT probably has the skillsets needed for projects like this, and although the push might come from another department (my money is sales and marketing will be the ones pushing for this, maybe operations), the value needs to be seen by IT before getting them onboard with this type of project.  There's no mistake that Big Data is a crucial area for business transformation, but it needs to be an overall business strategy with IT buy-in, and it seems we just aren't quite there yet.
yeomantechnologies
100%
0%
yeomantechnologies,
User Rank: Moderator
11/10/2014 | 1:02:51 PM
Re: Become indespensible without owning the data - IT also brings trus
There's also a big part of IT giving its 'blessing' to the actual data.  IBM has an oft-quoted stat that 1 our of 3 managers don't trust their data.  Can't validate if that's true, but I know first hand that BS analysis gets done all the time.  We had a situation where IT stepped up and helped "clarify" some sketchy data at the request of the CEO. They could have walked away, but instead opted to remember the I in IT is information.
Lorna Garey
100%
0%
Lorna Garey,
User Rank: Author
11/10/2014 | 12:31:07 PM
Re: Become indespensible without owning the data
Exactly, it needs to be a team effort, but the data seems to show that many technologists have a "fine, we'll take our ball and go home" attitude. IT may not own the data, but if the company falters because IT didn't help the business do analytics effectively, IT is just as hosed.
D. Henschen
50%
50%
D. Henschen,
User Rank: Author
11/10/2014 | 12:13:37 PM
Become indespensible without owning the data
Here's a plea for IT to take the indespensible role of providing enterprisewise big-data infrastructure and governance. But IT doesn't own the data and can't be held responsible for monetizing big data. As Michael points out, it's a Catch 22. IT can't count on (and won't be given a budget for) a build-it-and-they-will-come approach.

The bottom line: it's up to a CIO, a CDO, a CMO or some such leader to recognize and broker support for a critical combination of promising, breakthrough big data apps. When it cuts across departments, big-data-infrastrcture budgets and responsibilities will be placed where they belong: In IT's court. Responsiblity for promoting and pioneering individual apps should rest with the business units, but they shouldn't be burdened with, and likely can't afford, responsibility for infrastructure and governance.
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
IT Strategies to Conquer the Cloud
Chances are your organization is adopting cloud computing in one way or another -- or in multiple ways. Understanding the skills you need and how cloud affects IT operations and networking will help you adapt.
Video
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll