Healthcare // Analytics
Commentary
10/27/2011
05:00 PM
Shvetank Shah
Shvetank Shah
Commentary
Connect Directly
RSS
E-Mail
50%
50%

Why Big Data Doesn't Always Equal Big Insight

Data is too often inaccessible and not trusted, and companies aren’t doing enough to nurture 'informed skeptics'.

Even as companies invest eight- and nine-figure sums to analyze the information streaming in from suppliers and customers, fewer than 40% of employees have the right processes and skills to make good use of the analysis. Think of this as a company's insight deficit. To overcome it, "big data" needs to be complemented by "big judgment."

To assess companies' ability to find and analyze relevant information to make decisions, the Corporate Executive Board created the Insight IQ index. Using this model, CEB surveyed 5,000 employees at 22 global companies and discovered that the overwhelming majority (62%) are making poor decisions when attempting to tease out insights from data. To change this, executives need to develop more "informed skeptics," challenge employees' biases, take ownership of their information, and make information more accessible.

We put employees into three categories based on their reliance on analysis and intuition. "Unquestioning empiricists" (43%) trust analysis over judgment, and "visceral decision-makers" (19%) exclusively go with their gut. Only 38% of employees (and 50% of senior managers) are "informed skeptics," who balance judgment and analysis, possess strong analytic skills, and listen to others' analysis to make sound decisions based on data.

To create more informed skeptics, companies need to make sure analytic capabilities aren't concentrated with too few employees. Second, companies must link key metrics to performance objectives and compensation, to build an insight-driven culture. Third, they need effective training that addresses information sources and analytical techniques, and provides reinforcement. Finally, they must train employees on the limitations of data, so they gain critical-thinking skills to uncover deeper insight, find new avenues for analysis, and spot faulty logic or biases.

But a company can't build an insight-driven culture if people can't access data. Seventy percent of business unit leaders in our survey find IT's information management capabilities inadequate. One reason is that, with the rise of social media and other new channels, it's harder to govern and manage the creation, storage, and dissemination of content. Eighty-five percent of companies' information is unstructured, and much of it is out of reach, such as employees' personal drives or in personal cloud storage.

Also, half of survey respondents indicate that information from corporate sources is in unusable formats; two-thirds spend time on unproductive analysis. IT must better understand how, when, and why information is used, then provide a greater selection of analytic tools aligned to specific business units or functions.

Data reliability also is often questioned: Two-thirds of employees don't trust information from other functions in the company. To overcome this distrust, leaders need to make transparent the information's original source, as well how it has been manipulated over time. Simple tactics such as color-coding data to indicate information quality or labeling missing fields increase trust and often spur action to close data gaps.

How valuable can an analytical culture be? We compared corporate functions across the 22 companies in our data set and found that those with the highest Insight IQ performed better, based on efficiency and effectiveness (such as employee engagement for HR or market share growth for business units). The difference on the index between the highest and lowest quartiles: 24%.

Shvetank Shah is executive director of the Corporate Executive Board. More from CEB on this topic is available at insightdeficit.com. Write to us at iwletters@techweb.com

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Mark Simchock
50%
50%
Mark Simchock,
User Rank: Apprentice
11/29/2011 | 3:33:27 PM
re: Why Big Data Doesn't Always Equal Big Insight
All spot on, mostly.

In theory I agree with the majority of your statements. However, the reality is a high percentage of the workforce is not analytical. More importantly, nor do they want to be.

I say this because years ago I had a position where I was responsible for ah-hoc reports for the consumer marketing department of a major telecommunications company. Let's just say that quite oftenGă÷after me asking, "What decisions are you hoping to make?"Gă÷the original request was modified because the report requested wasn't the right match for the business needs they were looking to satisfy. I am certain my predecessor, as well as my replacements, were not as "dedicated". And I'm sure there wasn't a complete makeover of the marketing department either.

Maybe it's time to consider that the responsibility of analytics doesn't fit into the traditional org chart as cleanly as many other roles? Maybe instead of asking and expecting ten different people to increase their analytics IQ ten to fifteen points, it would make more sense to bring in someone devoted and capable of the expertise needed at 130+ IQ points? If there's HR, Accounting, Purchasing, etc. why can't there be Analytics? That seem much more realistic to me. In other words, I'm not even sure Analytcis is a good fit for IT (in its current form).

Other than that, yes more data and more information does not necessarily translate to better decision.

Also, perhaps you could share more about the Insight IQ in the future?
Big Love for Big Data? The Remedy for Healthcare Quality Improvements
Big Love for Big Data? The Remedy for Healthcare Quality Improvements
Healthcare data is nothing new, but yet, why do healthcare improvements from quantifiable data seem almost rare today? Healthcare administrators have a wealth of data accessible to them but aren't sure how much of that data is usable or even correct.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest September 24, 2014
Start improving branch office support by tapping public and private cloud resources to boost performance, increase worker productivity, and cut costs.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.