Big Data Planning: Start Slow, Let It Grow - InformationWeek
Data Management // Big Data Analytics
04:18 PM
Shane O'Neill
Shane O'Neill
Connect Directly
Faster, More Effective Response With Threat Intelligence & Orchestration Playboo
Aug 31, 2017
Finding ways to increase speed, accuracy, and efficiency when responding to threats should be the ...Read More>>

Big Data Planning: Start Slow, Let It Grow

Don't begin with an end in mind. Allow yourself to be surprised by what big data reveals.

"We didn't know in the past that strawberry Pop-Tarts increase in sales, like seven times their normal sales rate, ahead of a hurricane," said former Wal-Mart CIO Linda Dillman, quoted in the book. "And the pre-hurricane top-selling item was beer."

A more recent example of data insights is Netflix, considered a big-data pioneer for how it analyzes user data (and metadata) such as movie ratings, hours of video streamed, and geo-location and social media data to understand viewing habits. Last year the company discovered that 50,000 Netflix subscribers watched all 13 episodes of AMC hit show Breaking Bad's fourth season the day before Season 5 premiered, giving the company a new level of awareness about binge-watching and peak viewing activity.

Cultivate Big Data Expertise Internally And Spread The Word

There's a shortage of big data expertise, our InformationWeek Staffing Survey confirms, so companies would be wise to nurture that expertise internally.

"You already have talent within your organization -- you just don’t know it," writes InformationWeek contributor and president of Yeoman Technology Group Mike Healey in a November 2012 InformationWeek Research report titled "6 Big Data Lies." "Consider that 39% of respondent organizations have department-level analysts as the primary users of their information. Break these people out of their department silos and start moving them toward a more holistic view of the data. You’ll be amazed at how compartmentized their analysis has been."

Big data training for technical and non-technical employees is on the rise. Storage giant EMC, for instance, offers a data science and big data analytics training and certification program to both employees and customers.

"Having a few specialists isn't going to cut it," writes Simon. "Everyday employees will need to become more comfortable working with data. Much like communication skills, proficiency with data and analytics will become requisite skills."

Nevertheless, cultivating data scientists internally is time-consuming, and many companies would rather buy data scientists than cultivate them. If you go outside, snap up people quickly. Big data experts don't stay on the labor market very long, so Simon recommends that companies "aggressively target graduating and newly minted data scientists."

As you spread the big data mantra around your company, remember that not everyone will listen. But pay the naysayers no heed, writes Simon.

"As your organization gets its arms around big data and starts to see the benefits, it's likely that others will follow," he says. "Part and parcel to this is publicizing the use of new tools, data and mindsets on company intranets and social networks."

The big data market is not just about technologies and platforms -- it's about creating new opportunities and solving problems. The Big Data Conference provides three days of comprehensive content for business and technology professionals seeking to capitalize on the boom in data volume, variety and velocity. The Big Data Conference happens in Chicago, Oct. 21-23.

2 of 2
Comment  | 
Print  | 
More Insights
Threaded  |  Newest First  |  Oldest First
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
IT Strategies to Conquer the Cloud
Chances are your organization is adopting cloud computing in one way or another -- or in multiple ways. Understanding the skills you need and how cloud affects IT operations and networking will help you adapt.
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll