Big Data // Big Data Analytics
04:18 PM
Shane O'Neill
Shane O'Neill
Connect Directly
Repost This

Big Data Planning: Start Slow, Let It Grow

Don't begin with an end in mind. Allow yourself to be surprised by what big data reveals.

5 Big Wishes For Big Data Deployments
5 Big Wishes For Big Data Deployments
(click image for larger view and for slideshow)

"It's the start that stops most people," a quotation widely attributed to anonymous, is one I keep in mind when struggling to get started on a project. Whether it's researching a new car or motivating myself to play tennis again, the hardest step is often the first one.

For enterprise IT, big data projects are a classic tough starter. Companies can get overwhelmed when they over plan and insist on sticking to a regimen. Big data doesn't lend itself to step-by-step schemes and a predetermined finish line, according to Phil Simon, author of the book Too Big to Ignore: The Business Case for Big Data.

"Hadoop and other big data solutions represent a fundamentally more flexible, ad hoc and organic approach to data modeling," Simon writes. "Meeting a business need trumps following regimented, predefined models. You don't need to begin with the end in mind."

[ Did big data almost sink J.C. Penney? Read Don't Be Blinded By Big Data. ]

Before moving into the deep waters of a big data implementation, consider the following tips on how to start, grow organically and build momentum, culled from Simon's book and a recent InformationWeek big data research report.

Aim For Little Victories

Every big data project doesn't require the CIO to submit an RFP and earmark millions of dollars. The beauty of software such as open-source Hadoop, Simon writes, is that it lets organizations take on big data organically and affordably.

"Why not start a bit conservatively with reasonable investments in hardware, software and additional headcount?" Simon writes. "And don't forget that cloud solutions may essentially obviate the need for hardware purchases and upgrades."

Think in terms of achievable, short-term goals. When it comes to your company's customers, Simon writes, the basics include gathering unstructured data on current and former customers to predict which products will gain traction; improving your understanding of customer behavior on your website to reduce customer churn and to retain your most valuable customers; and improving your company's website design and product offerings based on customer behavior and specific Web traffic metrics so you can contact customers who are about to defect (without annoying them of course).

When it comes to employees, gather more structured data on current and former ones to predict which employees will be successful; gather unstructured data such as performance reviews and exit interview notes to minimize bad hires and employee turnover; and increase understanding of your current workforce through both structured and unstructured data so you can proactively communicate with valuable employees who are thinking of leaving the company.

Keep An Open Mind And Let Your Plan Evolve

It's quite possible that after you've homed in on the right data, you'll get some unexpected results. Keep an open mind to what big data analysis might reveal.

For example, Simon's book cites what big data trailblazer Wal-Mart learned back in 2004 about preparing its inventory for a hurricane. Logic would dictate stores should stock lots of batteries, flashlights, canned goods and bottled water. While its data analysis confirmed that thinking, Wal-Mart also discovered that less obvious products get a bump in sales before big storms.

1 of 2
Comment  | 
Print  | 
More Insights
InformationWeek Elite 100
InformationWeek Elite 100
Our data shows these innovators using digital technology in two key areas: providing better products and cutting costs. Almost half of them expect to introduce a new IT-led product this year, and 46% are using technology to make business processes more efficient.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Elite 100 - 2014
Our InformationWeek Elite 100 issue -- our 26th ranking of technology innovators -- shines a spotlight on businesses that are succeeding because of their digital strategies. We take a close at look at the top five companies in this year's ranking and the eight winners of our Business Innovation awards, and offer 20 great ideas that you can use in your company. We also provide a ranked list of our Elite 100 innovators.
Twitter Feed
Audio Interviews
Archived Audio Interviews
GE is a leader in combining connected devices and advanced analytics in pursuit of practical goals like less downtime, lower operating costs, and higher throughput. At GIO Power & Water, CIO Jim Fowler is part of the team exploring how to apply these techniques to some of the world's essential infrastructure, from power plants to water treatment systems. Join us, and bring your questions, as we talk about what's ahead.