Big Data // Big Data Analytics
News
5/12/2014
10:46 AM
Connect Directly
Google+
RSS
E-Mail
50%
50%

Big Data Fans: Don't Boil The Ocean

Planning a big data strategy? Don't be overly ambitious and always know the problems you're trying to solve.

Been reading up on big data? Maybe wondering if it's time to jump on the ol' Hadoop bandwagon, hire a data scientist or two, start stockpiling petabytes of information, and then... Then... what?

If you're building a big-data platform, but aren't sure why, you're asking for trouble. So says Joel Young, chief technical officer of Digi International, a provider of machine-to-machine (M2M) wireless sensors and cloud solutions for a variety of enterprises in energy, medical, transportation, and other industries.

In a phone interview with InformationWeek, Young says organizations face two key challenges when undertaking a big data project. Number one: Not having a clear understanding of what you're trying to accomplish.

[Are you prepared to turn big data into decision-making power? See 5 Big Data Use Cases To Watch.]

"You end up with a boil-the-ocean strategy," says Young. He cited people who say to him, "'You know what? I've got to get involved in this Internet of Things. We're going to start collecting data because data is powerful and I'm sure we're going to gain a lot of insights from it.'"

When he hears that, "it's like a red flag," he says. "It's like, okay, let's back up here. What is the biggest problem you have? Why do you want to collect all this data? What kind of insight are you looking for? Just saying 'insight' and 'innovation' is a wonderful thing, but first and foremost you need to focus."

Oh, if you're not familiar with the term "boil the ocean," here's a brief definition from the Urban Dictionary: "To attempt something that is way too ambitious, effectively impossible -- an idea too broad in scope to accomplish." Like a big-data project without a clear objective.

"Finding the right data, if you know what it is, is way easier than just collecting monster loads of data and then trying to figure out what to do with it," says Young.

The second challenge is when enterprises assume they'll find a brilliant data guru -- the mythical data scientist unicorn -- who'll possess expert knowledge in a variety of technical and business disciplines required to make their big-data strategy fly.

"If you're connecting things that haven't been connected before, you need to be an expert in everything from embedded design, to cloud computing, to big data, to Web services, to application development," he says. "And there really isn't any one person who would be good at all of those things. And if they say they are, I think they're fibbing."

Rather, an effective big data solution often requires an in-house data science team or outside consultants to sharpen the focus. The data-driven Internet of Things (IoT), where billions of wireless devices communicate seamlessly on a global scale, faces technological challenges as well. For instance, today's menu of wireless solutions, including WiFi, Bluetooth, ZigBee, and various forms of cellular including LTE, is far from elegant and seamless.

"Over time there's a natural pruning... as certain technologies mature, hit their stride, and become more pervasive," Young says.

Security is another area that needs attention. To avoid breaches like the recent IoT-based cyber attack in which spam email was sent via consumer devices, connected hardware should be designed with all interfaces shut off except for the one needed to exchange data.

You should "make sure that interface is monitored and controlled," he says. "If you do that, it's not very hard to design security into the system."

Despite a growing interest in big data projects, many enterprises are still in the testing phase. "Opportunities are growing rapidly, but large-scale rollouts are a bit slower," he says. "There's a lot of activity and so many [companies] are trying to do proof of concepts."

You can use distributed databases without putting your company's crown jewels at risk. Here's how. Also in the Data Scatter issue of InformationWeek: A wild-card team member with a different skill set can help provide an outside perspective that might turn big data into business innovation. (Free registration required.)

Jeff Bertolucci is a technology journalist in Los Angeles who writes mostly for Kiplinger's Personal Finance, The Saturday Evening Post, and InformationWeek. View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
KKring
50%
50%
KKring,
User Rank: Apprentice
5/14/2014 | 2:24:12 PM
That's the challenge "always know the problems you're trying to solve"
Dan hits the nail right on the head "always know the problems you're trying to solve".  The challenge is that the problem you are trying to solve typically requires the integration of: marketing, finance, operations, the customer, etc.  And while business schools perfer to teach busines in those functional silos, business cuts across silos to get actual work done.

Big Data's real power is in knowing how it all fits together!

https://www.linkedin.com/today/post/article/20140426140918-7115569-big-data-great-now-what-do-we-do-with-it

D. Henschen
100%
0%
D. Henschen,
User Rank: Author
5/12/2014 | 1:11:52 PM
Leave it to a "solutions" provider to make it sound complicated
I like much of Young's advice, like being focused and concentrating on known problems, but I think he's exagerating when he says "you need to be an expert in everything from embedded design, to cloud computing, to big data, to Web services, to application development." In my book you need people who know the data, know the business problems and who are smart enough to pick up on new platforms. There are too many "gurus" out there trying to make big data sound so complicated you need to hire them to figure it out. Start with a focused problem, do a POC, and if you still can't figure it out, maybe then you need to get some help.

 
6 Tools to Protect Big Data
6 Tools to Protect Big Data
Most IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest September 23, 2014
Intrigued by the concept of a converged infrastructure but worry you lack the expertise to DIY? Dell, HP, IBM, VMware, and other vendors want to help.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.