IoT
IoT
Data Management // Big Data Analytics
News
11/24/2014
12:25 PM
Connect Directly
Google+
RSS
E-Mail
50%
50%

4 Big Data Essentials For Startups

Data-driven insights aren't just for behemoth enterprises. Here's what startups need to know before embarking on a big-data strategy.

Tech Hygiene: 10 Bad Habits To Break
Tech Hygiene: 10 Bad Habits To Break
(Click image for larger view and slideshow.)

Big-data products are generally targeted at large enterprises, and for good reason. They can be enormously expensive to initiate and operate, and therefore out of reach for the average startup or small business.

That's changing, but fledgling firms need to answer some hard questions before embarking on a data-driven strategy. These include: Do I need a big data system? And what insights do I hope to gain from it?

At last week's Techweek conference in Santa Monica, Calif., a two-day event connecting tech entrepreneurs with investors, Sean Anderson, manager of data services at cloud computing company Rackspace, offered some solid advice in his talk, "How Startups Can Leverage Big Data." Anderson's talk covered a wide range of data-related topics, but we've distilled a few takeaway points for companies debating the merits of a big-data initiative.

1. Explore the three Vs, and don't forget C.
Big data is often defined by the three Vs: volume, velocity, and variety. Anderson recommends adding a fourth letter to the formula: C, for complexity.

Volume, of course, refers to the sheer capacity of data. If the volume of information you're putting into your database or data store is breaking the system, it's a good time to explore a big-data technology. The same wisdom applies to the velocity of incoming data, a growing concern in the era of near-real-time analytics. As for variety, your database should allow you to query multiple data types, including unstructured data such as audio, video, and email text.

[It's time to make your gift-giving list. See 10 Smart Tech Toys For Kids.]

"There are plenty of legacy technologies that can scan and analyze text very, very easily," said Anderson. "But as time goes on... the types of file formats and the things we're trying to analyze and process get increasingly more complex."

That's where complexity comes into play.

"The things we're trying to stick into a database are changing," Anderson said. In this age of social engagement and content sharing, "we want to start understanding and getting insights from stuff that's not just text."

(Source: Camelia.boban)
(Source: Camelia.boban)

2. Volume is overrated.
Startups mustn't assume that big-data technologies are the exclusive domain of enterprises wrestling with petabytes or exabytes of data.

"The reality is, when [we] talk to enterprise customers -- Fortune 100 customers that are starting their big-data initiatives -- they don't have petabytes of information. Some of them don't have terabytes of information. Some are just trying to get good, reliable insights from gigabytes of information."

Takeaway: Don't use volume as the only factor when deciding if big data technology is right for your company.

3. Big data is hard.
The big data landscape is "changing at a feverish pace," said Anderson. He cited a recent Gartner survey that showed, while 73% of enterprise respondents have invested or plan to invest in big data in the next two years, these investments haven't led to an associated boost in organizations reporting deployed big-data projects. In fact, just 13% of respondents reported having "big data projects deployed to production." That's a notable increase from 8% a year earlier, but it also suggests that much of today's big-data work involves pilot programs, strategy development, and experimental projects, according to Gartner.

Takeaway: It's difficult for the smartest organizations, including startups, to keep up with the latest big-data innovations.

4. If it ain't broke...
Maybe you don't need a big-data initiative at all. If your current database system handles all of your data needs today and in the foreseeable future, why fix what doesn't need fixing?

"We... would be remiss to go to any of you with systems that are functioning properly and tell you to deploy a big-data solution," said Anderson. "It's disruptive to your business, and it may not be the thing that you need."

He added: "There are some great stories out there of companies that spent months evaluating big-data technologies, only to find out that their current technology... does everything they need."

Just 30% of respondents to our new Big Data and Analytics Survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives? Get the The Trouble With Big Data issue of InformationWeek Tech Digest today. (Free registration required.)

Jeff Bertolucci is a technology journalist in Los Angeles who writes mostly for Kiplinger's Personal Finance, The Saturday Evening Post, and InformationWeek. View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Doug_Laney
50%
50%
Doug_Laney,
User Rank: Strategist
11/26/2014 | 9:27:01 AM
Volume, Velocity, Variety & Complexity
Great to see others finally appreciating Gartner's definition of Big Data, albeit 15 years after we first defined it. My original "3Vs" piece from 2000 can now be found by searching for my blog post: "Deja VVVu: Others Claiming Gartner's Construct for Big Data". The professional courtesy of a citation is always appreciated. --Doug Laney, VP Research, Gartner, @doug_laney 
pfretty
50%
50%
pfretty,
User Rank: Ninja
11/25/2014 | 12:45:30 PM
Start small
I have talked to so many organizations -- almost equal in how many failed and how many succeeded. The one common component? Those who succeeded started small. They built out a strategy, found a known problem and then found a solution. They were not expecting to completely change the world, simply address one problem. What this did is allow for them to build out an analytical culture and the acceptance level constantly improved as lines of business realized the potential. With each utilization, they often look for a slightly larger problem to tackle.

Peter Fretty, IDG blogger working on behalf of SAS  
6 Tools to Protect Big Data
6 Tools to Protect Big Data
Most IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Register for InformationWeek Newsletters
White Papers
Current Issue
Top IT Trends to Watch in Financial Services
IT pros at banks, investment houses, insurance companies, and other financial services organizations are focused on a range of issues, from peer-to-peer lending to cybersecurity to performance, agility, and compliance. It all matters.
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on InformationWeek.com for the week of August 21, 2016. We'll be talking with the InformationWeek.com editors and correspondents who brought you the top stories of the week to get the "story behind the story."
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.