Hadoop Adoption Poised For Growth: Survey - InformationWeek
IoT
IoT
Cloud // Cloud Storage
News
9/17/2015
08:06 AM
50%
50%
RELATED EVENTS
Moving UEBA Beyond the Ground Floor
Sep 20, 2017
This webinar will provide the details you need about UEBA so you can make the decisions on how bes ...Read More>>

Hadoop Adoption Poised For Growth: Survey

More than three quarters of respondents to a recent AtScale survey said they plan to do more with Hadoop in the next three months. Learn how they intend to derive business value from these efforts.

7 Worst Cloud Compliance Nightmares
7 Worst Cloud Compliance Nightmares
(Click image for larger view and slideshow.)

Hadoop adoption is past the "kicking the tires" stage and is likely to see enterprise adoption accelerate, according to a survey of more than 2,100 business, IT and C-suite executives from 1,300 companies worldwide.

The survey was conducted by AtScale, a vendor whose products and services aim to help business users visualize the data in Hadoop platforms. The firm partnered with MapR, Tableau, and Cloudera to survey those companies' customers about their Hadoop use. The survey included responses from CIOs and CEOs working at the same companies.

According to AtScale, this is one of the larger Hadoop surveys to date. One was a Barclay's Equity Research Unit forecast that painted a very bullish outlook for Hadoop adoption, Aziza said. The other was a Gartner study from earlier this year that received 125 responses from a group of 284 and offered a relatively muted outlook for Hadoop adoption.

[ Test your container know-how. Read Containers 101: 10 Terms To Know. ]

More than three quarters of respondents (76%) said they plan to do more with Hadoop in the next three months. "We've entered a second phase where people connect Hadoop with business users," said Bruno Aziza, CMO of AtScale. About 77% of respondents are not tire kickers. They are already operating between 10 and 500 Hadoop nodes. And many of them believe they will reap strategic advantage.

In fact, nearly half of respondents (49%) said they obtained some "tangible value" from using Hadoop. Another 45% said they hope they will, while the remaining 6% were pessimistic.

Hadoop adoption is not a slam-dunk guarantee of success. Companies are more likely to reap value from a Hadoop implementation if they are operating more nodes. Among respondents whose companies operate 500 nodes or more, 76% reported getting "some value" out of Hadoop. Conversely, only 33% of respondents whose organizations operate 10 nodes or less said they got "some value" out of their Hadoop installation.

(Image: Janka Dharmasena/iStockphoto)

(Image: Janka Dharmasena/iStockphoto)

Value is more easily attained if self-service access (SSA) is part of the implementation. Respondents from companies using SSA were 50% more likely to extract value from their Hadoop implementation than those who were not, according to the report.

A lack of skill sets among IT professionals may be the biggest stumbling block facing Hadoop adoption. The one bottleneck identified by the survey is the need for professionals with the skills that enable them to manage a Hadoop implementation. Two thirds of respondents (66%) identified this as their top challenge. Aziza cited a McKinsey & Co. study that showed the need for 140,000 to 190,000 skilled analysts to fill this gap.

Challenges notwithstanding, about half of those surveyed said they are committed to making greater use of Hadoop in the next 12 months, Aziza said. "You've got a year to figure it out. In a year, everybody is going to be on board."

ETL is one bridge leading organizations towards greater Hadoop adoption. ETL, which means extract, transform and load, involves people "taking data from the traditional data source and dumping it into Hadoop," Aziza said. Survey results showed 74% of respondents using Hadoop for ETL.

The next step in the transition takes Hadoop from the realm of data scientists to business users. Data scientists "focus on fewer and more complicated problems the enterprise sees," Aziza noted. The challenge is getting the data in front of business users and analysts.

Self-Serving Access (SSA) is what does this. Nearly two thirds (61%) of respondents believe SSA will allow them to obtain value from a Hadoop implementation. Here, "obtaining value" does not mean cost cutting. Rather, it's about achieving increases in revenue because the business side is making better decisions with the data they have.

Finding the insight that yields the gain is like finding a needle in a haystack. But in the world of big data, making a bigger haystack works to the user's advantage. "More data means better algorithms," Aziza said. "The more data I can capture, the better the correlations will be."

Ultimately, all paths lead toward achieving business results for the enterprise. In the end, sales and marketing people need to know they are spending their dollars wisely to spur sales. Using Hadoop to get there appears to be gaining traction.

William Terdoslavich is an experienced writer with a working understanding of business, information technology, airlines, politics, government, and history, having worked at Mobile Computing & Communications, Computer Reseller News, Tour and Travel News, and Computer Systems ... View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Stratustician
50%
50%
Stratustician,
User Rank: Ninja
9/18/2015 | 2:33:03 PM
Adoption will only grow once those skillsets become more available too
I'm a huge fan of Hadoop and what it can do when it comes to analytics, and this article nailed it with one of the reasons I am seeing slower than expected growth...skillsets.  It took us awhile before we saw enough IT folks with the skills to build these types of environments to support next-generation analytics, but we're still not there when it comes to having a steady pool of folks who know what to do with the data once it's captured.  It'll come, but we just need more education and support to get more folks trained on these technologies.  That's when we'll see the growth really take off!
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
IT Strategies to Conquer the Cloud
Chances are your organization is adopting cloud computing in one way or another -- or in multiple ways. Understanding the skills you need and how cloud affects IT operations and networking will help you adapt.
Video
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll