Hadoop Jobs: Where To Find Them - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IT Leadership // Team Building & Staffing
09:06 AM

Hadoop Jobs: Where To Find Them

One in three IT jobs requiring Hadoop skills is based in California, but other regions should see big-data-related hiring increases in the next few years, says Dice.com.

10 Biggest Tech Disappointments Of 2013
10 Biggest Tech Disappointments Of 2013
(Click image for larger view and for slideshow.)

Go West, young big data pro.

That's where the jobs are. Take Hadoop: On any given day of late, there are more than 1,500 openings for people with Hadoop skills listed on the tech jobs site Dice.com -- and nearly a third of them are in California. On March 25, for instance, there were 1,647 Hadoop jobs listed, and 504 were located in California, according to data that Dice shared with InformationWeek. If you drill down from there, you can safely presume most of them are based in the San Francisco Bay Area.

That's more Hadoop-related hiring than the rest of the top five states combined, according to Dice.com president Shravan Goli: New York (149), Maryland (130), Massachusetts (108), and Texas (93).

Overall, there has been a 35% increase in Hadoop-related positions compared with the same time last year. "Hadoop, being the center of gravity with respect to big data technologies, is experiencing this enormous growth," Goli said in an interview.

He noted that big data's about more than just Hadoop, though. A broader swath of big-data job openings demanding skills such as MapReduce, R, MongoDB, Cassandra, Pig, and other technologies is up 37% over the same period, according to Dice data.

[Having trouble explaining big data to the big boss? Read How To Explain Hadoop To Non-Geeks.]

"Collectively, as a set of technologies covering big data, there is absolutely going to be [continued] tremendous growth this year and going into next year," Goli said.

That growth is being driven by the skyrocketing quantity and frequency of consumer interactions across mobile, social, cloud, and other platforms, Goli told us, and a corresponding stampede of businesses trying to convert that information into competitive advantages.

As for the lopsided geographical distribution of Hadoop and other big-data jobs, Goli said he expects a bit more balance to develop over time -- even though Silicon Valley will most likely continue to generate the lion's share of hiring demand for the foreseeable future.

(Source: Matthew Keefe/Flickr)
(Source: Matthew Keefe/Flickr)

"As more and more [companies] adopt [big-data technologies], the jobs are going to be distributed more evenly," Goli said. Don't expect, say, Illinois to suddenly leapfrog California in big data hiring -- "Hiring will [still] follow the 'hot pockets,' so to speak" -- but you can expect increasing demand there and in other parts of the US. Technology, believe it or not, does exist beyond the confines of the San Francisco Bay Area.

"What we have noticed throughout the last year [is] the Midwest has been showing growth [in big-data jobs] and difficulty hiring. That trend has evolved because there are more and more companies demanding more and more technology professionals in these areas. I definitely see this spreading through more states."

Goli expects Hadoop and other big-data hiring to pick up in Washington State as well, especially in the Seattle area. He also thinks that demand will spread farther across the northeast corridor -- where big-data hiring is already relatively strong -- to states such as New Jersey and Virginia.

Big-data pros willing to relocate -- especially to California -- might find themselves in enviable seats at the negotiating table.

"Desperate times call for desperate measures," Goli said, and those measures might include generous relocation packages. "When there's so much shortage of talent in terms of big data -- and overall technology -- companies have gotten a more creative in spreading their wings and trying to find candidates from all over the place."

That's been true at Dice itself: The company opened a Bay Area office last year and has been hiring since. "We've certainly been open to talking to people from other states, and we've in fact relocated quite a few people here."

Can the trendy tech strategy of DevOps really bring peace between developers and IT operations -- and deliver faster, more reliable app creation and delivery? Also in the DevOps Challenge issue of InformationWeek: Execs charting digital business strategies can't afford to take Internet connectivity for granted.

Kevin Casey is a writer based in North Carolina who writes about technology for small and mid-size businesses. View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
D. Henschen
D. Henschen,
User Rank: Author
4/7/2014 | 3:01:23 PM
New Jersey is on the up-and-coming list
Based on my recent interview with Hadoop user Merck, I'd says New Jersey's pharma corridor is primed for big data growth. But Merck is pointing the way for any manufacturer interested in optimization. Merck could just as easily have been manufacturing widgets instead of a vaccines; the same big-data analysis and data-visualizaiton techniques could be applied in any number of industries gathering lots of production data. The automotive plants of Michigan, Ohio, and Tennessee may be next on the Hadoop headhunting list.
User Rank: Author
4/7/2014 | 2:55:52 PM
Don't overlook VA
While it makes sense that California is the epicenter for Hadoop jobs, don't count out Washington DC/Virginia/Maryland IT hub supporting the federal government.

Based on state by state openings as of Apr. 7:

MD - 140

VA - 99

DC - 11

Total = 250
User Rank: Ninja
4/7/2014 | 12:18:12 PM
Bay Area
Sure, the Bay Area will be one of the first spots where an emerging technology like big data will proliferate. But over time that will spread around. Most companies still don't know what to do about big data analytics right now.

But that will change: as organizatons figure out what to do with these datasets, they will look to, ironically, to recruit talent from the Bay Area. That's just the way it is and where innovation comes from. 
10 Ways to Transition Traditional IT Talent to Cloud Talent
Lisa Morgan, Freelance Writer,  11/23/2020
Top 10 Data and Analytics Trends for 2021
Jessica Davis, Senior Editor, Enterprise Apps,  11/13/2020
Can Low Code Measure Up to Tomorrow's Programming Demands?
Joao-Pierre S. Ruth, Senior Writer,  11/16/2020
White Papers
Register for InformationWeek Newsletters
Current Issue
Why Chatbots Are So Popular Right Now
In this IT Trend Report, you will learn more about why chatbots are gaining traction within businesses, particularly while a pandemic is impacting the world.
Flash Poll