Big data means many things to many people, but how broad is its impact? Consider these figures on big data and the gurus who splice it.
1 of 11
More than a buzzword Big data, however you define it, has been praised and vilified. It's many things to many people: a boon to scientists and retailers, but also an enabling technology for a host of privacy and security threats.
Whether savior or scam -- or maybe even a mixture of the two -- big data remains a popular topic among pundits, prognosticators, marketers, and security buffs. Its unofficial definition is evolving as well. So what is it? Wikipedia's description is a good start: "any collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications."
But the challenges of managing massive volumes of varied data sets arriving at high velocities -- the classic 3V's definition -- are changing as the number of data-sharing devices grows exponentially. This hardware, collectively known as the Internet of Things (IoT), includes machine sensors and consumer-oriented devices such as connected thermostats, light bulbs, refrigerators, and wearable health monitors. IDC predicts the IoT market will soar in the coming years -- from 9.1 billion installed units at the end of 2013 to 28.1 billion by 2020.
The irony of big data is that despite its potential to enhance the human experience, it's often difficult to collect, filter, analyze, and interpret to gain those cherished insights. This slideshow examines the challenges and capabilities of big data. The facts and figures may surprise you. What to expect? Well, the future appears bright for Hadoop, the leading big data platform. And data scientists and related big data gurus should be gainfully (and lucratively) employed for years to come.
Industry insiders have predicted the buzz term "big data" will fade away. "It is all just data, after all. Big data and all the predictions for this space will collapse into 'data management' by the analysts and all those following, including a lot of the 'big' vendors," wrote Hortonworks president Herb Cunitz in a December 2012 blog.
Cunitz may have prematurely predicted the demise of "big data," but he's spot on: It's all just data. Only the tools needed to manage it will change. Now dig into our slideshow and get a look at some revealing statistics and research.
Jeff Bertolucci is a technology journalist in Los Angeles who writes mostly for Kiplinger's Personal Finance, The Saturday Evening Post, and InformationWeek. View Full Bio
6 Tools to Protect Big DataMost IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Big Data Brings Big Security ProblemsWhy should big data be more difficult to secure? In a word, variety. But the business won’t wait to use it to predict customer behavior, find correlations across disparate data sources, predict fraud or financial risk, and more.
InformationWeek Tech Digest, Nov. 10, 2014Just 30% of respondents to our new survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives?