Will big data be a force for good or evil by the end of this decade? See if you agree with expert reactions to new Pew Internet Center research.
Big Data Talent War: 10 Analytics Job Trends
(click image for larger view and for slideshow)
Will big data be a force for good or evil within a decade? Will humanity find new and innovative ways to analyze, visualize, and extract value from massive and growing data sets, or will we become overwhelmed by information that's simply too abundant to manage effectively?
These are just a few of the questions the Pew Internet Center's Internet & American Life Project and Elon University asked more than 1,000 Internet "experts," including educators, business executives, pundits, scientists, and other tech industry observers. "The Future of Big Data" survey posed a series of thought-provoking questions centered on one main theme: How will big data influence our lives in 2020?
The issue concerns government leaders as well. The White House Office of Science and Technology Policy announced in March the Big Data Research and Development Initiative, a plan by six federal agencies to spend more than $200 million to develop new tools to access, structure, and pull meaning from massive volumes of data.
With as murky a term as "big data" is, it's no surprise the responses to the Pew survey were varied. Optimists and pessimists offered their thoughts on the state of data analysis within a decade.
We've posted some of the more thought-provoking responses below. Respondents were free to agree or disagree with each statement, and explain why. The full set of survey predictions is available here.
Pew survey statement: "By 2020, the use of Big Data will improve our understanding of ourselves and the world."
Sean Mead, director of analytics at Mead, Mead & Clark, Interbrand, believes big data may be the next tech boom: "Large, publicly available data sets, easier tools, wider distribution of analytics skills, and early stage artificial intelligence software will lead to a burst of economic activity and increased productivity comparable to that of the Internet and PC revolutions of the mid to late 1990s."
"Big data is the new oil," wrote Bryan Trogdon, an entrepreneur and user-experience professional. "The companies, governments, and organizations that are able to mine this resource will have an enormous advantage over those that don't."
Survey statement: "Nowcasting, real-time data analysis, and pattern recognition will surely get better."
Google chief economist Hal Varian agrees that real-time forecasting has a bright future: "I'm a big believer in nowcasting," he wrote. "Nearly every large company has a real-time data warehouse and has more timely data on the economy than our government agencies. In the next decade we will see a public/private partnership that allows the government to take advantage of some of these private-sector data stores. This is likely to lead to a better informed, more pro-active fiscal and monetary policy."
Survey statement: "The good of big data will outweigh the bad. User innovation could lead the way, with "do-it-yourself analytics."
Marjory S. Blumenthal, associate provost at Georgetown University and adjunct staff officer at RAND, sees the pros and cons of advancements in data analysis tools and techniques. "Do-it-yourself analytics will help more people analyze and forecast than ever before. This will have a variety of societal benefits and further innovation. It will also contribute to new kinds of crime," Blumenthal wrote.
6 Tools to Protect Big DataMost IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Big Data Brings Big Security ProblemsWhy should big data be more difficult to secure? In a word, variety. But the business won’t wait to use it to predict customer behavior, find correlations across disparate data sources, predict fraud or financial risk, and more.
InformationWeek Tech Digest, Nov. 10, 2014Just 30% of respondents to our new survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives?