Software // Information Management
News
2/7/2013
04:10 PM
Connect Directly
Twitter
RSS
E-Mail
50%
50%

Government Braces For Big Data

Terabytes are growing into petabytes. Your action plan must include new skills, tools and cross-agency collaboration.

InformationWeek Green - Feb. 11, 2013
InformationWeek Green
Download the entire February 2013 issue of InformationWeek Government, distributed in an all-digital format as part of our Green Initiative
(Registration required.)


Big Data

Petabytes of information are accumulating across government: military veterans' genomics data, climate records dating to the 16th century, years worth of stock trades and even the results of particle physics experiments.

The era of big data has arrived in government just as it has in business. Digital documents, transactions, intelligence, photos, video, Web content and electronic correspondence are filling storage systems to the brim. At the same time, IT budgets are flat, agencies are being pressed to consolidate data centers, and IT teams don't have the skills they need to manage, analyze and apply all of that data.

Government CIOs and their staffs must quickly work their way up the big data learning curve. Terabyte databases are growing into petabyte databases, pushing the processing and storage limits of the IT systems in place and testing the know-how of even the most experienced database managers.

A big data workshop held by the National Institute of Standards and Technology in January drew more than 800 attendees from federal agencies and the technology companies that work with them. IT leaders from the Department of Defense, the Department of Energy, NASA, the National Oceanic and Atmospheric Administration (NOAA), Veterans Affairs and the White House were among those who came to discuss the convergence of big data and cloud computing, big data life cycle management and big data analytics.

The Obama administration pushed big data up the federal IT priority list last March when it unveiled a formal research and development initiative aimed at developing new technologies for big data management and analysis. The goal is spurring breakthroughs in science and engineering, transforming education and strengthening national security. In a blog post titled "Big Data Is A Big Deal," Tom Kalil, deputy director for policy at the Office of Science and Technology Policy, called for an "all hands on deck" among government, businesses, universities and nonprofits.

To kick-start the effort, six federal agencies -- the Defense Advanced Research Projects Agency, the departments of Defense and Energy, National Institutes of Health (NIH), National Science Foundation (NSF), and U.S. Geological Survey (USGS) -- announced plans to invest $200 million collectively in big data R&D. A new interagency steering group is crafting a national R&D strategy, the components of which include foundational research, development of IT infrastructure that's "big data ready," education and workforce development, and collaboration.

Some agencies have begun to develop their own plans for big data research and management. The Pentagon will spend $250 million annually on big data ($60 million of which is included in the $200 million in new federal research). One area of investment is a DARPA program called XDATA to develop "computational techniques and software tools for sifting through large structured and unstructured data sets," according to a White House document on the federal initiative.

To read the rest of the article,
Download the February 2013 issue of InformationWeek Government

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Ellis Booker
50%
50%
Ellis Booker,
User Rank: Strategist
2/11/2013 | 4:41:54 PM
re: Government Braces For Big Data
This citizen wonders if this wealth of data will be open to the public for business or, even, consumer use, a la United States Census data. --Ellis Booker, InformationWeek Community Editor
Byurcan
50%
50%
Byurcan,
User Rank: Apprentice
2/11/2013 | 2:16:09 PM
re: Government Braces For Big Data
Interesting that the Pentagon and DARPA will also be so heavily investing in big data management, obviously it has a big role to play in national defense, maybe with better big data capabilities the gov't can spot patterns of cyberattacks more effectively.
The Agile Archive
The Agile Archive
When it comes to managing data, donít look at backup and archiving systems as burdens and cost centers. A well-designed archive can enhance data protection and restores, ease search and e-discovery efforts, and save money by intelligently moving data from expensive primary storage systems.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest - August 27, 2014
Who wins in cloud price wars? Short answer: not IT. Enterprises don't want bare-bones IaaS. Providers must focus on support, not undercutting rivals.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Howard Marks talks about steps to take in choosing the right cloud storage solutions for your IT problems
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.