Space agency partners with the Department of Energy and National Science Foundation to find creative ways to handle huge government data sets.
IW500: 15 Top Government Tech Innovators
(click image for larger view and for slideshow)
NASA, the Department of Energy, and the National Science Foundation have created a competition to develop new ways to capitalize on the vast amounts of data generated by the federal government.
The Big Data Challenge invites the public to participate in a series of contests aimed at identifying ways to analyze and share large amounts of data across government, using information sets drawn from the health, energy, and earth science fields. The top three finishers will receive $500 each in prize money.
The competition will be hosted by the NASA Tournament Lab, under the auspices of the Networking and Information Technology Research and Development program (NITRD).
"Big data is characterized not only by the enormous volume or the velocity of its generation, but also by the heterogeneity, diversity, and complexity of the data," Suzi Iacono, co-chair of the interagency Big Data Senior Steering Group, part of NITRD, said in a statement on the competition. "There are enormous opportunities to extract knowledge from these large-scale diverse data sets, and to provide powerful new approaches to drive discovery and decision-making, and to make increasingly accurate predictions. We're excited to see what this competition will yield."
The competition will be run by the NASA Tournament Lab, itself a collaboration among NASA, Harvard University, and TopCoder, a community of more than 400,000 digital creators.
Four contests are planned. The first is an "ideation challenge" seeking ideas for tools and techniques that can smooth out the gaps in disparate data sources and subjects.
The White House announced a federal big data initiative in March. Since then, several agencies and companies have announced projects to find ways to capitalize on the government's vast data stores. In June, for instance, IBM and Lawrence Livermore National Laboratory announced a partnership to provide access to the lab's supercomputer, Vulcan, to businesses, non-profits, and government agencies looking to tackle problems that big data may be able to solve.
InformationWeek Government's GovCloud 2012 is a day-long event where IT professionals in federal, state, and local government will develop a deeper understanding of the options available today. IT leaders in government and other experts will share best practices and their advice on how to make the right choices. Join us for this insightful gathering of government IT executives to hear firsthand about the challenges and opportunities of cloud computing. It happens in Washington, D.C., on Oct. 17.
The Agile ArchiveWhen it comes to managing data, donít look at backup and archiving systems as burdens and cost centers. A well-designed archive can enhance data protection and restores, ease search and e-discovery efforts, and save money by intelligently moving data from expensive primary storage systems.
2014 Analytics, BI, and Information Management SurveyITís tried for years to simplify data analytics and business intelligence efforts. Have visual analysis tools and Hadoop and NoSQL databases helped? Respondents to our 2014 InformationWeek Analytics, Business Intelligence, and Information Management Survey have a mixed outlook.
InformationWeek Tech Digest, Nov. 10, 2014Just 30% of respondents to our new survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives?