DARPA Funds Python Big Data Effort - InformationWeek
IoT
IoT
Software // Information Management
News
2/6/2013
03:20 PM
Connect Directly
Twitter
RSS
E-Mail
50%
50%

DARPA Funds Python Big Data Effort

Department of Defense has dished out $3 million for Python big data analytics libraries from a $100 million fund for big data research and development.

Military Drones Present And Future: Visual Tour
Military Drones Present And Future: Visual Tour
(click image for larger view and for slideshow)
The Defense Advanced Research Projects Agency, which is spending $100 million over four years to advance big data technologies, recently awarded $3 million to develop data analytics and data processing libraries for popular computer programming language Python.

The funding, awarded to data visualization and analytics company Continuum Analytics, will go toward the development of a scientific computing library for Python called Blaze and a visualization system called Bokeh, Continuum announced in a blog post.

The funding, which was awarded in December, comes as part of XDATA, a $100 million DARPA research and development project that aims to "develop computational techniques and software tools for processing and analyzing the vast amount of mission-oriented information for Defense activities." XDATA, in turn, is but one piece of larger big data efforts by the Department of Defense and the federal government.

[ What else is DARPA up to? Read DARPA: Your Tech Will Self-Destruct. ]

Blaze will extend the current NumPy mathematical computing library and the SciPy scientific computing library for Python and will make those libraries more useful with big data. Key developers of those technologies, including NumPy's original author Travis Oliphant, will be involved with Blaze.

According to Continuum, Blaze will be "designed to handle out-of-core computations on large data sets that exceed the system memory capacity, as well as on distributed and streaming data."

Bokeh, meanwhile, is a Python library for big data visualization, what Continuum terms a "scalable, interactive and easy-to-use visualization system" for big data sets. Bokeh will integrate numerous visualization approaches, according to Continuum, including the Stencil visualization model and Grammar of Graphics.

A number of other big data efforts have also been recipients of DARPA's largesse.

In November, data visualization and processing software company Kitware announced a $4 million award to work with software company KnowledgeVis and universities on an open source data aggregation, querying and visualization toolkit called the Visualization Design Environment.

Then, in December, Georgia Institute of Technology announced that it had received a $2.7 million award to work on scalable machine-learning technologies and distributed computing architectures to rapidly process data analytics algorithms, and Scientific Systems Company, Inc., won an undisclosed amount of funding for new machine learning software.

Last month, database developer and software consultancy SYSTAP won $2 million as part of XDATA to build an open source graph analytics platform for use with GPU compute clusters.

Comment  | 
Print  | 
More Insights
Comments
Oldest First  |  Newest First  |  Threaded View
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
2017 State of the Cloud Report
As the use of public cloud becomes a given, IT leaders must navigate the transition and advocate for management tools or architectures that allow them to realize the benefits they seek. Download this report to explore the issues and how to best leverage the cloud moving forward.
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on InformationWeek.com for the week of November 6, 2016. We'll be talking with the InformationWeek.com editors and correspondents who brought you the top stories of the week to get the "story behind the story."
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll