Eclipse To Pursue Open-Source Tools For Parallel Computing - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Software // Enterprise Applications
07:00 PM
Connect Directly

Eclipse To Pursue Open-Source Tools For Parallel Computing

Effort will allow tools for building parallel-processing applications to work together.

The Eclipse Foundation is forging ahead with an attempt to bring order to the fragmented field of tools for building software to run on parallel computers.

Parallel computers are usually found at universities, research institutions, and businesses where large, centralized data warehouses, such as Wal-Mart's Teradata system, are used.

The foundation will team up with the Los Alamos National Laboratory, a parallel-computing user, to make Eclipse a central host for many parallel-computing tools. Under the Eclipse approach, many tools plug into its programmer's workbench and work together by passing development work from one tool to another.

"Los Alamos knows firsthand the pain of using many parallel-programming tools and trying to make them work together," says Greg Watson, project leader in Los Alamos' Advanced Computing Laboratory. Different parallel computers tend to have their own tools, and software can't be moved between them without being reworked. There's even little integration among the different tools for the same type of parallel machine, he adds.

The foundation has launched a Parallel Tools Platform Project to produce open-source tools for use in parallel computing. Parallel computing allows one large task to be subdivided and its individual parts run on separate processors, yielding complex computing results much faster, Watson says.

"Parallelized" development tools produce software that solves problems by arranging them into subdivided tasks that are assigned to parallel processors. A leading example of parallel processing is the Google search engine. It doesn't methodically conduct a search of the Google index of the Internet from end to end when pursuing a keyword. It breaks the task down into many parts, with independent processors each conducting part of the search. In that way, it returns results much faster, Urs Hoelzle, Google's VP of engineering, told attendees at the EclipseCon user conference in Burlingame, Calif., early last month.

Parallel processing is also different from more common processor clusters in that each processor in a parallel machine usually has its own memory and operating system. That configuration allows it to perform a task as if it were a standalone unit. Software governing the parallel machine coordinates the overall results.

Processors in a cluster, in contrast, tend to share a common pool of memory, and one processor is restricted from using a set of data already in use by another processor, slowing output if the cluster's resources are focused on one big task. Instead, the work of several applications is generally spread across a cluster.

Los Alamos Lab will lead the parallel-tools project, says Mike Milinkovich, executive director of the Eclipse Foundation. The foundation will host the project, he says, providing a central development site where work will proceed on a parallel debugger and other tools.

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
9 Steps Toward Ethical AI
Cynthia Harvey, Freelance Journalist, InformationWeek,  5/15/2019
How to Assess Digital Transformation Efforts
Lisa Morgan, Freelance Writer,  5/14/2019
Is AutoML the Answer to the Data Science Skills Shortage?
Guest Commentary, Guest Commentary,  5/10/2019
White Papers
Register for InformationWeek Newsletters
Current Issue
A New World of IT Management in 2019
This IT Trend Report highlights how several years of developments in technology and business strategies have led to a subsequent wave of changes in the role of an IT organization, how CIOs and other IT leaders approach management, in addition to the jobs of many IT professionals up and down the org chart.
Flash Poll