Facebook Data Center Showcases Open Compute Work - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Cloud // Software as a Service
09:41 AM
Connect Directly

Facebook Data Center Showcases Open Compute Work

Facebook's Altoona, Iowa, data center includes Open Compute Project data center network fabric.

H-1B Visa Program: 13 Notable Statistics
H-1B Visa Program: 13 Notable Statistics
(Click image for larger view and slideshow.)

The Open Compute Project has taken strides forward with its Networking Project, including a data center network fabric, installed by Facebook at its newest data center, which will be contributed to the project.

The Altoona, Iowa, data center opened Nov. 14 and is the first Facebook facility to include a 40-Gbps Ethernet network fabric that links every pod, or set of 48 server racks, to every other pod in the data center. The fabric design gets away from the constraint of a server cluster being limited by the lack of bandwidth connecting it to other clusters.

"We challenged ourselves to make the entire data center building one high-performance network, instead of a hierarchically oversubscribed system of clusters," wrote Alexey Andreyev, Facebook network architect, in a blog post on the fabric.

[Take a look inside another Facebook data center. See Facebook's Futuristic Data Center: Inside Tour.]

That means Facebook has found a way to "disaggregate" what had been a few high-performance and vendor proprietary switches managing each cluster's traffic into smaller units spread throughout the data center. "Instead of the large devices and clusters, we broke the network up into small identical units -- server pods -- and created uniform high-performance connectivity between all pods."

And that means Facebook can extend high-performance networking throughout its data centers whenever it chooses. Its more modular networking approach is scalable beyond the limits of its previous cluster management switches.

Facebook's New Altoona, Iowa, data center. (Source: Facebook)
Facebook's New Altoona, Iowa, data center.
(Source: Facebook)

In addition, Facebook has been enhancing its Wedge top-of-rack switch, whose specifications are part of the Networking Project, noted Najam Ahmad, VP of network engineering at Facebook, in an interview.

"We didn't have a top-of-rack design laid out initially. We spun up the Networking Project (a year ago) without having a design ready to go," he recalled.

Facebook, through the Open Compute Project, is trying to make basic components of data center hardware available through open source designs. "The primary job was to disaggregate the network appliance, most often a proprietary chip, operating system, and hardware built by one vendor," he said.

Among other things, Open Compute advocates are seeking to add a micro-server to a standard switch or other network hardware device through which it may be programmed and managed on a dynamic networking basis. That's a hardware idea that meshes with a software-defined network, with a network controller reaching out to such devices with sets of instructions.

Mellanox and Dell have produced Wedge-specified switches, he noted.

At the end of October, the Open Compute Project announced that it has achieved the Open Network Install Environment (ONIE), an open source and freely available way to boot up network switches, after testing them. There are already ways to boot switches, but they are either proprietary and billed with the purchase of products, or they are a published standard that's still accompanied by a fee.

ONIE, contributed by Cumulus Networks, "is one of the fundamental pieces that we've done and announced," said Ahmad.

Cumulus Networks produced ONIE as an open source boot loader for the switch. It does initial testing of the hardware, then can boot it up for operations with the software assigned to it. "It's like the BIOS on a compute server," noted Ahmad.

Our latest survey shows growing demand, fixed budgets, and good reason why resellers and vendors must fight to remain relevant. One thing's for sure: The data center is poised for a wild ride, and no one wants to be left behind. Get the Research: 2014 State Of The Data Center report today. (Free registration required.)

Charles Babcock is an editor-at-large for InformationWeek and author of Management Strategies for the Cloud Revolution, a McGraw-Hill book. He is the former editor-in-chief of Digital News, former software editor of Computerworld and former technology editor of Interactive ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
Thomas Claburn
Thomas Claburn,
User Rank: Author
11/25/2014 | 5:30:16 PM
Re: Altoona is built to a familiar Facebook scale
Has the Open Compute Project affected the stock price of network equipment makers like Cisco? Because it seems as if it should.
Charlie Babcock
Charlie Babcock,
User Rank: Author
11/25/2014 | 4:33:45 PM
That's a goal of OCP
Yes, Asksqn, multiple suppliers of generic, programmable switches running open source and built to a common design -- that's a goal of the Open Compute Project.


Charlie Babcock
Charlie Babcock,
User Rank: Author
11/25/2014 | 3:18:06 PM
Altoona is built to a familiar Facebook scale
The Altoona site is currently one of two data centers planned for the site. It is a massive structure, built on a scale similar to the 330,000 square-foot data centers in Prineville, Ore. If each of the two main data centers there were stood up on one end, they would be the Twin Towers, each 81 stories high, of the high desert.
InformationWeek Is Getting an Upgrade!

Find out more about our plans to improve the look, functionality, and performance of the InformationWeek site in the coming months.

New Storage Trends Promise to Help Enterprises Handle a Data Avalanche
John Edwards, Technology Journalist & Author,  4/1/2021
11 Things IT Professionals Wish They Knew Earlier in Their Careers
Lisa Morgan, Freelance Writer,  4/6/2021
How to Submit a Column to InformationWeek
InformationWeek Staff 4/9/2021
White Papers
Register for InformationWeek Newsletters
Current Issue
Successful Strategies for Digital Transformation
Download this report to learn about the latest technologies and best practices or ensuring a successful transition from outdated business transformation tactics.
Flash Poll