Google Wants Less Reliable Hard Disks - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Cloud // Cloud Storage
News
2/25/2016
04:05 PM
Connect Directly
Google+
LinkedIn
Twitter
RSS
E-Mail
50%
50%

Google Wants Less Reliable Hard Disks

With less reliable hard disks tuned for collective operation, Google believes cloud data can be kept more affordably and securely.

iPhone Encryption: 5 Ways It's Changed Over Time
iPhone Encryption: 5 Ways It's Changed Over Time
(Click image for larger view and slideshow.)

Google wants to see storage technology evolve to meet the demands of cloud computing by adopting designs that are more affordable, more error prone, and better suited to collective operation.

In a research paper published Tuesday, Feb. 23, for the 2016 USENIX conference File and Storage Technologies (FAST 2016), Eric Brewer, VP of infrastructure at Google, calls for industry and academia to work together to adapt hard disk drives to current data center needs.

The problem, Brewer explains in a blog post, is that current "nearline enterprise" disks -- spinning hard disk drives as opposed to more expensive solid state drives -- are designed for traditional servers rather than large scale data centers supporting cloud computing. This is the fastest growing market, says Brewer, and it's likely to represent the majority of the market in the near future.

YouTube demonstrates why Google sees the need for change. YouTube users, according to Brewer, upload more than 400 hours of video every minute. With video requiring about 1 gigabyte of storage space per hour, that translates to more than a petabyte (1 million gigabytes) of new storage every day. And Brewer expects the rate of video ingestion to grow 10x every five years.

(Image: Google)

(Image: Google)

How then to accommodate our insatiable hunger for cat videos? Brewer argues that hard disks should be optimized to function as collections of disks rather than discrete devices associated with a single server. "This shift has a range of interesting consequences, including the counter-intuitive goal of having disks that are actually a little more likely to lose data, as we already have to have that data somewhere else anyway," Brewer says.

[ Read how Spotify rocks on Google's cloud. ]

Such hardware wouldn't actually lose data. It would be designed to facilitate the management disk errors at a higher level, through error correction and replication across multiple, coordinated disks. The result would be more affordable data center storage hardware. Individually, the disks would be more prone to errors. But collectively, they'd keep data secure while allowing improvements in capacity and performance.

The research paper, Disks for Data Centers, co-authored by Brewer, Lawrence Ying, Lawrence Greenfield, Robert Cypher, and Theodore T'so, also asserts that security must be improved as new use cases for storage are considered. It argues that security must be hardened to prevent unauthorized firmware changes and that encryption -- currently the cause of a major legal battle between Apple and the US government -- must be adapted to collections of disks through support for multiple keys. This would make it easier to secure data from different customers in shared disk space.

What have you done to advance the cause of Women in IT? Submit your entry now for InformationWeek's Women in IT Award. Full details and a submission form can be found here.

Thomas Claburn has been writing about business and technology since 1996, for publications such as New Architect, PC Computing, InformationWeek, Salon, Wired, and Ziff Davis Smart Business. Before that, he worked in film and television, having earned a not particularly useful ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Comments
Oldest First  |  Newest First  |  Threaded View
<<   <   Page 3 / 3
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
3/1/2016 | 3:53:19 PM
Not less reliable; more cost effective
It's not that Google literally wants less reliable disks. It wants more cost effective ones. Let cloud software do for disk drives what it's done for servers. The burden of continuous operation lies in the software, not the hardware. When a device fails, there's already a backup copy of the data and a new copy is created on a healthy device immediately after failure. This allows the use of more cost-efficient hardware. It doesn't have to be non-stop, continuous operations for the longest time manufacturable by man. It can have a built in, shorter life without harm to the overall system.
<<   <   Page 3 / 3
Commentary
What Becomes of CFOs During Digital Transformation?
Joao-Pierre S. Ruth, Senior Writer,  2/4/2020
News
Fighting the Coronavirus with Analytics and GIS
Jessica Davis, Senior Editor, Enterprise Apps,  2/3/2020
Slideshows
IT Careers: 10 Job Skills in High Demand This Year
Cynthia Harvey, Freelance Journalist, InformationWeek,  2/3/2020
White Papers
Register for InformationWeek Newsletters
Video
Current Issue
IT 2020: A Look Ahead
Are you ready for the critical changes that will occur in 2020? We've compiled editor insights from the best of our network (Dark Reading, Data Center Knowledge, InformationWeek, ITPro Today and Network Computing) to deliver to you a look at the trends, technologies, and threats that are emerging in the coming year. Download it today!
Slideshows
Flash Poll