Cloud Connect: Netflix Finds Home In Amazon EC2 - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Cloud // Infrastructure as a Service
News
3/8/2011
11:21 AM
Connect Directly
Twitter
RSS
E-Mail
50%
50%

Cloud Connect: Netflix Finds Home In Amazon EC2

The video delivery company couldn't build data centers fast enough to keep pace with growing demand, so it moved operations to Amazon's Elastic Compute Cloud.

Slideshow: Amazon's Case For Enterprise Cloud Computing
Slideshow: Amazon's Case For Enterprise Cloud Computing
(click image for larger view and for full slideshow)

Netflix gained experience in the cloud by using it in 2009 to encode the digital versions of movies that it was adding to its library. It used thousands of instances, or virtual machines, in EC2 to execute the task as a batch job "and get more movies online," he said. Netflix is also a user of petabytes of Amazon's S3 storage.

It also began moving its Web site into EC2, a process that is largely completed, he said.

At no time did Cockcroft express dissatisfaction with Amazon as a cloud service provider, although he did acknowledge several challenges. Netflix chose Amazon over other cloud providers based on its size, ability to grow its services quickly, and its cloud feature set.

Among the challenges was Amazon's EC2's Elastic Load Balancer, which he termed as possessing "too many limits" for the scale at which Netflix wished to operate.

In addition, SimpleDB is good for dozens or hundreds of gigabytes of data, but Netflix needs it to handle terabytes at a time. That need "was beyond its sweet spot," although Netflix found SimpleDB living up to its name as an easy-to-use system.

Netflix built "a large tier" of data cache management in front of SimpleDB to handle more data. It used the open source system memcached to do so.

Cockcroft also said the performance of EC2's Elastic Block Store storage system for running applications was "slow and too inconsistent" for Netflix's purposes and it substitutes its own system built with the NoSQL system Cassandra.

The move to the cloud prompted the abandonment of many former standard practices in the data center. Netflix, for example, no longer uses a change management database because they work best with relatively static systems that change infrequently. The fluid, rapidly changing alignment of virtual machines in the cloud means Netflix had to impose a new method of managing changes.

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Previous
2 of 3
Next
Comment  | 
Print  | 
More Insights
Slideshows
Strategies You Need to Make Digital Transformation Work
Joao-Pierre S. Ruth, Senior Writer,  11/25/2019
Commentary
Enterprise Guide to Data Privacy
Cathleen Gagne, Managing Editor, InformationWeek,  11/22/2019
News
Watch Out: 7 Digital Disruptions for IT Leaders
Jessica Davis, Senior Editor, Enterprise Apps,  11/18/2019
White Papers
Register for InformationWeek Newsletters
Video
Current Issue
Getting Started With Emerging Technologies
Looking to help your enterprise IT team ease the stress of putting new/emerging technologies such as AI, machine learning and IoT to work for their organizations? There are a few ways to get off on the right foot. In this report we share some expert advice on how to approach some of these seemingly daunting tech challenges.
Slideshows
Flash Poll