Cloud // Infrastructure as a Service
News
3/8/2011
11:21 AM
Connect Directly
Twitter
RSS
E-Mail
50%
50%

Cloud Connect: Netflix Finds Home In Amazon EC2

The video delivery company couldn't build data centers fast enough to keep pace with growing demand, so it moved operations to Amazon's Elastic Compute Cloud.

Slideshow: Amazon's Case For Enterprise Cloud Computing
Slideshow: Amazon's Case For Enterprise Cloud Computing
(click image for larger view and for full slideshow)

Netflix gained experience in the cloud by using it in 2009 to encode the digital versions of movies that it was adding to its library. It used thousands of instances, or virtual machines, in EC2 to execute the task as a batch job "and get more movies online," he said. Netflix is also a user of petabytes of Amazon's S3 storage.

It also began moving its Web site into EC2, a process that is largely completed, he said.

At no time did Cockcroft express dissatisfaction with Amazon as a cloud service provider, although he did acknowledge several challenges. Netflix chose Amazon over other cloud providers based on its size, ability to grow its services quickly, and its cloud feature set.

Among the challenges was Amazon's EC2's Elastic Load Balancer, which he termed as possessing "too many limits" for the scale at which Netflix wished to operate.

In addition, SimpleDB is good for dozens or hundreds of gigabytes of data, but Netflix needs it to handle terabytes at a time. That need "was beyond its sweet spot," although Netflix found SimpleDB living up to its name as an easy-to-use system.

Netflix built "a large tier" of data cache management in front of SimpleDB to handle more data. It used the open source system memcached to do so.

Cockcroft also said the performance of EC2's Elastic Block Store storage system for running applications was "slow and too inconsistent" for Netflix's purposes and it substitutes its own system built with the NoSQL system Cassandra.

The move to the cloud prompted the abandonment of many former standard practices in the data center. Netflix, for example, no longer uses a change management database because they work best with relatively static systems that change infrequently. The fluid, rapidly changing alignment of virtual machines in the cloud means Netflix had to impose a new method of managing changes.

Previous
2 of 3
Next
Comment  | 
Print  | 
More Insights
Multicloud Infrastructure & Application Management
Multicloud Infrastructure & Application Management
Enterprise cloud adoption has evolved to the point where hybrid public/private cloud designs and use of multiple providers is common. Who among us has mastered provisioning resources in different clouds; allocating the right resources to each application; assigning applications to the "best" cloud provider based on performance or reliability requirements.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest - August 20, 2014
CIOs need people who know the ins and outs of cloud software stacks and security, and, most of all, can break through cultural resistance.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.