Netflix Completes Its Cloud Journey - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Cloud // Platform as a Service
Commentary
8/18/2015
01:05 PM
Larry Loeb
Larry Loeb
Commentary
50%
50%

Netflix Completes Its Cloud Journey

By the end of the summer, Netflix will close its last data center and move its entire streaming service to the cloud with help from AWS. It's a lesson for companies large and small.

7 Worst Cloud Compliance Nightmares
7 Worst Cloud Compliance Nightmares
(Click image for larger view and slideshow.)

Milestones for an industry do not always happen with a splash and a braying of trumpets. Some occur simply, as a continuation of a path that has been already established. Netflix and its move to Amazon Web Service is one of those.

Netflix -- the entertainment service that accounts for around 37% of evening download traffic on the Internet in North America -- has just announced its last consumer-facing data center will shut down this summer, according to the Wall Street Journal.

The service now totally lives in the cloud. This is the first time that such a large Internet installation has committed its business to the cloud alone, and it's a major milestone for the cloud-service business.

Starting at the end of this summer, Netflix will fully reside in Amazon's data centers in the cloud, as well as some ISP facilities, and the Internet exchange points that facilitate speedy Internet traffic.

It all started with a massive hardware failure in 2008 that gave Netflix, then a fledgling company, a massive black eye in the public view.

(Image: mphillips007/iStockphoto)

(Image: mphillips007/iStockphoto)

The process of the migration was described in a presentation Netflix's Neil Hunt gave last November at an Amazon conference.

First, Netflix's video player, discovery and search, iPhone-related technology, and accounts pages were brought into the cloud. Then the big data platform migrated in 2013, and billing and payments came aboard in 2014.

There is still hardware that Netflix uses directly, mostly in its content delivery network (CDN), that makes its videos stream well to customers. That hardware will stay, though updating of contents may occur through the various cloud services.

Netflix also has hardware acting as video caches inside some ISP installations, and that hardware is not going to go anywhere else in the foreseeable future.

One of the major parts of the migration process was Netflix rolling its own tools to do it.

[Read more about Netflix's history with the cloud.]

It has committed to open source tools that it developed in concert with other major AWS cloud players. The tools implement a decentralized architecture that is crucial for the system to run at all.

"Netflix's deployment technology allows for continuous build and integration into our worldwide deployments serving members in over 50 countries," according to the company. "Our focus on reliability defined the bar for cloud-based elastic deployments with several layers of failover. Netflix also provides the technology to operate services responsibility with operational insight, peak performance, and security. We provide technologies for data (persistent & semi-persistent) that serve the real-time load to our 62 million members, as well as power the big data analytics that allow us to make informed decisions on how to improve our service."

This is big-time stuff, and certainly no simple task. It underscores the importance of Netflix being able to pull this off at all, and serves as an example to other companies of how big tasks can be done in the cloud.

Larry Loeb has written for many of the last century's major "dead tree" computer magazines, having been, among other things, a consulting editor for BYTE magazine and senior editor for the launch of WebWeek. He has written a book on the Secure Electronic Transaction Internet ... View Full Bio
We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
larryloeb
50%
50%
larryloeb,
User Rank: Author
8/19/2015 | 2:29:30 PM
Re: Netflix migration began seven years ago
Yes, others can use the open source tools they made for their own projects.

They do have to use AWS, but still nice to see the enabling tools out there.

Who knows what someone will come up with to use them with?
larryloeb
50%
50%
larryloeb,
User Rank: Author
8/19/2015 | 2:27:32 PM
Re: Netflix migration began seven years ago
I don't see a reason why they should have an internal cloud. They would have to run the wires to everywhere else in the world.

AWS id geographically disperse enough for them to do what they must.

The fact they made their own tools to do this move is really impressive to me. It's just a huge project and they did it right.
Princey
50%
50%
Princey,
User Rank: Apprentice
8/19/2015 | 2:22:57 PM
AWS is not the full story for Netflix
In the past few years Netflix has added Teradata's cloud service into the mix for Big Data and complex analytics.
SaneIT
50%
50%
SaneIT,
User Rank: Ninja
8/19/2015 | 8:25:19 AM
Re: Netflix migration began seven years ago
Very true, this shows how stable AWS has become and how much value is built in to the product.  The infrastructure is hard to match and Netflix seems to have realized that they could build the same product, pay to power it, support it and keep expanding or they could pay Amazon to keep building and make their product even better.  I'm glad that Netflix went this route because it means better service for everyone else in the long run.
Gary_EL
50%
50%
Gary_EL,
User Rank: Ninja
8/19/2015 | 12:35:16 AM
Re: Netflix migration began seven years ago
One of the things that is so fascinating about this is that Netflix is certainly large enough to do this on its own - it's big enough to build its own internal cloud, but the company chose not to.
larryloeb
50%
50%
larryloeb,
User Rank: Author
8/18/2015 | 6:43:58 PM
Re: Netflix migration began seven years ago
And move they did....
babcockcw
50%
50%
babcockcw,
User Rank: Apprentice
8/18/2015 | 6:39:05 PM
Netflix migration began seven years ago
I remember Adrian Cockcroft, Netflix infrastructure architect at the time, describing the 2008 start of this process at the Cloud Connect show in Santa Clara in the spring of 2010. He showed a still from an action movie, with a building blowing up, and said Netflix knew it was either going to be continuously building data centers to keep its IT infrastructure from collapsing or it was going to move to a cloud computing model.
Slideshows
What Digital Transformation Is (And Isn't)
Cynthia Harvey, Freelance Journalist, InformationWeek,  12/4/2019
Commentary
Watch Out for New Barriers to Faster Software Development
Lisa Morgan, Freelance Writer,  12/3/2019
Commentary
If DevOps Is So Awesome, Why Is Your Initiative Failing?
Guest Commentary, Guest Commentary,  12/2/2019
White Papers
Register for InformationWeek Newsletters
Video
Current Issue
Getting Started With Emerging Technologies
Looking to help your enterprise IT team ease the stress of putting new/emerging technologies such as AI, machine learning and IoT to work for their organizations? There are a few ways to get off on the right foot. In this report we share some expert advice on how to approach some of these seemingly daunting tech challenges.
Slideshows
Flash Poll