Cloud // Infrastructure as a Service
News
4/10/2014
11:35 AM
Connect Directly
Twitter
RSS
E-Mail
50%
50%

Netflix Cloud Architect: How To Succeed As Disruptor

Adrian Cockcroft, Netflix's former chief cloud architect, outlines how a changed business flowed out of the cloud.

be handed off to someone not familiar with what's gone before or someone who didn't understand the goals the team was shooting for. "Getting to that high trust is difficult," he conceded.

But doing so enabled Netflix to transform its business rapidly from a novel supplier to the firm that outmaneuvered Blockbuster in a changing market and became the dominant supplier of home video. By the time Cockcroft left, it had changed from a firm with a few million subscribers to one with 30 million in the US and 8 million more worldwide.

The empowered developers and high-trust product cycle would not have been possible without Netflix's move into Amazon's EC2 infrastructure-as-a-service, where servers could be spun up as needed. The decision to do so was made by CEO Reed Hastings, Cockcroft, and other executives and then adopted throughout the company.

How did Netflix build out an organization that understood how to exploit the opportunities of the new infrastructure? For a young and growing firm, there was no possibility of a long retraining period, but that wasn't a big problem, Cockcroft said. "Ninety percent of the architecture is through hiring people who want to do what you need to do," he said.

At first, many businesspeople declared Netflix crazy for closing its own datacenters in 2008 and declared, "It will never work." By 2010 and 2011, they were saying what Netflix did works for it, but Netflix was "a unicorn," unlike other businesses, which could never do what it was doing. By 2013 and 2014, other businesses wanted to emulate the Netflix pattern. The firm made that possible by donating many of the systems it had developed as open source code. There are 40 projects on GitHub that had their origin at Netflix, Cockcroft said.

"We wanted to invest our intellectual capital on things that were unique to Netflix. This was at [the] root of our move to the cloud," he said. In some cases, using software-as-a-service, Netflix declined to "build things that are undifferentiated in nature from our rivals," and moved wholesale into a massive video-streaming business that on some days makes up 30% of Internet activity, he said.

Randy Mott, CIO of General Motors, spoke before Cockcroft, warning against outsourcing and supporting bringing IT skills back in-house under a central authority. As Cockcroft took the stage, he warned much of his talk "would be in contrast" to the speaker who came before him.

When Cockcroft finished, Jerry Johnson, recently retired as CIO of Pacific Northwest National Labs, said:

    You've both inspired me and scared the hell out of me. There's a big difference from where you're at and where Randy is at. What scared me was your discussion about "low process, high trust," and the potential effect that has on customer impact. At Netflix, you have a tolerant customer base. If a customer can't find an actor they want one day, they'll come back. If Randy has that high trust and a young developer makes a change that shuts down a production line, that's a whole different problem.

Cockcroft thought a moment and responded. Delivering a film as expected to a parent with children expecting to see it can also be viewed as a mission-critical issue, he said. The system must perform as expected, or Netflix can lose the customer. The Netflix systems in the cloud are resilient, spread across six Amazon complexes and three availability zones. One can go down completely and the systems in the other two zones will sustain Netflix business as expected.

The cloud and Netflix's way of using it aren't low-cost options. They've become the platform on which the company wishes to base the reliability and future of its business -- and that's what it's doing, he said.

Too many companies treat digital and mobile strategies as pet projects. Here are four ideas to shake up your company. Also in the Digital Disruption issue of InformationWeek: 6 Enduring Truths About Selecting Enterprise Software. (Free registration required.)

Charles Babcock is an editor-at-large for InformationWeek, having joined the publication in 2003. He is the former editor-in-chief of Digital News, former software editor of Computerworld and former technology editor of Interactive Week. He is a graduate of Syracuse ... View Full Bio

Previous
2 of 2
Next
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
ChrisMurphy
50%
50%
ChrisMurphy,
User Rank: Author
4/11/2014 | 9:02:11 AM
Re: Was the cloud the cause or just an enabler?
Adrian's presentation was very thought provoking, especially coming right after General Motors CIO Randy Mott's session that made the case that cloud services might get you EVEN with your competitors, and ahead of where you are today, but it will never give you competitive advantage over competitors. The two sessions had a lot of people talking, since they offered such different ends of the spectrum. 
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
4/10/2014 | 2:37:34 PM
Was the cloud the cause or just an enabler?
Netflix' move to the cloud coincided with its disruption of the home movie rental business. The cloud, if not the cause of the disruption, was an enbler. Netflix had to convert analogue content on EC2, store it and then stream the new digitized content to millions of customers. The power of the cloud was available for each step that moved Netflix away from shipping DVDs.

 
Multicloud Infrastructure & Application Management
Multicloud Infrastructure & Application Management
Enterprise cloud adoption has evolved to the point where hybrid public/private cloud designs and use of multiple providers is common. Who among us has mastered provisioning resources in different clouds; allocating the right resources to each application; assigning applications to the "best" cloud provider based on performance or reliability requirements.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest - July 22, 2014
Sophisticated attacks demand real-time risk management and continuous monitoring. Here's how federal agencies are meeting that challenge.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
A UBM Tech Radio episode on the changing economics of Flash storage used in data tiering -- sponsored by Dell.
Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.