Cloud // Infrastructure as a Service
09:26 AM
Connect Directly

Cloud ROI: Why It's Still Hard To Measure

Why does calculating cloud ROI remain so tough? Examine the tactics used by two cloud innovators, GE and Airbnb -- plus our exclusive survey.

When it comes to judging the true cost of cloud computing, many companies try to break down the cost of running their own on-premises data center and compare that with the cost of using Amazon's or Microsoft's cloud. At Airbnb, Dave Augustine doesn't really have time for all that.

The six-year-old Web company has never had its own data center. Airbnb launched its service, which matches travelers with people looking to rent out a room or other accommodation, using the Amazon cloud, and its developers still build all their applications for Amazon's EC2. Having more than one cloud infrastructure provider, says Augustine, Airbnb's manager of site reliability engineering, "is an interesting idea" he might look at someday -- perhaps after Airbnb doubles its bookings again. As for determining his company's return on investment on Amazon services, Augustine calls that "penny-pinching."

Augustine and Airbnb land in the minority of respondents to this year's InformationWeek Cloud ROI Survey -- the 20% of companies that don't calculate ROI for their cloud projects. The other 80% of the 339 companies using or evaluating cloud computing say they're highly to somewhat likely to calculate ROI for cloud projects. "Right now, we have better things to do," Augustine says.

While the 122-year-old General Electric also is "all-in on the cloud," says GE Cloud chief operating officer Chris Drumgoole, its approach is dramatically different from Airbnb's. Unlike Airbnb, the 300,000-employee GE wasn't born in the cloud and must find a way to migrate a massive legacy application infrastructure. GE operates 34 company-owned data centers and runs more than 9,000 applications. It's now consolidating to five data centers and painstakingly evaluating which applications it will rearchitect and move into a private or public cloud, and which ones it will phase out. It's also using software-as-a-service selectively, striking a deal in May, for example, to give employees access to Box online storage.

And if you know GE, the king of managing through metrics, you know it's basing its cloud decisions on intense ROI calculations. Put GE among the 23% of respondents in our Cloud ROI Survey who are highly likely to calculate ROI.

[Read related stories: Cloud ROI Easy Win: Disaster Recovery and Milliman Strives For ROI With Azure System.]

But cloud ROI calculations are difficult, even for a company as steeped in analytics as GE. Unlike Airbnb, GE wants multiple cloud infrastructure providers; it's using Amazon and Microsoft Azure today, and it plans to use Verizon's cloud. "We envision a world metric that measures application performance" across vendors, Drumgoole says, but such a measure won't be possible until GE has at least a year of captured experience, and probably several years' worth.

The stories of Airbnb and GE reflect the reality of cloud computing technology. Operationally, cloud technology has proved itself capable of handling large-scale infrastructure and software needs. Financially, however, companies still are struggling with the right way to calculate the payback; how to measure the cloud's value in speed, cost, and staff focus; and how to assess where cloud use makes the most sense.

The responses to InformationWeek's Cloud ROI Survey reinforce that uncertainty. Some notable findings:

-- At least half of survey respondents consider these three financial factors among their top cloud ROI priorities: initial capital costs, operational expense,

Next Page

Charles Babcock is an editor-at-large for InformationWeek and author of Management Strategies for the Cloud Revolution, a McGraw-Hill book. He is the former editor-in-chief of Digital News, former software editor of Computerworld and former technology editor of Interactive ... View Full Bio

1 of 3
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
<<   <   Page 2 / 2
User Rank: Author
8/4/2014 | 10:45:49 AM
So interesting to contrast the approaches of GE, with all its legacy apps, and Airbnb, with less baggage in tow. Interesting that GE will collect its own data for that "world metric." I supsect it will be worth the wait.
<<   <   Page 2 / 2
Multicloud Infrastructure & Application Management
Multicloud Infrastructure & Application Management
Enterprise cloud adoption has evolved to the point where hybrid public/private cloud designs and use of multiple providers is common. Who among us has mastered provisioning resources in different clouds; allocating the right resources to each application; assigning applications to the "best" cloud provider based on performance or reliability requirements.
Register for InformationWeek Newsletters
White Papers
Current Issue
Top IT Trends to Watch in Financial Services
IT pros at banks, investment houses, insurance companies, and other financial services organizations are focused on a range of issues, from peer-to-peer lending to cybersecurity to performance, agility, and compliance. It all matters.
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on for the week of August 21, 2016. We'll be talking with the editors and correspondents who brought you the top stories of the week to get the "story behind the story."
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.