Interop: Data Represents Big Cloud Challenge - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Software
News
5/21/2009
03:15 PM
Connect Directly
Twitter
RSS
E-Mail
50%
50%

Interop: Data Represents Big Cloud Challenge

Slow and inefficient Internet links, security concerns, and architectural problems in terms of processing are top of mind for one expert panel.

Of all the stumbling blocks companies face in moving to cloud computing for important tasks, figuring out what to do with copious amounts of data that's stored or generated on premises is close to the top of the list, panelists said at an Interop Conference and Expo session Thursday.

There are any number of reasons data transfer and choice over where to locate important data stores when working with cloud computing present a challenge, the panelists said: slow and inefficient Internet links, security concerns, and architectural problems in terms of processing, just to name a few.

The TCP/IP protocol, a core element of network traffic, has long been seen as inefficient, and has forced many companies to buy technology like WAN optimization equipment to mitigate some of the problems associated with it.

"It surprises people that when you have a 1-Gb connection on both ends, it doesn't exactly work well to transfer data over that link, and that's because of the problems and inefficiencies with things like TCP/IP," said Internet Research Group analyst Peter Christy. "It's a much greater problem than most people think until people run into it."

That's just the beginning, though. Just moving the data from on premises to the cloud can present a challenge in terms of time and money, especially if a company wants to use the cloud for extra capacity for a largely on-premises, data-backed application and needs to be able to "burst" quickly. Case in point: Amazon.com on Thursday launched a service for companies to ship their data overland rather than upload it.

That said, sometimes it doesn't matter, and procuring additional servers would take longer than uploading or mailing the data to a company like Amazon. According to Omer Trajman, Vertica's director of field engineering, one of its financial services customers, for example, migrated its mortgage data to the cloud to begin new mortgage data modeling work because it didn't have three months to wait for a bunch of new servers to arrive at its data centers.

Even if companies solve the problem of latency and inefficient data links, there may be other bottlenecks lurking where companies might not expect them, such as at the cloud nodes themselves. Aspera estimates that Amazon EC2 nodes are good for 250 Mbps of throughput, meaning that companies with gigabit links are going to see performance degradation when they attempt to transfer or process data via the cloud.

Then there's the problem with what to do with large chunks of data when it's actually in the cloud. Amazon S3, for example, can't handle the largest of files, thus requiring companies to break up huge data stores into chunks. Aspera has had to help some of its customers do this with additional services, which could add significantly to the cost of moving to the cloud.

With all these problems, some of the panelists saw the potential emergence of a new class of vendors working on what Aspera co-founder and CEO Michelle Munson calls "data movement," combining such expertise as how to compress the amount of data sent over the Internet link, how to store data as efficiently as possible, and how to eliminate redundant data through things like data deduplication.


InformationWeek has published an in-depth report on cloud storage. Download the report here (registration required).

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Commentary
AI Regulation: Has the Time Arrived?
John Edwards, Technology Journalist & Author,  2/24/2020
News
Fighting the Coronavirus with Analytics and GIS
Jessica Davis, Senior Editor, Enterprise Apps,  2/3/2020
Slideshows
IT Careers: 10 Job Skills in High Demand This Year
Cynthia Harvey, Freelance Journalist, InformationWeek,  2/3/2020
White Papers
Register for InformationWeek Newsletters
State of the Cloud
State of the Cloud
Cloud has drastically changed how IT organizations consume and deploy services in the digital age. This research report will delve into public, private and hybrid cloud adoption trends, with a special focus on infrastructure as a service and its role in the enterprise. Find out the challenges organizations are experiencing, and the technologies and strategies they are using to manage and mitigate those challenges today.
Video
Current Issue
IT Careers: Tech Drives Constant Change
Advances in information technology and management concepts mean that IT professionals must update their skill sets, even their career goals on an almost yearly basis. In this IT Trend Report, experts share advice on how IT pros can keep up with this every-changing job market. Read it today!
Slideshows
Flash Poll