Big Data // Big Data Analytics
News
2/20/2014
09:06 AM
Connect Directly
Google+
RSS
E-Mail

Think Today's Data Is Big? Wait 10 Years

If a petabyte won't qualify as big data, what will? Cleversafe's founder explains.

Comment  | 
Print  | 
Comments
Newest First  |  Oldest First  |  Threaded View
Chris Gladwin
50%
50%
Chris Gladwin,
User Rank: Apprentice
2/24/2014 | 2:21:51 PM
Re: How do the connections even keep up?
Certainly the growth of data will drive demand for increased network bandwidth. But innovative, new approaches - not just brute use of old methods that have worked in the past - will be required to handle this data growth from Terabyte to Petabyte to Exabyte scale.  For example, just replicating multiple copies of an Exabyte and sending those copies around a network to create location failure tolerance would create a huge wave of bandwidth demand and could overwhelm even an advanced network infrastructure.  Instead, new information coding techniques – such as Information Dispersal Algorithms – can be used to create multi-site failure tolerance while consuming less bandwidth than multiple copies.
Chris Gladwin
50%
50%
Chris Gladwin,
User Rank: Apprentice
2/24/2014 | 1:54:23 PM
Re: Beyond size
A huge factor driving data storage demands is the improving capability of smart machines, like cameras, scanners, genomics sequencers and more, to create ever-increasing amounts of digital information. All this additional information has a lot of benefits, but it also has a profound and increasing impact on the demand for data storage.
Stratustician
50%
50%
Stratustician,
User Rank: Ninja
2/22/2014 | 11:50:40 AM
How do the connections even keep up?
Am I the only one who is thinking "ok, if we have that kind of data scale, how can you possibly keep up from a network perspective?"  8K video?  I am scared to barely watch .MKV files on my mobile device or via my home internet connection, what would the internet bills look like processing that size of data?  Can the network providers even keep up with the demand for processing and accessing such vast amounts of data?  That is the real question.  If you are an organization working with petabytes, or exabytes, the processing power to manage the information, outside of storage requirements, will be significant.  Throw in Cloud, and how you plan to access the information over the internet, and either you will be like Google and build your own networks, or we will have to see a revamp in the way data charges are set by the telecom providers.  

And don't even get me started on replication to cloud, or disaster recovery/business continuity.  How long would it take to work with that much data over today's networks?!
WKash
50%
50%
WKash,
User Rank: Author
2/20/2014 | 11:19:21 PM
Re: Beyond size
Seeing 4K video now coming to the market, and knowing that's one small indication of the growing volume of data flooding into the world, it's easy to imagine how quaint TBs and PBs are already becoming.

 
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
2/20/2014 | 9:00:51 PM
It's a good time to be a storage builder
Yes, big data is about more than size, but there's no denying the size of data sets is one of the few things keeping pace with Moore's Law. Fortunately, storage systems are almost keeping pace as well. But the projected sizes involved mean a lot of money is going to be spent on storage.
ChrisMurphy
50%
50%
ChrisMurphy,
User Rank: Author
2/20/2014 | 11:22:01 AM
Beyond size
Big data is about more than size. We're hearing a lot that the variety of data types is at least as big a challenge ahead. What other "big" factors are causing headaches? 
6 Tools to Protect Big Data
6 Tools to Protect Big Data
Most IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest September 18, 2014
Enterprise social network success starts and ends with integration. Here's how to finally make collaboration click.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
The weekly wrap-up of the top stories from InformationWeek.com this week.
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.