When Data Hoarding Makes Sense
Newest First  |  Oldest First  |  Threaded View
User Rank: Apprentice
7/28/2014 | 3:40:32 PM
One case where it's good to be a hoarder..
Great article and topic, Jeff. I agree with Bill – this is one case where it's good to be a hoarder. In my opinion big data requires having access to as much data as possible, retained over the longest period of time – it's no longer enough to just toss what you can't store. With the meteoric rise of data, companies can't expect to get by with the bare minimum. That said, it's important that companies focus on placing data in the appropriate tiers. I have been watching the growth in "cold data" in which companies store less-frequently accessed data at a lower price point with only moderately reduced access times – created to tackle this exact problem. If you are interested, we recently conducted research on this exact topic:

-Jeff Flowers, Founder/CEO Storiant
Alan Simon
Alan Simon,
User Rank: Apprentice
7/22/2014 | 10:49:58 PM
Re: Hoarding generously
The long-standing argument against data hoarding, going back to the early days of data warehousing, was grounded on two points: 1) the excessive amount of up-front business analysis needed to properly categorize, organize, cleanse, move, and then store operational data in some form of an analytical database; and 2) the cost and complexity of the storage and databases needed to do so. However, as Mr. Schmarzo points out, Big Data technology effectively neutralizes those two arguments, opening up new possibilities for insights drawn from "broad and deep" retained data. Not every modern data repository will in fact yield outsized results from its cache of "hoarded" data, but that doesn't matter; the opportunity cost of not doing so should be enough to trigger business and technology strategists to "think like a hoarder" and leave behind those long-standing arguments against doing so.
User Rank: Strategist
7/22/2014 | 1:51:55 PM
Re: Hoarding generously
I like how you put it this way, David: hoarding generously. It's what data hoarders should do, really. There has always been a negative connotation with hoarding data, so this is a welcome viewpoint.
David F. Carr
David F. Carr,
User Rank: Author
7/22/2014 | 12:43:47 PM
Hoarding generously
The more negative data hoarding behaviors in business are more about business units hoarding data as part of a power play, as in keeping it to themselves, refusing to share with others who could make productive use of that data. What you're talking about here is less selfish, more generous, data accumulation for the (potential) good of the organization.

Register for InformationWeek Newsletters
White Papers
Current Issue
Top IT Trends to Watch in Financial Services
IT pros at banks, investment houses, insurance companies, and other financial services organizations are focused on a range of issues, from peer-to-peer lending to cybersecurity to performance, agility, and compliance. It all matters.
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on for the week of September 25, 2016. We'll be talking with the editors and correspondents who brought you the top stories of the week to get the "story behind the story."
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.