10 Lessons Learned By Big Data Pioneers
August 23, 2011 02:10 PM How can you prepare for the big data era? Consider this expert advice from IT pros who have wrestled with the thorny problems, including data growth and unconventional data.
Lesson 1: Fast Querying Ensures Productivity And Timeliness
Massively parallel processing platforms, column-store databases, in-database processing techniques, and in-memory computing options can slash query times from days or hours down to minutes or seconds, but what's the big hurry? As New York ad-delivery firm Interclick has discovered, the most obvious benefit of fast analysis is productivity. Quick responses free up time for more queries, deeper analysis or both. A second benefit is near-real-time insight, whereby analyses can be acted upon while there's still an opportunity. With fast response, Interclick can serve up ads to targeted segments of Web surfers within hours or even minutes of demonstrated behavior. An ad for an airline, hotel chain, or car rental agency, for example, can be delivered soon after someone has visited a travel-related Web site--and before they've made all their arrangements. Interclick's speed enabler is a ParAccel column-store database deployment turbocharged by a 3.2-terabyte-RAM in-memory cluster.