Virtual private data marts eliminate the need for costly new physical data marts.
EBay has instituted a utility computing model to better manage the growth of its data warehouse that Oliver Ratzesberger, senior director of architecture and operations, refers to as "analytics as a service."
This service lets authorized eBay employees access a virtual slice of the main data warehouse server where they can store and analyze their own data sets--either in isolation or in combination with core data in the enterprise data warehouse. EBay's virtual private data marts have been quite successful--hundreds have been created, with 50 to 100 in operation at any one time. They've eliminated the company's need for new physical data marts that cost an estimated $1 million apiece and require the full-time attention of several skilled employees to provision.
Virtual marts are often used only for a few days or weeks, so system resources are quickly reclaimed. Users typically introduce less than a terabyte of new data, which they often want to analyze in conjunction with the data in the enterprise data warehouse. If these projects were implemented as separate physical data marts, the required core data would probably be extracted to the data mart, swelling its size, requiring a way to keep replicated data up to date, and multiplying cost and complexity in other ways.
EBay's analytics as a service is a way for people to do "agile prototyping," Ratzesberger says. "They can do experiments quickly and succeed or fail quickly and inexpensively." This helps the company move faster to find and exploit opportunities in connection with Web site optimization, fraud detection, and revenue generation.
When an analytic environment is needed for more than 90 days, the data warehouse team explores whether the user's data ought to be incorporated into the enterprise model.
How Enterprises Are Attacking the IT Security EnterpriseTo learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
IT Strategies to Conquer the CloudChances are your organization is adopting cloud computing in one way or another -- or in multiple ways. Understanding the skills you need and how cloud affects IT operations and networking will help you adapt.