A Winter Corp. report says warehouses with as much as 200 terabytes of raw data will be operational by 2004, occupying nearly 1 petabyte of disk space.
Data warehouses with as much as 100 to 200 terabytes of raw data will be operational by next year, performing nearly 2,000 concurrent queries and occupying nearly 1 petabyte (1,000 terabytes) of disk space. In the same time period, transaction-processing databases will handle workloads of nearly 66,000 transactions per second.
Those predictions are in a new report from the Winter Corp. consulting firm, based on surveys of operators of some of the largest decision-support (data warehouse) and transaction-processing databases in the world. "We're moving into the area, in the next year or two, of petabyte systems," president Richard Winter says.
Despite the slowdown in IT spending since early 2001, companies have continued to invest in large-scale database projects. They say the systems raise productivity, enhance customer-relationship management and customer-satisfaction efforts, provide a single view of the business, and improve the bottom line, according to the report.
Designing such rapidly growing databases so that they are manageable and useful is a difficult challenge, especially as more databases are used for real-time applications, Winter says. While computer hardware can provide the needed processing power for giant databases, faster interconnects to move data in and out are needed, as are increasingly sophisticated database design and management tools.
IT's Reputation: What the Data SaysInformationWeek's IT Perception Survey seeks to quantify how IT thinks it's doing versus how the business really views IT's performance in delivering services - and, more important, powering innovation. Our results suggest IT leaders should worry less about whether they're getting enough resources and more about the relationships they have with business unit peers.
What The Business Really Thinks Of IT: 3 Hard TruthsThey say perception is reality. If so, many in-house IT departments have reason to worry. InformationWeek's IT Perception Survey seeks to quantify how IT thinks it's doing versus how the business views IT's performance in delivering services - and, more important, powering innovation. The news isn't great.