The smartest business decisions are based on fact, not gut feel. That means they're based on analysis of data, a resource that most organizations have stockpiled but failed to use to guide their business decisions. These stockpiles are growing faster than ever, with Internet clickstreams, sensor data, log files, mobile data, and social-network comments adding to vast stores of transactional information.
Led by Internet marketers, telecommunications providers, and other big data pioneers , enterprises are embracing new technologies to tap into their big data stores. Massively parallel processing (MPP) platforms and column-store databases, for example, have flourished in recent years, often deployed on pre-integrated data warehousing appliances complete with software and hardware. On the cutting edge, NoSQL (not only SQL) platforms such as Cassandra and Hadoop are now on the rise, offering low-cost options for processing and managing semi-structured, unstructured and combined data types encountered at a massive scale.
If your data volumes are headed north of 10 terabytes and you're encountering a greater variety of data, more complex data, and expectations for faster insight, it's time to reexamine your information-management strategy and infrastructure.