Data analysis is a do-or-die requirement for today's businesses. We analyze notable vendor choices, from Hadoop upstarts to traditional database players.
1 of 17
Revolutionary. That pretty much describes the data analysis time in which we live. Businesses grapple with huge quantities and varieties of data on one hand, and ever-faster expectations for analysis on the other. The vendor community is responding by providing highly distributed architectures and new levels of memory and processing power. Upstarts also exploit the open-source licensing model, which is not new, but is increasingly accepted and even sought out by data-management professionals.
Apache Hadoop, a nine-year-old open-source data-processing platform first used by Internet giants including Yahoo and Facebook, leads the big-data revolution. Cloudera introduced commercial support for enterprises in 2008, and MapR and Hortonworks piled on in 2009 and 2011, respectively. Among data-management incumbents, IBM and EMC-spinout Pivotal each has introduced its own Hadoop distribution. Microsoft and Teradata offer complementary software and first-line support for Hortonworks' platform. Oracle resells and supports Cloudera, while HP, SAP, and others act more like Switzerland, working with multiple Hadoop software providers.
In-memory analysis gains steam as Moore's Law brings us faster, more affordable, and more-memory-rich processors. SAP has been the biggest champion of the in-memory approach with its Hana platform, but Microsoft and Oracle are now poised to introduce in-memory options for their flagship databases. Focused analytical database vendors including Actian, HP Vertica, and Teradata have introduced options for high-RAM-to-disk ratios, along with tools to place specific data into memory for ultra-fast analysis.
Advances in bandwidth, memory, and processing power also have improved real-time stream-processing and stream-analysis capabilities, but this technology has yet to see broad adoption. Several vendors here complex event processing, but outside of the financial trading, national intelligence, and security communities, deployments have been rare. Watch this space and, particularly, new open source options as breakthrough applications in ad delivery, content personalization, logistics, and other areas push broader adoption.
Our slideshow includes broad-based data-management vendors -- IBM, Microsoft, Oracle, SAP -- that offer everything from data-integration software and database-management systems (DBMSs) to business intelligence and analytics software, to in-memory, stream-processing, and Hadoop options. Teradata is a blue chip focused more narrowly on data management, and like Pivotal, it has close ties with analytics market leader SAS.
Plenty of vendors covered here offer cloud options, but 1010data and Amazon Web Services (AWS) have staked their entire businesses on the cloud model. Amazon has the broadest selection of products of the two, and it's an obvious choice for those running big workloads and storing lots of data on the AWS platform. 1010data has a highly scalable database service and supporting information-management, BI, and analytics capabilities that are served up private-cloud style.
The jury is still out on whether Hadoop will become as indispensable as database management systems. Where volume and variety are extreme, Hadoop has proven its utility and cost advantages. Cloudera, Hortonworks, and MapR are doing everything they can to move Hadoop beyond high-scale storage and MapReduce processing into the world of analytics.
The niche vendors here include Actian, InfiniDB/Calpont, HP Vertica, Infobright, and Kognitio, all of which have centered their big-data stories around database management systems focused entirely on analytics rather than transaction processing. German DBMS vendor Exasol is another niche player in this mold, but we don't cover it here as its customer base is almost entirely in continental Europe. It opened offices in the U.S. and U.K. in January 2014.
This collection does not cover analytics vendors, such as Alpine Data Labs, Revolution Analytics, and SAS. These vendors invariably work in conjunction with platforms provided by third-party DBMS vendors and Hadoop distributors, although SAS in particular is blurring this line with growing support for SAS-managed in-memory data grids and Hadoop environments. We also excluded NoSQL and NewSQL DBMSs, which are heavily (though not entirely) focused on high-scale transaction processing, not analytics. We plan to cover NoSQL and NewSQL platforms in a separate, soon-to-be-published collection.
Now dig in and learn more about these analytics vendors and how they compare.
6 Tools to Protect Big DataMost IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Big Data Brings Big Security ProblemsWhy should big data be more difficult to secure? In a word, variety. But the business won’t wait to use it to predict customer behavior, find correlations across disparate data sources, predict fraud or financial risk, and more.
InformationWeek Tech Digest, Nov. 10, 2014Just 30% of respondents to our new survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives?