Cloudera Plans Data Hub Role For Hadoop - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Data Management // Software Platforms
News
10/29/2013
12:08 AM
Connect Directly
LinkedIn
Twitter
RSS
E-Mail
50%
50%

Cloudera Plans Data Hub Role For Hadoop

Cloudera prepares to make Hadoop a central hub and first destination for companies' data. SAS and Apache Spark add data-analysis options.

Extending The Hub

The Enterprise Data Hub vision also encompasses data-processing and data-analysis options from third-party vendors. On this front the company highlighted Cloudera Enterprise 5 support for deploying, managing and monitoring Hadoop-compatible products from partners including SAS, Revolution Analytics, Informatica, Syncsort and others. Support for SAS Scoring and SAS Visual Analytics on Cloudera's Hadoop platform is particularly significant given the vast pool of SAS-savvy data analytics professionals.

Reaching out to startups, Cloudera announced an Innovators program that will see DataBricks, the company behind Apache Spark, as an inaugural member. Spark is an in-memory analytics framework that runs on Hadoop. Now in open source, the technology is being developed and commercially supported by DataBricks, which was spun out of AMPLab at the University of California, Berkeley.

As part of the Innovators program, Cloudera announced direct support for Apache Spark within CDH, and Olson said the company will also provide technical resources and front-line support.

[ Want to hear the counterpoint view? Read Big Data Debate: Will Hadoop Become Dominant Platform? ]

In other announcements tied to the Enterprise 5 beta release, Cloudera announced new capabilities including:

-- In-memory HDFS caching designed to boost Map/Reduce processing performance and Cloudera Impala query response times,
-- User-defined functions (UDFs) that let users store custom functions for use with Cloudera Impala and the open source MADlib statistical and analytic library for in-database analytics,
-- YARN and Cloudera Manager resource management tools designed to enable administrators to allocate resources by workload and workgroup,
-- Centralized data-auditing and data-lineage features to satisfy governance and compliance requirements,
-- New cloud-based Cloudera services from Savvis (a CenturyLink company), SoftLayer (an IBM company), T-Systems and Verizon Cloud. Cloudera services were already available through Amazon Web Services.

Commercial Vs. Open Source

Cloudera's biggest competitor, Hortonworks, will likely point to the many spots where Cloudera's Enterprise Data Hub vision leads to commercial software. Olson insisted that "everything at the core and at the platform level is open source." Where the company has proprietary software -- Cloudera Manager, Cloudera Navigator and some aspects of backup and disaster recovery -- Olson said the company is delivering unique value.

"If it's about manageability, deploying and operating the software at scale, or about getting added value from the data, we reserve the right to make that proprietary," he said.

In some cases, "core" options that are open source, like Cloudera Impala and Cloudera Search, would be almost impossible to run at scale without Cloudera Manager to provision, manage and monitor the workloads and Cloudera Navigator to provide access control and auditing.

Will these differences even matter to the many Hadoop users who are still tinkering with clusters and experimenting with Map/Reduce? Or has the platform really matured to the point where many companies are ready for the Enterprise Data Hub vision?

"We don't see [Enterprise Data Hub-style deployments] ubiquitously, but in most of our longstanding accounts and among all of our very largest customers, we absolutely see this happening," Olson said. "I expect most of our installed base to be deployed in this way within the next couple of years."

That's optimistic. As for the licensing, packaging and pricing differences, we have yet to hear the details. But it sounds like we can expect an all-you-can-eat Enterprise Data Hub licensing and support approach. That, plus a harder push to extend the community and tightly integrate Cloudera's flavor of Hadoop with third-party data-management and analytics offerings from SAS and similar companies.

IT leaders must know the trade-offs they face to get NoSQL's scalability, flexibility and cost savings. Also in the When NoSQL Makes Sense issue of InformationWeek: Oregon's experience building an Obamacare exchange. (Free registration required.)

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Previous
2 of 2
Next
Comment  | 
Print  | 
More Insights
News
Can Cloud Revolutionize Business and Software Architecture?
Joao-Pierre S. Ruth, Senior Writer,  1/15/2021
Slideshows
10 IT Trends to Watch for in 2021
Cynthia Harvey, Freelance Journalist, InformationWeek,  12/22/2020
News
How CDOs Can Build Insight-Driven Organizations
Jessica Davis, Senior Editor, Enterprise Apps,  1/15/2021
White Papers
Register for InformationWeek Newsletters
Video
Current Issue
2021 Top Enterprise IT Trends
We've identified the key trends that are poised to impact the IT landscape in 2021. Find out why they're important and how they will affect you.
Slideshows
Flash Poll