Cloudera Intros Hadoop Monitoring, Self-Provisioning Tool - InformationWeek
IoT
IoT
Data Management // Software Platforms
News
10/14/2014
04:06 PM
Connect Directly
Facebook
Google+
RSS
E-Mail
50%
50%

Cloudera Intros Hadoop Monitoring, Self-Provisioning Tool

Cloudera Director tool leads off lineup of announcements, including upgrades to Impala SQL query engine and stronger security.

EMP, Debunked: The Jolt That Could Fry The Cloud
EMP, Debunked: The Jolt That Could Fry The Cloud
(Click image for larger view and slideshow.)

Leading Apache Hadoop provider Cloudera made a slew of announcements Tuesday, starting with the release of a new, free tool for monitoring and self-service provisioning of Hadoop clusters in the cloud.

Called Cloudera Director, the tool allows business users to provision and monitor private or public cloud deployments of Hadoop, reportedly without needing IT staff intervention. If it works as advertised, Director will make scalable Hadoop cloud deployments far easier to spin up. The application also includes usage tracking for determining costs and departmental charge-backs.

Amazon Web Services (AWS) is the first cloud vendor to be certified with Cloudera Director, followed by SoftLayer, CenturyLink, and T Systems; other cloud providers are in the works.

The new tool represents "over a year of talking to customers" about their needs for data integration, governance, and security in the cloud, Matt Brandwein, Cloudera's director of product marketing, told InformationWeek in a phone call.

[Hadoop? A high-scale relational database? NoSQL? Event-processing technology? Here's how to decide. Big Data: How To Pick Your Platform.]

While most Cloudera customers are using on-premises Hadoop today, the company has seen a lot of experimentation in the cloud. "We want to get ahead of that... We want to have their favorite Hadoop experience waiting for them in the cloud," Brandwein said.

While Cloudera Director is free to download and use, the company expects production deployments of cloud Hadoop (either entirely in the cloud or a hybrid of on-premises and cloud) will step up to a paid Cloudera subscription, which includes an unlimited number of Director seats.

Cloudera made its announcements on the eve of Strata+Hadoop World, where attendance will double compared to the 2013 conference, shown here.(Source: O'Reilly Media)
Cloudera made its announcements on the eve of Strata+Hadoop World, where attendance will double compared to the 2013 conference, shown here.
(Source: O'Reilly Media)

Impala 2.0
Since its release 18 months ago, Cloudera's Impala, an SQL query engine for Hadoop, has been downloaded more than a million times. The 2.0 release beefs up support for core SQL functions, vendor-specific SQL extensions, and legacy data types.

Also new in Impala 2.0 is the removal of query-size limits. The database now supports queries against physical disks, and so is no longer dependent on RAM size, as was the case in the previous version.

Security improvements
Rounding out the news, Cloudera said it had significantly beefed up the security attributes of Cloudera 5.2. While healthcare, financial services, and government organizations are showing increasing interest in Hadoop databases, they often can't move on to production deployments due to a lack of industry-standard security features.

"Security has been a major area of investment for well over a year now, and we've had the opportunity to speak with hundreds of customers," Brandwein said, adding that without these security features, Hadoop deployments will be forever be relegated to a side role as cut-off "sandboxes."

To address these shortcomings, Cloudera 5.2 brings the following:

  • Perimeter security based on Kerberos network authentication
  • Role-based access controls for both SQL and non-SQL resources
  • Hardware-level security for Intel chips (leveraging the chipmaker's $740 million, 18% investment in Cloudera in March)
  • Support for auditing and data-lineage tracking
  • Comprehensive encryption, including centralized management of encryption keys (leveraging Cloudera's acquisition of Gazzang in June)

Cloudera made its announcements a day ahead of Strata+Hadoop World's opening in New York. The three-day conference, co-presented by O'Reilly Media and Cloudera, is sold out, with 5,000 attendees expected, nearly double the size of the last year's New York show, according to Cloudera.

What will you use for your big data platform? A high-scale relational database? NoSQL database? Hadoop? Event-processing technology? One size doesn't fit all. Here's how to decide. Get the new Pick Your Platform For Big Data issue of InformationWeek Tech Digest today. (Free registration required.)

Ellis Booker has held senior editorial posts at a number of A-list IT publications, including UBM's InternetWeek, Mecklermedia's Web Week, and IDG's Computerworld. At Computerworld, he led Internet and electronic commerce coverage in the early days of the web and was ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Register for InformationWeek Newsletters
White Papers
Current Issue
Top IT Trends for 2018
As we enter a new year of technology planning, find out about the hot technologies organizations are using to advance their businesses and where the experts say IT is heading.
Video
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll