Big Data. Big Decisions
InformationWeek
Special Coverage Series

Commentary

Doug Henschen

Doug Henschen

Executive Editor, InformationWeek

SAS Gets Hip To Hadoop For Big Data



(Page 2 of 2)

SAS didn't divulge the cost of its software or discuss whether licensing models would change to adapt to the open source, big data world, but the vendor clearly expects to do more on the Hadoop platform. A SAS High-Performance Marketing Optimization application announced last week will run on Hadoop with a release expected next April. For now that application, which is built on the HPA Server, runs on EMC Greenplum and Teradata.

High-Performance Marketing Optimization is designed to speed marketing campaign analysis when organizations are dealing with thousands of campaigns and millions or even billions of customer records. At this scale it can take eight to 12 hours or more to run optimizations -- either to identify the most successful marketing offer or the most responsive target audience -- but running on EMC Greenplum or Teradata, that analysis might take just a few minutes.

More Insights

Webcasts

More >>

White Papers

More >>

Reports

More >>

Once the marketing app can run on Hadoop it will presumably be able to handle campaigns with even bigger and more varied data sets, and users will be able to quickly analyze new data sets without the delays associated with transforming data to meet a rigid, predefined data model as required in relational environments.

Among the other announcements made by SAS last week were a new stream processing engine and updates of the SAS Text Analytics module and SAS Model Manager. SAS DataFlux Event Stream Processing (ESP) is designed to bring the vendor's fraud and risk-analysis chops to the world of real-time data processing.

[ Want more on analytics alternatives? Read Low-Cost Options For Predictive Analytics Challenge SAS, IBM. ]

Stream processing is mostly practiced by financial institutions for their trading-floor applications. These firms usually have real-time infrastructure in place, but ESP is designed to deliver a callable, embeddable service that these operations can bring into their operational environment to handle tasks such as trade surveillance. Other possible applications include anti-money-laundering surveillance for banks, just-in-time inventory and purchasing for retailers, customer intelligence in e-commerce scenarios and customer-churn analysis for telcos.

The SAS Text Mining update incorporates automated learning and rule-generation features that will back up domain expertise with machine-learning algorithms. For example, a domain expert might have some idea what to expect from a batch of warranty claims, insurance claims, customer surveys, or a stream of social comments.

Machine-analysis offers a second opinion that uncovers human content-categorization errors, oversights, and hidden relationships between, say, a particular model of car and warranty claims, accidents, and customer dissatisfaction. Once machine learning has uncovered latent patterns, domain experts can work with and customize system-generated classification rules to develop more accurate text-mining results and applications, according to SAS.

In keeping with SAS' push into big data, the SAS Model Manager updates are partly aimed at embracing non-SAS predictive models including those written in PMML (Predictive Model Markup Language) and R. Where the model manager previously focused on SAS models, this administrative tool can now be used to import, validate, publish, deploy, and monitor the ongoing performance of third-party models. The upgrade also delivers new statistical measures around probability-to-default and loss measures tied to Basel II compliance for financial institutions.

If you review the bulk of SAS' many announcements last week, you can see two clear patterns. One, it's delivering a steady stream of updates for customers using conventional tools and tried-and-true approaches to do analysis at less-than-big-data scale. Second, at the cutting edge of big data and high-performance computing, SAS is acknowledging that the same old tools and years-long product-delivery timelines just won't cut it with this new class of customers.

« Previous Page | 1 2  


Related Reading




Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

BYTE encourages readers to engage in spirited, healthy debate, including taking us to task. However, BYTE moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing/SPAM. BYTE further reserves the right to disable the profile of any commenter participating in said activities.

Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.

Follow InformationWeek

By The Numbers

What Are Your Primary Concerns About Using Big Data Software?

Base: 417 respondents at organizations using or planning to deploy data analytics, BI or statistical analysis software
Data: InformationWeek 2013 Analytics, Business Intelligence and Information Management Survey of 541 business technology professionals, October 2012

What Do You Think?

What's your attitude about SQL analysis on top of Hadoop?
We want fast, standard SQL analysis capabilities on Hadoop ASAP
Hadoop is for unstructured data; SQL is for relational databases
We'll give SQL on Hadoop a try, but relational DBs will remain the mainstay
Given strong SQL support on Hadoop, we'd nix the data warehouse
We're not interested in Hadoop
No opinion



Related Content

From Our Sponsor

Five Big Data Challenges and How to Overcome Them with Visual Analytics

Five Big Data Challenges and How to Overcome Them with Visual Analytics

Business leaders often need a visual snapshot of data to quickly grasp and use it. This paper identifies five challenges in presenting data and how visual analytics can resolve them. Solutions are suggested to overcome the challenges of: speed, data clarity, data quality, displaying meaningful results, and dealing with outliers.

Game-Changing Analytics: How IT Executives Can Use Analytics to Create Innovation and Business Success

Game-Changing Analytics: How IT Executives Can Use Analytics to Create Innovation and Business Success

Today's competitive advantage requires a deeper understanding of your business, your market and your customers. As an IT executive, you can drive that knowledge transformation. In this white paper, learn how to make decisions as a strategic business leader and three steps to begin an analytics initiative within your enterprise.

Data Visualization Techniques: From Basics to Big Data with SAS Visual Analytics

Data Visualization Techniques: From Basics to Big Data with SAS Visual Analytics

High-performance data visualization turns sophisticated analyses into meaningful graphics, leading to faster and smarter decision making. In this white paper, learn how visual analytics can transform big data, with additional features such as real-time functionality, mobile compatibility, robust applications for technical groups and accessibility for nontechnical users.

Big Data: Lessons from the Leaders

Big Data: Lessons from the Leaders

Financial performance, competitive advantage, operational efficiency, strategic decision making - every business goal can extract value from big data, and the time for doubt or inaction has long passed. In this Economist Intelligence Unit report, in-depth interviews with data pioneers reveal the link between the effective use of big data and the bottom line among other results.

Decision-Driven Data Management: A Strategy for Better Decisions with Better Data

Decision-Driven Data Management: A Strategy for Better Decisions with Better Data

Which came first, the data or the decision? This white paper makes the case for having a decision in mind, then tailoring big data's volume, variety and velocity to achieve business results such as overcoming customer dissatisfaction or creating well-informed strategies in real time.

Informationweek Reports

Research: The Big Data Management Challenge

Research: The Big Data Management Challenge

The challenge of big data is real, but most organizations don't differentiate 'big data' from traditional data, and nearly 90% of respondents to our survey use conventional databases as the primary means of handling data. We'll help you understand what constitutes big data (it's not just size) and the numerous management challenges it poses.