Big Data. Big Decisions
InformationWeek
Special Coverage Series

Commentary

Fritz Nelson

Fritz Nelson

Vice President, Editorial Director InformationWeek Business Technology Network

Microsoft Joins Oracle In Big Data Push

What a big week for big data. Hadoop could change your business, but how about healthcare, politics, and crimefighting?

InformationWeek Now--What's Hot Right Now
Last week seemed like big data's debutante ball, with Oracle brass blathering on about Exa-this and Exa-that, though it was pre-empted a bit by EMC's new Greenplum Modular Data Computing Appliance two weeks earlier.

The Hadoop-ification of the data world bled into this week when Microsoft, quiet save for its SQL Server Parallel Data Warehouse, announced that it, too, would be making big noise about big data. Microsoft added a couple of surprises to its plans for SQL Server 2012, wrote InformationWeek's Doug Henschen on Wednesday: "First, the platform will include big data processing capabilities based on Apache Hadoop. And second, new touch-based data exploration capabilities will be extended to Apple iOS devices."

More Insights

Webcasts

More >>

White Papers

More >>

Reports

More >>

Microsoft will offer Hadoop on Azure and on Windows Server, but details, including when, are nebulous--known only to some predictive analytics agent that has yet to be invented. What is known: There will be Hadoop connectors for SQL Server and SQL Parallel Data Warehouse, and there will be Hive ODBC drivers for customers using Microsoft's BI tools.

This Big Data is a Big Deal, and while it is more likely futuristic for most companies, the big suppliers (Oracle, IBM, EMC, HP, Teradata, SAP, Microsoft) are jockeying for supremacy already. Many of them are well known for their prowess in the world of structured data, but unstructured data is much more prevalent and much more difficult to manage, let alone to extract meaning from.

Henschen writes:

"Interest in Hadoop is driven primarily by the need to handle large volumes of loosely or inconsistently structured data such as social network feeds, Web logs, email, documents, and other text-centric information. These data types can be used for applications such as customer sentiment analysis, but they cannot be effectively managed in a relational database such as SQL Server, Oracle Database, or IBM's DB2."

Big data may seem the realm of big business, and to a great extent it is, but its impact is as meaningful as its ambitious moniker suggests. For example, the 2012 political campaigns are starting to use complex data tools (social network data mining, master data management) to gird for the election; CNN recently detailed the intricacies behind the Obama campaign's complex big data efforts for voter outreach.

CNN writes: "The Obama campaign not only has a Facebook page with 23 million 'likes' (roughly 10 times the total of all the Republicans running), it has a Facebook app that is scooping up all kinds of juicy facts about his supporters."

The report talks about the team's use of NationalField, which it describes as a social network tool that lets everyone share their work--not just the typical structured data, but "qualitative information: what points or themes worked for them in a one-on-one conversation with voters, for example. Ups,' 'Downs' and 'Solutions' are color-coded, so people can see where successes are happening or challenges brewing."

At this week's Web 2.0 Expo, LinkedIn's former Chief Scientist, DJ Patil, talked about the company's goal of making big data useful, the role of the "data scientist" and the act of what Patil called "data jujitsu," according to InformationWeek's David Carr. And where science meets martial arts, customers get things like LinkedIn's "people you may know" widget, recruiter recommendations, and job opening recommendations.

While data makes for better products and helps companies gain an edge, it can also save lives. InformationWeek Healthcare's Paul Cerrato wrote earlier this week about how doctors are starting to personalize care based on analyzing clinical data. For instance, medical professionals have begun using this data to individualize treatment protocols, to understand the risk factors that lead to patients being re-admitted to hospitals--and intervene with specialized care to prevent it. They're also vying to increase the success rate of drug treatments for diabetes and coronary patients while also reducing treatment costs.

The Department of Homeland Security is even using big data analysis techniques to help prevent crime. As InformationWeek Government's Elizabeth Montalbano writes: "Specifically, the program--which is only in the preliminary stages of research--is using sensors to 'non-intrusively' collect video images, audio recordings, and so-called 'psychophysiological measurements' such as heart rate, breathing patterns, and eye blinking, that will be analyzed for their association with certain behaviors."

Big data isn't just about super-sizing an Oracle or Microsoft SQL Server database. It's not just "big" data, it's "better" data.

Let the race to get there begin.

Fritz Nelson is the editorial director for InformationWeek and the Executive Producer of TechWebTV. Fritz writes about startups and established companies alike, but likes to exploit multiple forms of media into his writing.

Follow Fritz Nelson and InformationWeek on Twitter, Facebook, YouTube, LinkedIn, and Google+:

Virtualization support, memory, and bandwidth are in, our annual State of Server Technology Survey finds. Download the issue now. (Free registration required.)



Related Reading




Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

BYTE encourages readers to engage in spirited, healthy debate, including taking us to task. However, BYTE moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing/SPAM. BYTE further reserves the right to disable the profile of any commenter participating in said activities.

Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.

Follow InformationWeek

By The Numbers

What Are Your Primary Concerns About Using Big Data Software?

Base: 417 respondents at organizations using or planning to deploy data analytics, BI or statistical analysis software
Data: InformationWeek 2013 Analytics, Business Intelligence and Information Management Survey of 541 business technology professionals, October 2012

What Do You Think?

What's your attitude about SQL analysis on top of Hadoop?
We want fast, standard SQL analysis capabilities on Hadoop ASAP
Hadoop is for unstructured data; SQL is for relational databases
We'll give SQL on Hadoop a try, but relational DBs will remain the mainstay
Given strong SQL support on Hadoop, we'd nix the data warehouse
We're not interested in Hadoop
No opinion



Related Content

From Our Sponsor

Five Big Data Challenges and How to Overcome Them with Visual Analytics

Five Big Data Challenges and How to Overcome Them with Visual Analytics

Business leaders often need a visual snapshot of data to quickly grasp and use it. This paper identifies five challenges in presenting data and how visual analytics can resolve them. Solutions are suggested to overcome the challenges of: speed, data clarity, data quality, displaying meaningful results, and dealing with outliers.

Game-Changing Analytics: How IT Executives Can Use Analytics to Create Innovation and Business Success

Game-Changing Analytics: How IT Executives Can Use Analytics to Create Innovation and Business Success

Today's competitive advantage requires a deeper understanding of your business, your market and your customers. As an IT executive, you can drive that knowledge transformation. In this white paper, learn how to make decisions as a strategic business leader and three steps to begin an analytics initiative within your enterprise.

Data Visualization Techniques: From Basics to Big Data with SAS Visual Analytics

Data Visualization Techniques: From Basics to Big Data with SAS Visual Analytics

High-performance data visualization turns sophisticated analyses into meaningful graphics, leading to faster and smarter decision making. In this white paper, learn how visual analytics can transform big data, with additional features such as real-time functionality, mobile compatibility, robust applications for technical groups and accessibility for nontechnical users.

Big Data: Lessons from the Leaders

Big Data: Lessons from the Leaders

Financial performance, competitive advantage, operational efficiency, strategic decision making - every business goal can extract value from big data, and the time for doubt or inaction has long passed. In this Economist Intelligence Unit report, in-depth interviews with data pioneers reveal the link between the effective use of big data and the bottom line among other results.

Decision-Driven Data Management: A Strategy for Better Decisions with Better Data

Decision-Driven Data Management: A Strategy for Better Decisions with Better Data

Which came first, the data or the decision? This white paper makes the case for having a decision in mind, then tailoring big data's volume, variety and velocity to achieve business results such as overcoming customer dissatisfaction or creating well-informed strategies in real time.

Informationweek Reports

Research: The Big Data Management Challenge

Research: The Big Data Management Challenge

The challenge of big data is real, but most organizations don't differentiate 'big data' from traditional data, and nearly 90% of respondents to our survey use conventional databases as the primary means of handling data. We'll help you understand what constitutes big data (it's not just size) and the numerous management challenges it poses.