Big Data. Big Decisions
 InformationWeek
Special Coverage Series


Kaggle Crowdsources The Data Scientist Problem

Why poll just one data scientist when you can tap the expertise of 65,000? See how Kaggle aims to make that easier in the latest episode of Valley View.

By Fritz Nelson InformationWeek
December 12, 2012 09:35 AM

Much has been written about the elusive data scientist, about how difficult finding highly skilled data scientists has become. Many organizations are taking creative approaches, like creating data science teams.

Informationweek.com run-of-site player, used to publish article embedded videos via DCT. The same ads will be served on this player regardless of embed location.

However, Kaggle has an even more creative approach: Crowdsource the problem to some 65,000 data scientists, using open (or closed) data-mining competitions. Kaggle has hosted 150 such competitions, some on behalf of customers like Allstate Insurance (conducted to help in predicting insurance claims), according to Kaggle's CEO Anthony Goldbloom, who was a recent guest on InformationWeek's Valley View (a live, monthly Web TV show).

You can watch Goldbloom's elevator pitch, and see what our judges thought in the video above.

, join the conversation


Related Reading

News

Commentary

Most Popular

On the Web

Slideshow

Video



Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

BYTE encourages readers to engage in spirited, healthy debate, including taking us to task. However, BYTE moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing/SPAM. BYTE further reserves the right to disable the profile of any commenter participating in said activities.

Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.

Follow InformationWeek

By The Numbers

Pie Chart: Formal Big Data Strategy

Data: InformationWeek 2012 Big Data Survey of 231 business technology professionals, December 2011

What Do You Think?

Which group is the primary user of your organization's data?
Department-level analysts
Senior business management
A wide array of business users
Dedicated business analyst group
Business users dedicated to analysis (not full time)
Others



Related Content

From Our Sponsor

Big Data: Harnessing a Game-Changing Asset

Big Data: Harnessing a Game-Changing Asset

Big data is changing the way companies of all sizes go about their business by unlocking insight. Find out what they are saying about the impact data has had on their organization in the past five years, and the future agenda.

Big Data Meets Big Data Analytics

Big Data Meets Big Data Analytics

The vision of big data is that organizations will harvest every byte of relevant data and make superior decisions. Explore how big data technologies not only support the ability to collect large amounts, but provide the ability to take advantage of its full value.

The Chief Merits of Hadoop

The Chief Merits of Hadoop

Companies founded by Hadoop contributors, provide validated software builds and enterprise support contracts for organizations that aren't comfortable with unsupported open-source software. Find out why many US Fortune 500 companies have either completed or are planning a project involving Hadoop.

High-Performance Analytics Makes the Difference

High-Performance Analytics Makes the Difference

How do you solve your biggest big data problems? If you focus on the analytic rather than a transactional basis, you need high-performance analytics. Explore what you could do differently if you drastically reduce processing times for fraud, risk, marketing and collections.

4 Recommendations to Guide Business Intelligence Purchases

4 Recommendations to Guide Business Intelligence Purchases

Next-generation BI tools blend the capabilities of top-down, metrics-driven reporting with bottom-up, ad hoc analyses seamlessly. Read this white paper to learn about 4 key recommendations that will prepare you for your next BI Purchase.

Informationweek Reports

Research: The Big Data Management Challenge

Research: The Big Data Management Challenge

The challenge of big data is real, but most organizations don't differentiate 'big data' from traditional data, and nearly 90% of respondents to our survey use conventional databases as the primary means of handling data. We'll help you understand what constitutes big data (it's not just size) and the numerous management challenges it poses.