Supercomputers Unleash Big Data's Power - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
IT Life
News
6/24/2015
07:06 AM
Lisa Morgan
Lisa Morgan
Slideshows
Connect Directly
Twitter
RSS
E-Mail

Supercomputers Unleash Big Data's Power

Here are six reasons why established companies, and even startups, are using supercomputing resources, and why your IT organization may want to consider such options to meet your big data and business analytics needs.
2 of 7

The Dataset Fits Into Memory 
If a dataset is terascale or you're combining multiple terascale datasets, the data may too large to fit into memory. One way to deal with it is to break it down into smaller pieces and analyze the pieces individually. While it's possible to do many kinds of analysis on the fragments of data, more types of analysis can be done when all of the data is available in memory and the analyses can be executed faster. It is also possible to ask more types of questions, expand the scope of discovery, and do more correlations.
'If I want the right answer to a question, bringing in all the needed data, bringing it in fully, being able to query it fully, best enables me to come to the right conclusions,' said JICS director Tony Mezzacappa in an interview.
One example is identifying fraudulent healthcare claims, which involves massive amounts of data. By bringing all the data into memory, it's possible to discover patterns that are not apparent if the claims are viewed in isolation, according to Ken Gilbert, director of Business Analytics at the University of Tennessee office of research and economic development, in an interview.
(Image: OpenIcons via Pixabay)

The Dataset Fits Into Memory

If a dataset is terascale or you're combining multiple terascale datasets, the data may too large to fit into memory. One way to deal with it is to break it down into smaller pieces and analyze the pieces individually. While it's possible to do many kinds of analysis on the fragments of data, more types of analysis can be done when all of the data is available in memory and the analyses can be executed faster. It is also possible to ask more types of questions, expand the scope of discovery, and do more correlations.

"If I want the right answer to a question, bringing in all the needed data, bringing it in fully, being able to query it fully, best enables me to come to the right conclusions," said JICS director Tony Mezzacappa in an interview.

One example is identifying fraudulent healthcare claims, which involves massive amounts of data. By bringing all the data into memory, it's possible to discover patterns that are not apparent if the claims are viewed in isolation, according to Ken Gilbert, director of Business Analytics at the University of Tennessee office of research and economic development, in an interview.

(Image: OpenIcons via Pixabay)

2 of 7
Comment  | 
Print  | 
Comments
Newest First  |  Oldest First  |  Threaded View
LisaMorgan
50%
50%
LisaMorgan,
User Rank: Moderator
6/29/2015 | 7:10:40 PM
Re: Is that you, False-Positive?
Your point about false positives is well-taken.  Insurance companies often reject claims as a matter of course because it's in their best interest to do so.  A long, arduous process causes many claimants to settle for less than they might recover because they just can't weather the battle.  Knowing that, some claimants hire law firms hoping to to recover more than they would on their own, which works or doesn't depending on a number of factors.
asksqn
50%
50%
asksqn,
User Rank: Ninja
6/29/2015 | 5:50:41 PM
Is that you, False-Positive?
<excerpt>

 

One example is identifying fraudulent healthcare claims, which involves massive amounts of data. By bringing all the data into memory, it's possible to discover patterns that are not apparent if the claims are viewed in isolation[...]

 

LOL I smell job security for decades for plaintiff law firms bringing suit against skinflint ins. cos. denying legitimate claims because it spent millions on software and didn't take into consideration the cost of false-positive results and the ensuing litigation.

Slideshows
Data Science: How the Pandemic Has Affected 10 Popular Jobs
Cynthia Harvey, Freelance Journalist, InformationWeek,  9/9/2020
Commentary
The Growing Security Priority for DevOps and Cloud Migration
Joao-Pierre S. Ruth, Senior Writer,  9/3/2020
Commentary
Dark Side of AI: How to Make Artificial Intelligence Trustworthy
Guest Commentary, Guest Commentary,  9/15/2020
White Papers
Register for InformationWeek Newsletters
2020 State of DevOps Report
2020 State of DevOps Report
Download this report today to learn more about the key tools and technologies being utilized, and how organizations deal with the cultural and process changes that DevOps brings. The report also examines the barriers organizations face, as well as the rewards from DevOps including faster application delivery, higher quality products, and quicker recovery from errors in production.
Video
Current Issue
IT Automation Transforms Network Management
In this special report we will examine the layers of automation and orchestration in IT operations, and how they can provide high availability and greater scale for modern applications and business demands.
Slideshows
Flash Poll