Graph Analytics: The Other Big Data - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Data Management // Big Data Analytics
02:23 PM
Connect Directly

Graph Analytics: The Other Big Data

Dedicated graph analytics appliance from Cray subsidiary YarcData looks for hard-to-find relationships in big data.

5 Big Wishes For Big Data Deployments
5 Big Wishes For Big Data Deployments
(click image for larger view and for slideshow)

Most big data solutions today focus on "the search problem." That's according to Arvind Parthasarathi, president of YarcData, a Cray subsidiary based in Pleasanton, Calif. "The issue is finding the right answer to a question. It's what we call 'search,' and that's what Hadoop to everything else does very effectively," said Parthasarathi in a phone interview with InformationWeek.

But there's another side to big data, one that Parthasarathi calls "discovery." "Discovery is not about finding the right answer to a question," he said. "It's about seeking the right question to ask."

Graphs, of course, are ubiquitous in government, commerce and science. They're very useful in visualizing relationships and patterns that might otherwise remain hidden in massive amounts of data. YarcData sells an enterprise-ready big data appliance called Ureka (as in, "Eureka, I've found it!"), a standalone box built for enterprises that use graph analytics to tackle discovery-related issues. The company sees a market here, as graph analysis of big data can bring commodity, x86-based hardware to its knees -- a problem that Ureka is designed to solve.

[ How do you translate huge volumes of data into useful information? Read 5 Data Sources For Visualization Beginners. ]

The technical problem involves locality of reference, an esoteric term that refers to data fields being in close proximity to each other. "Graphs have no locality of reference," Parthasarathi pointed out. "There's almost no relation between proximity and relation," he added. "Think of data as being spread out across a football field. You could be on the 50-yard line, and suddenly go all the way to the goal line to get one piece of data."

This poses a problem for today's x86 systems, which have processors that are significantly faster than memory. Ureka, by comparison, has a graph accelerator processor and a shared memory model. Its XMT technology runs 128 hardware threads on a chip. "This allows us to deal with this locality of reference issue on the graph," Parthasarathi explained. "Imagine ingesting the entire football field into memory, and then being able to travel anywhere to anywhere without a performance penalty. That's our secret sauce."

To a computer network, the Ureka appliance appears as just another Linux server, albeit one with up to 512 terabytes of memory onboard. "The good news for enterprises is that we're not trying to replace anything. Every one of our customers has Hadoop, relational data warehouses and data appliances," said Parthasarathi. "[Those traditional big data tools] are great for search," he added. "We're augmenting them for discovery."

Parthasarathi acknowledged that Ureka isn't the only solution for graph analytics. "Graphs have been around for ages, and there are lots of software approaches to graphs," he said. "But the main problem with them is that they don't scale. I can show you a really nice demo about graph analytics. But the moment I start putting in any real data -- like a normal enterprise's data -- I'm suddenly going from a response time in minutes to days."

YarcData recently announced winners of its $100,000 challenge, in which contestants demonstrated real-world uses of graph analytics to solve big data problems.

First prize ($70,000) went to Dr. Brady Bernard, Andrea Eakin, and Dr. Ilya Shmeulevich at the Seattle-based Institute for Systems Biology. Their entry researched more than 25 different types of cancers, as well as thousands of patients, to gain insight into biological networks that are disrupted or altered within a given cancer type, according to YarcData. The entry also identified potential drugs that could be repurposed to treat the given cancer.

YarcData is optimistic that Ureka will help solve other big data discovery problems as well. "We're seeing use cases in everything from cybersecurity to finding new cures for cancer, to patient treatment and personalized medicine, to new trading strategies for financial firms," said Parthasarathi.

E2 is the only event of its kind, bringing together business and technology leaders across IT, marketing, and other lines of business looking for new ways to evolve their enterprise applications strategy and transform their organizations to achieve business value. Join us June 17-19 for three days of 40+ conference sessions and workshops across eight tracks and discover the latest insights in enterprise social software, big data and analytics, mobility, cloud, SaaS and APIs, UI/UX and more. Register for E2 Conference Boston today and save $200 off Full Event Passes, $100 off Conference, or get a FREE Keynote + Expo Pass!

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Enterprise Guide to Edge Computing
Cathleen Gagne, Managing Editor, InformationWeek,  10/15/2019
Rethinking IT: Tech Investments that Drive Business Growth
Jessica Davis, Senior Editor, Enterprise Apps,  10/3/2019
IT Careers: 12 Job Skills in Demand for 2020
Cynthia Harvey, Freelance Journalist, InformationWeek,  10/1/2019
White Papers
Register for InformationWeek Newsletters
Current Issue
Getting Started With Emerging Technologies
Looking to help your enterprise IT team ease the stress of putting new/emerging technologies such as AI, machine learning and IoT to work for their organizations? There are a few ways to get off on the right foot. In this report we share some expert advice on how to approach some of these seemingly daunting tech challenges.
Flash Poll