MemSQL, VoltDB Vie For In-Memory Big Data Role - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Data Management // Big Data Analytics
11:46 AM
Connect Directly

MemSQL, VoltDB Vie For In-Memory Big Data Role

MemSQL, VoltDB present in-memory databases as alternatives to a menagerie of "science projects" used in real-time big data apps. Is SQL simpler?
1 of 2

MemSQL presents itself as a complement to Apache Spark.
MemSQL presents itself as a complement to Apache Spark.

1 of 2
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View
User Rank: Apprentice
2/12/2015 | 5:12:21 PM
Re: Correction: VoltDB says it can replace Spark Streaming, not the entire Spark framework
Thank you Doug.

VoltDB competes with Spark streaming - especially in cases where spark streaming is used to sessionize, transform incoming streams or implement real time analytics (in the style of a Lambda speed layer).

However, VoltDB integrates with a breadth of OLAP and Hadoop tooling - including Spark. In these cases, developers use Spark to calculate OLAP style analytics against large data sets and use those outputs in VoltDB to build real time applications for personalization, fraud alerting, and streaming analytics.

For example, one VoltDB user deploys VoltDB in combination with Spark to detect online advertising bot fraud. VoltDB is performing a sessionization function - processing 100,000's of events per second into sessions -  while Spark is used to run machine learning algorithms that detect fraud. 
D. Henschen
D. Henschen,
User Rank: Author
2/12/2015 | 2:30:25 PM
Correction: VoltDB says it can replace Spark Streaming, not the entire Spark framework
I've tweaked this article to say that VoltDB specifically presents itself as an alternative to Spark Streaming (as you'll note if you follow the link I provided in the story), not the entire Apache Spark framework (the article originally said just "Spark"), which addresses multiple types of data analysis. It also says it can be complementary to Spark, but if you're rejecting Spark Streaming for use in a streaming app that you're choosing VoltDB to support, I'm not quite sure what's left for Spark to handle. I've asked the folks at VoltDB to add a comment on that nuance, so hopefully you'll see more on that here.
Get Your Enterprise Ready for 5G
Mary E. Shacklett, Mary E. Shacklett,  1/14/2020
Modern App Dev: An Enterprise Guide
Cathleen Gagne, Managing Editor, InformationWeek,  1/5/2020
9 Ways to Improve IT and Operational Efficiencies in 2020
Cynthia Harvey, Freelance Journalist, InformationWeek,  1/2/2020
White Papers
Register for InformationWeek Newsletters
Current Issue
The Cloud Gets Ready for the 20's
This IT Trend Report explores how cloud computing is being shaped for the next phase in its maturation. It will help enterprise IT decision makers and business leaders understand some of the key trends reflected emerging cloud concepts and technologies, and in enterprise cloud usage patterns. Get it today!
Flash Poll