IoT
IoT
Data Management // Big Data Analytics
News
12/15/2014
09:06 AM
Connect Directly
Google+
RSS
E-Mail
100%
0%

Big Data Tool Analyzes Intentions: Cool Or Creepy?

Lexalytics intention analysis tool determines what you're going to do before you do it, the company says. This goes beyond sentiment analysis.

 Holiday Gift Guide 2015: What Techies Want
Holiday Gift Guide 2015: What Techies Want
(Click image for larger view and slideshow.)

Many organizations mine Twitter and other social media streams to gauge the online masses' impressions of their products or services. But although this sentiment analysis is an effective way to mine for opinions, it's less useful at determining people's future actions.

Lexalytics, an Amherst, Mass., provider of text and sentiment analysis software, will soon release a new feature called intention analysis, which the company claims can predict a person's objectives based on his or her online activities.

"If you can take a content stream -- customer feedback data, for example, or chat logs from a website -- you can mine that [data] for intention, not just sentiment," said Lexalytics founder and CEO Jeff Catlin in a phone interview with InformationWeek.

Lexalytics' claim to fame is sentiment analysis, which the company has been doing for a decade. An impressive roster of tech players license the company's technology, including Oracle and Microsoft, the latter of which uses Lexalytics' software to monitor social media feeds. 

[Want a year-end review of big data's accomplishments? Read Top 5 Big Data Trends Of 2014.]

At first glance, intention analysis might seem a lot like sentiment analysis. But Catlin explained the distinction between the two:

"Take a simple statement like, 'I'm gonna buy a new iPhone from Verizon,'" he said. "If you look at that from a sentiment point of view, there isn't any. There's no actual tone in that. You could argue that buying a new phone is good news, but you're putting an interpretation on it."

The person, however, is stating an intention to buy something: in this case, an iPhone.

(Image: Latin Times)
(Image: Latin Times)

Catlin explained via email how intention analysis software would deconstruct the following tweet: "I've been saving like crazy for Black Friday. iPhone 6 here I come!"

"There are no words like 'buy' or 'purchase' in this tweet, even though their intention is to purchase an iPhone," wrote Catlin. Here's how an intention analysis tool would tag the tweet:

- intention = "buy"

- intended object = "iPhone"

- intendee = "I"

Grammar-parsing technology is the engine that makes intention analysis work.

"Intention is kind of the sexy feature, but the grammar parser is the key that makes it go, the ability to understand what people are talking about, regardless of content type," said Catlin. "We've built a grammar-parser for Twitter, which deals with the fact that there's bad punctuation, weird capitalization, and things like that."

Companies can run this type of analysis on millions of tweets in seconds, which could help them determine customers' buying patterns, Catlin added.

Law enforcement is another potential market.

"If you're the government and worried about terrorism, you can mine Twitter streams and look for harm," said Catlin. "Is there an intention to do harm here? That's a really interesting [example]. I consider it scary, but also very interesting."

Lexalytics plans to add intention analysis to Semantria, its Saas offering, as a premium service. Catlin acknowledged that Internet giants such as Google and Facebook could pose problem competition if they build intention analysis tools in-house.

"We haven't seen Google build it yet. Could they? Sure. But even for them, it would take a certain amount of time to build some of this," he said.  

"Time-to-market matters," added Catlin. "Some cellphone vendors have talked to us and have looked at the features. They could build it themselves if they were interested, but [they] generally pick time-to-market over building it" in-house.

When asked whether intention analysis might provide companies with more opportunities to hurl unwanted sales pitches at social media users, Catlin noted that it's up to Lexalytics' clients to use the technology in a responsible fashion. 

"We're the low-level provider, and it's up to our customers to make those decisions," he said, adding that companies shouldn't "spam people based on their intention."

Just 30% of respondents to our new Big Data and Analytics Survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives? Get the The Trouble With Big Data issue of InformationWeek Tech Digest today. (Free registration required.)

Jeff Bertolucci is a technology journalist in Los Angeles who writes mostly for Kiplinger's Personal Finance, The Saturday Evening Post, and InformationWeek. View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
pfretty
50%
50%
pfretty,
User Rank: Ninja
1/6/2015 | 2:12:03 PM
A little of both
How we feel about this really depends heavily on our relationship with the organization ultimately using the resulting analysis. Obviously, as data analysis gets smarter and more personal it presents us with numerous advantages -- many of which are time savers and help improve our productivity.  However, when we do not have a good relationship with a group tracking and leveraging personal data, it can be alarming.  Bottom line: We need to be more data aware as a society. 

Peter Fretty, IDG blogger working on behalf of SAS
asksqn
50%
50%
asksqn,
User Rank: Ninja
12/28/2014 | 7:29:03 PM
A lot of false positives in Lexalytics future
>>"If you can take a content stream -- customer feedback data, for example, or chat logs from a website -- you can mine that [data] for intention, not just sentiment, [...]" <<

 

Also known as surveillance without a warrant.  Further, just because I may provide consumer feedback does not necessarily mean I either hate or love the product.  It is feedback.  Period.  
Thomas Claburn
50%
50%
Thomas Claburn,
User Rank: Author
12/15/2014 | 4:57:38 PM
Re: Creepy
If the predictions prove accurate, the first thing people will do is modify their behavior to mess with the predictions.
soozyg
50%
50%
soozyg,
User Rank: Ninja
12/15/2014 | 3:08:13 PM
can't judge future actions
But although this sentimental analysis is an effective way to mine for opinions, it's less useful at determining people's future actions.

Yes, my finances friend always tells me, "Prior acts are no indication of future acts."
soozyg
50%
50%
soozyg,
User Rank: Ninja
12/15/2014 | 3:05:46 PM
Re: Creepy
Some people think that marketing--or any entity--that uses a tracking tool is considered Big Brother-y. I just assume I'm being tracked. I see the benefits of my data being analyzed so I've kind of given up the fight.....
Laurianne
50%
50%
Laurianne,
User Rank: Author
12/15/2014 | 12:53:42 PM
Creepy
Marketers using this tool is  one thing, but law enforcement using it definitely screams Big Brother. Of course, anything you post publicly on Twitter is already fair game for whatever AI the government has to point at the opportunity. What do you think, readers?
6 Tools to Protect Big Data
6 Tools to Protect Big Data
Most IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Register for InformationWeek Newsletters
White Papers
Current Issue
Top IT Trends to Watch in Financial Services
IT pros at banks, investment houses, insurance companies, and other financial services organizations are focused on a range of issues, from peer-to-peer lending to cybersecurity to performance, agility, and compliance. It all matters.
Video
Slideshows
Twitter Feed
InformationWeek Radio
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.