Under Powerset's hood is decades-in-the-making natural-language processing technology the company licensed from the Palo Alto Research Center, formerly of Xerox.
Microsoft's proving that it has plenty of ways of spending the $40-plus billion that Yahoo turned down earlier this year, announcing Tuesday that it would buy search startup Powerset for an undisclosed sum.
Powerset brings Microsoft a new line of attack against Google, and one that doesn't rely on quickly gained economies of scale like an acquisition of Yahoo would. Instead, Powerset brings new technology to Microsoft: semantic search.
Semantic or natural-language search relies on sentence structure, syntax, dictionaries, and thesauri to extract meaning from text, rather than relying on how heavily Web pages are linked to one another to determine the relevance of search results. Under Powerset's hood is decades-in-the-making natural-language processing technology the company licensed from the Palo Alto Research Center, formerly of Xerox.
"Powerset set out with a really ambitious vision to bring about the future of search through machines that could understand language," Powerset co-founder and CTO Barney Pell said in an interview. "One of the questions is, how is a company that's a small little startup like Powerset actually going to bring that out to a large scale? With Microsoft, we've found the right partner. The vision, the goals, and even the culture were really aligned."
Though today's Web search companies employ linguists and can distinguish between singular and plural words, correct some misspellings, and find some synonyms, they're nothing like search engines designed from the ground up with contextual meaning in mind. Powerset competes with Hakia, Cognition Technologies, and several others.
Microsoft estimates that one-third of all searches don't get answered immediately, often because the search engine can't pull meaning out of queries. "To go to the next level on search, we can't treat search as matching keywords and queries," Ramez Naam, group program manager for Microsoft Live Search, said in an interview. "We have to go into understanding intent, meaning, and context in the queries so we can do matching and ranking at that level."
For Powerset's startup competitors, Microsoft's acquisition will likely be seen both as a validation and a warning shot. On the one hand, there's the view of Melek Pulatkonak, Hakia's chief operating officer. "This is definitely a confirmation and a vote of confidence that semantic search is here," she said in an interview. However, if Microsoft's acquisition is the beginning of a chain reaction, winners may be determined more by who gets acquired than by who has the best technology.
Google, for one, isn't saying much. "Search is a highly competitive industry and we welcome competition that stimulates innovation and provides users with more choice," the company said in a generic-sounding statement Tuesday afternoon.
6 Tools to Protect Big DataMost IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Big Data Brings Big Security ProblemsWhy should big data be more difficult to secure? In a word, variety. But the business won’t wait to use it to predict customer behavior, find correlations across disparate data sources, predict fraud or financial risk, and more.
Join us for a roundup of the top stories on InformationWeek.com for the week of December 14, 2014. Be here for the show and for the incredible Friday Afternoon Conversation that runs beside the program.