Natural Language Query: Old Answer for 'New' BI Opportunity
As combinations of business intelligence and search technology are emerging, Progress Software is reviving a simpler approach: turning natural language queries into SQL code.
Why can't searching for answers from business intelligence systems be as simple as searching the Internet? Plenty of vendors have been trying to make it so, with leaders including Business Objects and Cognos from the BI camp and Endeca and FAST from the search camp, but it's hard to get search technology to interpret structured data. That may explain why the hit list of search-BI success stories is a short one to date.
But what if you could turn natural-language queries into good old-fashioned SQL queries? Well, that capability actually existed long before Google became a household word. In the mid 1990s, Software AG offered a product called Esperant that pioneered what's called Natural Language Query (NLQ). Microsoft also latched onto the approach, bundling a free "English Query" utility in SQL Server 2000. While these two tools seem to have drifted into obscurity, Progress Software is now reviving NLQ with EasyAsk
, a product recently repositioned to bring the ease of Internet-style search to operational BI.
The timing of this latest NLQ offering could make a big difference, says Howard Dresner, former Gartner BI analyst and now head of Dresner Advisory Services. "Natural Language Query didn't do well 15 years ago because people didn't get it," says Dresner. "The market now gets what search is all about, so it's easier for them to understand something like EasyAsk."
EasyAsk is designed to combine both the SQL query and search approaches to find relevant information. "In response to typing in a question or a description of what you're interested in, EasyAsk does two things," explains Dr. Larry Harris, vice president and general manager of Progress EasyAsk. "First, we generate an ad hoc, SQL-based query, and second, we do a search on a repository of standard reports."
The generation of SQL is guided by dictionaries that are tuned to the underlying structure of available databases, including table names, column names and the ways in which data values are represented. The repository scan is a conventional document-oriented search. Both are important, says Harris, because well-designed reports are often a better source of answers for common questions than ad hoc queries. "A structured report might include additional data that wasn't explicitly mentioned in the question but that might be useful in the analysis," he says. "Reports also offer formatting that might better highlight key results."
Until recently, EasyAsk was marketed primarily as an e-commerce tool, used by customers including HP, The Gap, Coach and Sony to power Web site searches tied to product databases rather than document repositories or collections of Web pages. Late last year the focus changed, and Progress started marketing the technology for operational BI. One of the earliest customers was Nedbank, which is the fourth largest bank in South Africa. The bank has piloted EasyAsk in a handful of applications and it's now on the verge of rolling out a major production project.
Nedbank's 60-employee Business Intelligence Solutions departments looks after a 40-terabyte data warehouse, and it regularly spins out data mart applications with Web-based GUIs that enable business users to run stored queries for data exploration. The challenge was that users were constantly coming up with new questions, but the apps are "only as flexible and as fast as a developer can move," says Derick Oliver, data warehouse delivery manager.
The Agile ArchiveWhen it comes to managing data, donít look at backup and archiving systems as burdens and cost centers. A well-designed archive can enhance data protection and restores, ease search and e-discovery efforts, and save money by intelligently moving data from expensive primary storage systems.
2014 Analytics, BI, and Information Management SurveyITís tried for years to simplify data analytics and business intelligence efforts. Have visual analysis tools and Hadoop and NoSQL databases helped? Respondents to our 2014 InformationWeek Analytics, Business Intelligence, and Information Management Survey have a mixed outlook.
InformationWeek Must Reads Oct. 21, 2014InformationWeek's new Must Reads is a compendium of our best recent coverage of digital strategy. Learn why you should learn to embrace DevOps, how to avoid roadblocks for digital projects, what the five steps to API management are, and more.