Onsite: iBasis Moves to Appliance-Based Warehousing - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Software // Information Management
07:10 PM
Connect Directly

Onsite: iBasis Moves to Appliance-Based Warehousing

Voice-over-IP telco iBasis solved its data warehousing problems by moving from conventional tools to a Netezza device and Sunopsis Software.

iBasis, Burlington, Mass. Growth is a good thing for business, but when it's fast-and-furious growth, as it has been for voice-over-IP (VoIP) network service provider iBasis, it can wreak havoc with the best-laid IT plans. A wholesale provider of international calling services, iBasis carried more than 9 billion minutes of voice traffic last year, but with the VoIP market growing like kudzu, the company's call volumes, and therefore data analysis needs, have been growing 40 percent to 50 percent per year.

A middleman that makes international VoIP call connections between major network providers through the Internet, iBasis is in a high-volume, low-margin business that changes by the minute. "We have lots of decisions to make about network capacity and utilization on a rapid-fire basis," says Paul Floyd, senior vice president of R&D, engineering and operations. "We also need to do analysis of our pricing relative to the cost of providing services."

The problem was that the company's three-and-a-half-year-old data warehouse, built on EMC, Oracle and Sun Microsystems infrastructure, couldn't keep up. It was taking between 18 and 24 hours to load and analyze the data and deliver reports on revenue, margins, network traffic and quality. Thus, managers in finance, billing, operations and sales couldn't make decisions reflecting the latest conditions and demands.

How could a comparatively new data warehouse get so bogged down? "I'm sure it was the perfect solution when it was first implemented, but we're now handling between 140 million and 150 million transactions per day, so our growth rate led our old technology to become slower and slower," says Mark Saponar, vice president of information systems.

When iBasis decided to replace its entire warehousing architecture, it looked into the emerging market of data warehousing appliances, devices that combine hardware, database software and storage in a low-cost package optimized for rapid query and retrieval. These appliances, from vendors such as Netezza and Datallegro, were initially targeted at specialized departmental and large data-mart applications, but as computing horsepower, storage capacities and integration flexibility have grown, the devices now sometimes serve as enterprise data warehouses--particularly when limited sets of analyses are confined to well-defined subject areas.

IBasis selected Netezza's Performance Server model NPS8250 appliance late last year, and added Sunopsis DataConductor software as the ETL solution. Sunopsis actually describes DataConductor as "ELT" software because it extracts and loads data directly to data warehouses. With this bulk approach, Sunopsis says, transformations and updates are handled much more quickly than in the conventional, row-by-row approach in an ETL server.

Deployed in just 12 weeks between January and March, the Netezza-Sunopsis combo has improved performance dramatically. "We are now pushing the transactions into the data warehouse in less than an hour," Saponar says. "The benefits are really the combination of speed of transfer of the information [the ETL process] as well as the very fast [Netezza] appliance for retrieval."

Speed of analysis can have a huge impact on profitability. "If I can get a current view of my margin that's up-to-the-second, it can completely change our view of the network and which provider we're using," Saponar says. Speed is also crucial in monitoring call data reports that spot quality problems. Those reports aggregate an enormous amount of data, but what previously took "several hours to several days" is now "a matter of seconds."

Current sources of data include an Oracle 10g database and flat files, but iBasis plans to use DataConductor to natively connect call billing systems and network monitoring equipment directly to the data warehouse.

"Sunopsis offered both a seamless integration with Netezza as well as the ability to work both in real time and in a batch transaction mode," Saponar says.

While data warehouse appliances such as Netezza's are most often used for data marts under 10 TB, "a few users have deployed enterprise data warehouses on appliances," according to TDWI's Philip Russom, an expert and author of the white paper "Defining the Data Warehouse Appliance." Russom says appliance applications are moving into the 20-TB range.

Where iBasis previously had a 6-TB Oracle database with 2.5 TB of queryable data (plus overhead), it now has a 9-TB Netezza appliance with 4.5 TB of queryable data (or about 8 billion records). The current configuration should meet iBasis's needs for three years given current growth projections, says Saponar. But what happens if the company once again blows by its growth projections?

"We looked at the upgrade path with Netezza, and it's very straightforward," he says. "We can upgrade to a 22-TB device within 24 hours, and it's all done in parallel with current processes."

The transition between data warehouses had no impact on the company's BusinessObjects BI platform, according to Saponar, and given the fast-paced deployment, Saponar says he was relieved: "Usually these types of projects are very painful, but in this case it was pretty straightforward."

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
1 of 2
Comment  | 
Print  | 
More Insights
InformationWeek Is Getting an Upgrade!

Find out more about our plans to improve the look, functionality, and performance of the InformationWeek site in the coming months.

Remote Work Tops SF, NYC for Most High-Paying Job Openings
Jessica Davis, Senior Editor, Enterprise Apps,  7/20/2021
Blockchain Gets Real Across Industries
Lisa Morgan, Freelance Writer,  7/22/2021
Seeking a Competitive Edge vs. Chasing Savings in the Cloud
Joao-Pierre S. Ruth, Senior Writer,  7/19/2021
White Papers
Register for InformationWeek Newsletters
Current Issue
Monitoring Critical Cloud Workloads Report
In this report, our experts will discuss how to advance your ability to monitor critical workloads as they move about the various cloud platforms in your company.
Flash Poll