Big Data // Big Data Analytics
News
11/10/2012
00:02 AM
Connect Directly
Google+
RSS
E-Mail
50%
50%
Repost This

Big Data Meets Texas Smart Energy Grid

Ambitious big data project cuts power usage and lowers storage costs, say IBM and Oncor, Texas' largest electric distribution company.

 Big Data Talent War: 7 Ways To Win
Big Data Talent War: 7 Ways To Win
(click image for larger view and for slideshow)

IBM and Oncor, Texas' largest electric distribution company, are using big data technology to manage an intelligent power grid that will run more than 3.2 million smart electrical meters in the state by the end of the year.

The advanced metering system gives Oncor near-real-time information on billions of data measurement points, including machine-to-machine (M2M) sensors, advanced meters, and power lines. The project also provides a Web-based interface where Oncor customers can monitor their energy usage.

In a phone interview with InformationWeek, IBM director of database software and systems Bernie Spang said that Big Blue became involved with Oncor's smart grid project two years ago. "Oncor was looking to expand its early pilot program with smart meters, and to build out a smart energy solution that gives them the ability to better optimize supply and demand, and to provide information back to their customers through the Web," Spang said.

[ Related: How Big Data Can Help Utilities Avoid Blackouts. ]

When IBM came on board, Oncor was expanding its project to more than 3 million advanced meters, each of which sends information every 15 minutes to Oncor's offices -- a dramatic increase over a traditional electric meter with its monthly readings. The logistics posed a classic big-data challenge. How could Oncor process and store all of that data in a cost-effective way?

"You're talking about a nearly three thousand times increase of data transactions when you go from once a month to every 15 minutes," said Spang.

Oncor needed to upgrade from its relational database management system, which was efficient at managing modest volumes and velocities of data, but was too inefficient for the new smart grid. "Relational database management is rows and columns, and tables of data that are interconnected," said Spang. "It's not very efficient for gathering and managing smart meter and sensor data, which is time-stamped and comes in intervals," he said.

So Oncor installed IBM's Informix database software to run its smart grid. The new Informix system loaded meter data 20 times faster, and performed queries up to 30 times faster than the system it replaced, IBM claims. In addition, it reduced data storage needs by 70%, an improvement that remained linear over time and therefore allowed Oncor to accurately predict its storage requirements.

Informix is a structured data management system that uses a time-series data model rather than a conventional relational model. This results in dramatic storage savings, IBM says. "If the system is designed to think in terms of time-series data, you only have to store the new data points when the data changes," Spang said. For example, if a smart meter delivers data updates every 15 minutes, but gives the same reading for 10 hours straight, there's no reason to store the same reading 40 times. If you need to run an analysis of the data, the system is smart enough to fill in the information -- which hasn't changed over the 10-hour period -- even though it didn't store the data initially.

The smart grid market is expected to grow significantly in the next decade, up from $4.9 billion in 2011 to $43.3 billion in 2020, according to a 2011 study by IBM. By 2015, an estimated 300 million smart meters will be in use worldwide, the study says.

Obviously, the world is becoming increasingly instrumented with meters and sensors, and that's one reason why IBM is bullish on Informix's time-series data model. "The technology will become increasingly important as folks start using data that's coming from all of these instruments," Spang said.

At this hands-on Wall Street & Technology Virtual Event, Big Data On Wall Street, experts and solution providers will offer detailed insight into how risk management, financial reporting, trading analytics and financial modeling, along with a host of other opportunities, can all benefit from applying big data techniques and technologies to business processes. When you register, you will gain access to live and on-demand webcast presentations, as well as virtual booths packed with free resources. It happens Nov. 8.

Comment  | 
Print  | 
More Insights
InformationWeek Elite 100
InformationWeek Elite 100
Our data shows these innovators using digital technology in two key areas: providing better products and cutting costs. Almost half of them expect to introduce a new IT-led product this year, and 46% are using technology to make business processes more efficient.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Elite 100 - 2014
Our InformationWeek Elite 100 issue -- our 26th ranking of technology innovators -- shines a spotlight on businesses that are succeeding because of their digital strategies. We take a close at look at the top five companies in this year's ranking and the eight winners of our Business Innovation awards, and offer 20 great ideas that you can use in your company. We also provide a ranked list of our Elite 100 innovators.
Video
Slideshows
Twitter Feed
Audio Interviews
Archived Audio Interviews
GE is a leader in combining connected devices and advanced analytics in pursuit of practical goals like less downtime, lower operating costs, and higher throughput. At GIO Power & Water, CIO Jim Fowler is part of the team exploring how to apply these techniques to some of the world's essential infrastructure, from power plants to water treatment systems. Join us, and bring your questions, as we talk about what's ahead.