Big Data Will Stymie Local Government - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Software // Information Management
10:18 AM
Connect Directly

Big Data Will Stymie Local Government

State and local agencies have only a fraction of the computing resources and personnel needed to handle expected data volumes, survey finds.

New York's 32-Story Data 'Fortress'
New York's 32-Story Data 'Fortress'
(click image for slideshow)
Despite the potential of big data analysis to improve governmental decision making, state and local IT pros have less than half of the computing resources and a third of the personnel they need to capitalize on the expected surge in data over the next four years.

The resulting gap and limited overall awareness about big data are among the reasons relatively few state and local agencies are taking steps to harness and analyze big data sets, according to a study by MeriTalk, a government IT networking group. The report, sponsored by NetApp, is based on a survey of 150 state and local CIOs and IT managers.

The survey found that state and local IT pros are struggling to keep up with data demands. Just 59% of state and local agencies are analyzing the data they collect and less than half are using it to make strategic decisions. State and local agencies estimate that they have just 46% of the data storage and access, 42% of the computing power, and 35% of the personnel they need to successfully leverage big data.

In addition, 57% say their enterprise architecture is not able to support big data initiatives. One in three state and local agencies has a dataset that has grown too large to work with, given their capacity limitations, the study found.

[ Can technology make your city a better place to live? Read IT Strategies For Future Cities. ]

Complicating the data management picture is confusion over who owns data: 47% of survey respondents believed that IT departments own the data, while 31% said ownership belongs to the department that generated it.

It's not that officials don't see the potential for analyzing big datasets. Survey respondents cited the ability to improve overall agency efficiency (57%), increase the speed and accuracy of decisions (54%), and achieve a greater understanding of citizen needs and how to meet them (37%) as the top advantages of tapping into big data.

But the advantages aren't universally understood or appreciated. The study found that 44% of state and local agencies aren't discussing big data; and 39% are just beginning to learn about this technology.

And while 94% of respondents said their agency can benefit from big data, 79% estimate it will be at least three years before they are able to take full advantage of it.

In a report issued last year, the National Association of State Chief Information Officers advised its members to develop an enterprise architecture and data governance policies to maximize the potential of big data in their agencies.

Urban transformation requires IT innovation. Here's how five U.S. cities are forging ahead. Also in the new, all-digital Future Cities issue of InformationWeek Government: Video surveillance provided valuable clues to the Boston Marathon bombings, serving as a lesson to other cities. (Free registration required.)

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Apprentice
4/30/2013 | 10:23:16 PM
re: Big Data Will Stymie Local Government
Crowdsource the data with your residents and see what they come up with.
John Foley
John Foley,
User Rank: Apprentice
4/30/2013 | 6:00:50 PM
re: Big Data Will Stymie Local Government
I'm not surprised that local and state government IT pros say their organizations don't have all the pieces in place to take advantage of big data. That's also true for many businesses, by the way. The key thing, as noted in the NASCIO report and recommendations, is that agencies have an IT architecture, policies, and plan in place to successfully execute big data initiatives. Ramping up system and storage capacity is the easy part.
How GIS Data Can Help Fix Vaccine Distribution
Jessica Davis, Senior Editor, Enterprise Apps,  2/17/2021
Graph-Based AI Enters the Enterprise Mainstream
James Kobielus, Tech Analyst, Consultant and Author,  2/16/2021
11 Ways DevOps Is Evolving
Lisa Morgan, Freelance Writer,  2/18/2021
White Papers
Register for InformationWeek Newsletters
Current Issue
2021 Top Enterprise IT Trends
We've identified the key trends that are poised to impact the IT landscape in 2021. Find out why they're important and how they will affect you.
Flash Poll