Government // Leadership
Commentary
2/24/2014
09:06 AM
Connect Directly
LinkedIn
RSS
E-Mail
100%
0%

Government IT: 5 Ways To Measure Value

Federal CIOs must do a better job of creating and using metrics if IT is to earn the respect it deserves as a value generator instead of a money drain.

When was the last time you were asked how IT investments contribute to your agency's mission? And what answer did you give?  Did you tout the fact that IT makes the agency more efficient or saves resources by lowering costs? Did you highlight the fact that your new social media presence and customer-facing website would increase citizen engagement and trust in your agency?

How did that person react to your answers? Was he convinced IT ought to be viewed as a strategic asset and not just a cost of doing business? Unless you were able to give him concrete measures, chances are you left him unconvinced. Sound harsh? Yes, but ask yourself: If you were considering an investment and the salesperson gave you concrete examples of its value, wouldn't you be more likely to believe the pitch?

Investments in information technology continue to rise in the public sector. In the US, federal agencies collectively spend more than $82 billion annually for maintaining, developing, and acquiring IT infrastructure. A significant proportion of those investments go toward making agencies more efficient in delivering services to the public. It is estimated that over $600 billion has been spent on IT projects over the past decade.

So why do government CIOs struggle when asked to quantify the value of IT to their agency? CIOs reluctantly confess that doing so is not only difficult but is something they have not considered seriously.

[Now's the right time to ask the uncomfortable questions. Read: Digital Business Strategy: 8 Gut-Check Questions.]

Over the last few years, my research work has allowed me to interview dozens of public-sector CIOs about their strategies for service-oriented architectures, crowdsourcing, and, most recently, big data. These federal, state, and local CIOs are working diligently to deliver value; innovate and experiment with technologies; and streamline business operations under strict budget and time constraints. Yet when asked a simple question – how do you measure the value of IT to your organization? – they often are speechless.

Unfortunately for CIOs, there are plenty of ways to measure IT waste and failure.

For instance, recent statistics released by the Government Accountability Office (GAO) concede that each year, more than $20 billion is spent on information systems and IT initiatives that never get off the ground. As much as 75% of the $600 billion federal IT budget has been spent on cost overruns and failed implementations, according to the report. Not surprisingly, in the absence of metrics on IT value, the negative statistics get more airtime and press coverage.

 Dashboard montage courtesy of Wikimedia
Dashboard montage courtesy of Wikimedia

CIOs need to focus on measuring the value of IT and devising metrics that are accessible to their internal and external stakeholders. Implementing performance indicators in the public sector is a difficult proposition. It's too easy to establish broad performance measures that have little relevance to your objectives, or rely too much on financial measures and efficiency without considering full impacts. Constantly changing performance indicators is another common problem.

The following five strategies will help you devise metrics to measure the impact of your agency's IT investments:

1. Create metrics where IT influences mission outcomes.
Prior to the introduction of a major new IT initiative, identify the mission outcomes you want to influence. These outcomes can be related to business processes, efficiencies, citizen experiences, or even employee-engagement measures. Make sure you understand the goals and the factors that influence them. Work with the key stakeholders who have influence over the business processes that affect the goals to get their perspective on how an IT investment might alter the outcome.

2. Develop metrics that measure IT project outcomes on multiple dimensions.
Despite rhetoric about creating IT performance measurements, too often IT projects are measured based on their financial outcomes. Metrics that measure IT project outcomes should focus on mission outcomes and be aligned with the strategic objectives of the organization. Put another way, each metric should be linked to the strategic priorities of the organizations in order to ensure they get the requisite attention.

3. Collect good baseline data on measures.
This is vital if you want to know what the current levels of functionality and performance is. Ensure that the baseline data collected is valid and reliable, and representative of both normal operating conditions and operations under stress. Collection of good baseline data is often overlooked by IT teams, which leaves them vulnerable to scrutiny when questions on IT value are asked.

4. Use dashboards to communicate.
Communicate metrics to stakeholders through the use of dashboards. Traditional email reports are often overlooked.  When appropriate, communicate metrics to journalists and others outside the agency who can tell your story.

5. Share your experiences building metrics and evaluation programs with other CIOs.
Share both lessons learned from things that worked and did not work. CIOs can gain from knowing what did not work.

CIOs adept in using metrics on a regular basis have learned it not only helps keep their stakeholders up-to-date on key initiatives, but also helps change the perception of IT departments as value generators instead of cost centers. Picking the right metrics and embedding them in dashboards also helps ensure they'll be more accurately used to track operational performance, make strategic decisions, and ensure that IT projects are aligned with other strategic objectives and priorities of the agency.

Finally, metrics can be used as a source of energy to ignite the morale of the IT department and keep it positive, even when most of the mainstream coverage of IT in the public sector projects might be negative. The bottom line: Make the creation of metrics a core discipline for communicating the value of your department, as well as your ongoing IT investments, to all of your stakeholders.

These five higher education CIOs are driving critical changes in an industry ripe for digital disruption. Also in the Chiefs Of The Year issue of InformationWeek: Stop bragging about your agile processes and make them better. (Free registration required.)

Dr. Kevin C. Desouza serves as the Associate Dean of Research at the College of Public Programs and is an Associate Professor in the School of Public Affairs at Arizona State University. He is also serving as the Interim Director of ASU's Decision Theater. His most ... View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Publius2014
50%
50%
Publius2014,
User Rank: Apprentice
2/27/2014 | 10:22:32 AM
5 ways to Measure value
The problems with the CIOs not being able to articulate or measure the value of IT projects in government have a few core reasons - the first is that they never take the time to understand the business of the agency, secondly they believe that for every problem there is a technology solution, and lastly and most importantly they adhere to the old garbage can theory of management - they know the solution before they even know the problem and it always has technology involved.  No CIO or leader will ever be successful if they continue that mode of operation and after a long career in the public sector I have yet to meet a CIO who does not operate in this mode.  CIOs need to work with the core business people  of the agency and collaboratively determine what problems technology can solve and what problems other types of reengineering are appropriate.
WKash
50%
50%
WKash,
User Rank: Author
2/25/2014 | 10:38:54 PM
Re: PortfolioStat
Thanks for weighing in on the IT dashboard,Kevin. I tend to agree it was designed more for the CFOs and budget regulators than for judging how well the projects actually support mission objectives.  If you see some dashboards that do a good job of that, pass them our way.  I'd like to do a series on 10 great IT dashboards that measure mission performance.

 
KevDesouza
50%
50%
KevDesouza,
User Rank: Apprentice
2/24/2014 | 9:13:33 PM
Re: PortfolioStat
Yes, I have looked at itdashboard.gov. It is a platform that promotes transparency around IT federal budgets. I do not think site does a good job of capturing 'value' metrics. Most of the metrics displayed are about IT expenditures. 
WKash
50%
50%
WKash,
User Rank: Author
2/24/2014 | 7:35:02 PM
PortfolioStat
Kevin, curious to know if you've evaluated the Federal Government's IT Dashboard, and looked into the metrics used by OMB's PortfoliStat, and what can be learned by looking at the metrics used in each.
2014 US Salary Survey: 10 Stats
2014 US Salary Survey: 10 Stats
InformationWeek surveyed 11,662 IT pros across 30 industries about their pay, benefits, job satisfaction, outsourcing, and more. Some of the results will surprise you.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest, Dec. 9, 2014
Apps will make or break the tablet as a work device, but don't shortchange critical factors related to hardware, security, peripherals, and integration.
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on InformationWeek.com for the week of December 14, 2014. Be here for the show and for the incredible Friday Afternoon Conversation that runs beside the program.
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.