Bad Data In, Bad Data Out - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Software // Information Management
11:53 AM
Ted Kemp
Ted Kemp

Bad Data In, Bad Data Out

Is data quality an IT issue or an organizational problem?

It's funny -- no, scratch that; it's pathetic -- how easily media types like me can get dragged into the latest big news trend. Data integration has been a hot topic in the business intelligence realm of late, mostly because of developments on the vendor side. But maybe the topic's a little hotter than it should be. Other, more fundamental business intelligence questions remain more important to the real BI practitioners out there.

I'm talking about the BI problem that won't go away: Data quality. Inaccurate, badly formatted, inappropriate, unclean, redundant or irrelevant data continues to thwart the business intelligence process in organizations of all sizes. This seemingly intractable problem is reflected in my conversations and correspondence with BI pros of every stripe.

In our current Business Intelligence Pipeline poll, we're asking whether you expect data integration or data quality to be the bigger challenge this year. Despite all the chirping coming from vendors about data integration, and the media's repetition of said chirping, Pipeline readers have so far cited data quality as their larger concern by a margin of two to one.

We're leaving the poll up on the site for another week for two reasons: 1) It's getting a big response, and 2) Its results have fluctuated more wildly over the last week than most polls do. So we're taking the time to hammer out a real consensus. Take a second to cast your vote.

Last year I asked readers to share tips, advice and wisdom with me about how they tackle the data quality issue at their organization. We got solid feedback from readers in the not-for-profit, private and public sectors. You can read a little of it here.

Now, I'm asking for more of the same. BI is becoming more central to business operations, intelligence demands from decision-makers are increasing, and turnaround times on analysis and reporting are tightening. You've gotten better at data warehousing, data integration, on-the-fly analysis and reporting. Have you gotten better at ensuring data quality? If so, how? What have you learned?

Send me an e-mail. Let me know if you'd prefer that your identity be kept anonymous, and I'll do that. Otherwise, indicate your name, position and the organization you work for.

I'm going to return to data quality issues in coming columns. Give me something to share. Is data quality an IT issue or an organizational problem? What are the fixes? Is it even possible for IT to fix the problem on its own? By pooling what we've learned, maybe everybody can benefit.

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
What Becomes of CFOs During Digital Transformation?
Joao-Pierre S. Ruth, Senior Writer,  2/4/2020
Fighting the Coronavirus with Analytics and GIS
Jessica Davis, Senior Editor, Enterprise Apps,  2/3/2020
IT Careers: 10 Job Skills in High Demand This Year
Cynthia Harvey, Freelance Journalist, InformationWeek,  2/3/2020
White Papers
Register for InformationWeek Newsletters
Current Issue
IT 2020: A Look Ahead
Are you ready for the critical changes that will occur in 2020? We've compiled editor insights from the best of our network (Dark Reading, Data Center Knowledge, InformationWeek, ITPro Today and Network Computing) to deliver to you a look at the trends, technologies, and threats that are emerging in the coming year. Download it today!
Flash Poll