Trump's Election: Poll Failures Hold Data Lessons For IT - InformationWeek
IoT
IoT
Data Management // Big Data Analytics
News
11/11/2016
11:06 AM
Connect Directly
Twitter
RSS
E-Mail
50%
50%
RELATED EVENTS
Ransomware: Latest Developments & How to Defend Against Them
Nov 01, 2017
Ransomware is one of the fastest growing types of malware, and new breeds that escalate quickly ar ...Read More>>

Trump's Election: Poll Failures Hold Data Lessons For IT

Are your data analytics predictions models suffering from the same problems as the models that predicted Hillary Clinton would easily win the US Presidential election? Here are a few things to consider.

8 Ways To Ensure Data Quality
8 Ways To Ensure Data Quality
(Click image for larger view and slideshow.)

How good is the data we rely on in our lives and businesses? After hundreds of polls were conducted and analyzed to predict who would win the US presidential election, the data scientists, statisticians, and media outlets that analyzed those polls failed to predict that Donald Trump would win against Hillary Clinton on Election Day. It was a shocker to many.

That brings up an important question for IT organizations that are investing in data and tools to analyze it. How good is that data? How good are those insights? Can we trust them? How can we make our predictive models more accurate? What lessons can we learn from the polling data issues that can be applied to our own organizations' data efforts?

[What did FiveThirtyEight's Nate Silver say about the presidential election a year ago? Read Nate Silver Predicts 2016 Presidential Race at Salesforce World Tour.]

The first thing to do is ensure the quality of the data.

"Polls are just like any other analytical model," said Bennett Borden, chief data scientist at the law firm Drinker Biddle & Reath, in an interview with InformationWeek. You have to ask, "Where are you getting your data from? Clearly there was a whole swath of the population that we did not reach in this polling data."

(Image: Joseph Sohm/iStockphoto)

(Image: Joseph Sohm/iStockphoto)

Borden followed election polling on the FiveThirtyEight media site headed up by Nate Silver, who won fame for correctly predicting the 2008 election. The trained statistician subsequently released a bestselling book, The Signal and The Noise: Why So Many Predictions Fail but Some Don't.

Silver's site was the most pessimistic about a Clinton win, but it still had her as the favorite in the election based on internally created models that incorporated voter polls. Clinton's lead was small enough to be a polling error.

Borden said that the other problem that can happen with polling data is that people don't always provide answers that reflect their true opinions. He said that that was a concern he'd heard expressed recently in a presentation by Chicago Mayor Rahm Emmanuel who had said his biggest fear about the polling data was that there were people who were afraid to admit in the polls that they were going to vote for Trump. That's something that has been cited in other coverage, too.

"It's like the Nielsen ratings. When people would write down what shows they watched, they always ended up watching documentaries on PBS, when in reality they were watching the Simpsons," Borden said.

That kind of embellished reality from respondents makes collecting accurate data more difficult when doing polls.

"It shows when you are gathering data to build your models on, you have to make sure the data is accurate," Borden said. "We think analytics are some kind of magic. Overreliance on analytics without understanding their limitations is where we see some of the issues coming in."

A recent survey by consulting firm KPMG recently found that while organizations are investing in data and analytics, they don't always place a high degree of trust in the results.

The firm's UK director of global data and analytics, Nadia Zahawi, told InformationWeek in an interview recently that these analytics efforts often reside in a "black box." Data goes in, insights come out, and stakeholders never see what happens inside.  

KPMG's report said other drivers, too, contribute to mistrust. For instance, decision-makers may be suspicious of the motives or abilities of internal or external expertise. Or they may subconsciously feel that their successful past decisions justify continued use of old sources of data and insight, leading to what KPMG says is a form of cognitive bias.

Drinker Biddle & Reath's Borden notes that algorithms that replace these insights can sometimes end up encoding the cultural biases and confirmation bias that organizations are trying to fix.

For instance, if machine-learning training data looks at all the successful managers in an organization's history to reveal insights about a profile for those managers, the resulting algorithm to find those managers will likely identify white men as the best candidates, because they are the people who enjoyed management success in the past.

It's a danger for future development efforts, and society has not yet really begun to address the governance and regulatory challenges posed by this danger, Borden said.

Jessica Davis has spent a career covering the intersection of business and technology at titles including IDG's Infoworld, Ziff Davis Enterprise's eWeek and Channel Insider, and Penton Technology's MSPmentor. She's passionate about the practical use of business intelligence, ... View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
greenhows
50%
50%
greenhows,
User Rank: Strategist
11/17/2016 | 11:21:13 AM
polls?
Other than material for news agencies to push, (mostly in an effort to skew public opinion), why do we care about polls? I for one, didn't care a lick about what the polls showed. I, probably like most people, knew who i was going to vote for. This whole line of news stories about the polls being wrong is like being upset the that the horroscopes not accurately telling what was going to happen in my life. We all have more important things to care about...
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
2017 State of IT Report
In today's technology-driven world, "innovation" has become a basic expectation. IT leaders are tasked with making technical magic, improving customer experience, and boosting the bottom line -- yet often without any increase to the IT budget. How are organizations striking the balance between new initiatives and cost control? Download our report to learn about the biggest challenges and how savvy IT executives are overcoming them.
Video
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll