To those who want to regulate search engines, ban traffic-light cameras, and otherwise crack down on algorithmic decision-making and automation: Careful what you wish for.
A growing chorus of commentators is rallying against the "tyranny of the algorithm," the notion that computer-aided decision-making might create a dystopia where automated systems ruin reputations, encourage narrow-minded discourse, harvest organs without people's consent, and remove free will from the world altogether.
This argument isn't just an intellectual conceit; it underpins movements in the US to regulate search engines and ban traffic-light cameras. In Europe, efforts are underway to curtail automated decisions about individuals. Taken to the extreme, this critique suggests a wholesale rejection of algorithmic decision-making.
Imagine that 10 years from now, a new US Congress dominated by members angry about "filter bubbles" and "algorithmic overlords" decides to outlaw algorithms. Let’s see how this decision might affect an average citizen.
Bob wakes up and notices the bright mid-morning sunlight and sounds of bustling traffic outside his window. He has overslept, despite having told his iPhone's Siri app to wake him up at 7:00 a.m. From now on, he will have to remember to set his alarm manually, as his phone's apps no longer support speech recognition.
Bob, an experienced coder, lost his job when his employer eliminated its entire analytics department, so he's looking for work. He checks his email for responses to his job applications, only to spend half an hour slogging through emails from Nigerian scam artists and black-market pharmacies selling Viagra. It's a shame, he thinks, that spam filters are no more.
He heads downtown to the job center and gets stuck in traffic. The roads shouldn't be this crowded so late in the morning, but then it dawns on him: The traffic lights are no longer synchronized. Morning gridlock is now worse than ever. He considers driving into the city with one of his friends next time
Daniel Castro is a senior analyst with the Information Technology and Innovation Foundation and director of the Center for Data Innovation. Castro writes and speaks on a variety of issues related to information technology and Internet policy, including privacy, ... View Full Bio
How Enterprises Are Attacking the IT Security EnterpriseTo learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Infographic: The State of DevOps in 2017Is DevOps helping organizations reduce costs and time-to-market for software releases? What's getting in the way of DevOps adoption? Find out in this InformationWeek and Interop ITX infographic on the state of DevOps in 2017.
2017 State of IT ReportIn today's technology-driven world, "innovation" has become a basic expectation. IT leaders are tasked with making technical magic, improving customer experience, and boosting the bottom line -- yet often without any increase to the IT budget. How are organizations striking the balance between new initiatives and cost control? Download our report to learn about the biggest challenges and how savvy IT executives are overcoming them.