Big Data // Big Data Analytics
Commentary
7/8/2013
07:10 PM
Connect Directly
Twitter
RSS
E-Mail
50%
50%

Why Prism Is The Right Investment

Let's not get distracted as a nation from the real problem: our sorry state of analytics.

The Natural Language Processing libraries allow systems to do that work on a massive scale. They look for red-flag words and help decipher meaning. And before you let your sci-fi imagination run away, it's not that sophisticated. Regardless of what you saw on Person of Interest, the kind of artificial intelligence that should scare you is decades away.

Finding meaning in text (even crudely!) is important because of the unimaginable scale of data that needs to be mined. We're not talking about mountains of data. That analogy is so 1986. Today's data mountains are like turducken: mountains within mountains within mountains. Deep fried.

There's no manual exercise that will help.

And that exact data blindness is how the FBI missed the story of Zacarias Moussaoui and his flight school in the suburbs of Minneapolis. Prism might have helped.

I say "might" because technology is anything but infallible. All code is fragile and buggy. But rest assured that technology, unlike humans, lacks ill intent. It's not out to get you. A system like Prism doesn't give a rat's ass about your conversations with your mom or lover.

And even if you were talking about bombing at the local open mic night, it wouldn't be a red flag unless you also happened to be chatting it up with a known terrorist. Without the intersection of the graph and NLP, there'd be too many red flags for law enforcement to pursue.

So statistically speaking, that ridiculous secret of yours --the one that no one but you cares about but the one you don't want the government to know about -- is safe. Hallelujah.

And that brings me to my four favorite words: You are not special.

The people working at the NSA don't care about your dumb life or your stupid fetish. They didn't take government pay so they could read your banal emails or listen to your limp conversations. They care about stopping bad guys. And quickly.

If you're afraid that they'll overreach and start listening to your calls or reading your emails, get over yourself. How embarrassing for you that your narcissism is your defining quality.

As for Edward Snowden …

He's not a hero. He's an attention whore.

And he's not a technologist, or he would've figured out what Prism is really capable of.

I even question whether he was working alone. I'm not a fan of conspiracy theories, but the whole thing smells like what would happen if a group of monied interests -- the vendors who sold the systems to the government -- needed to explain why their systems weren't operating as well as they should. A leak would relieve them of any responsibility (i.e., the reason our system isn't working is because everyone knows about it).

I'll leave that scenario to be fleshed out by John Grisham. Although to be fair, Daniel Suarez would be the better choice.

Previous
2 of 3
Next
Comment  | 
Print  | 
More Insights
Comments
Threaded  |  Newest First  |  Oldest First
D. Henschen
50%
50%
D. Henschen,
User Rank: Author
7/15/2013 | 5:42:18 PM
re: Why Prism Is The Right Investment
I'm with you, Coverlet, on many people getting excessively worked up about Prism. They see only black and white in a world full of gray. I do have a different take on the underlying technology. Here's my column on NSA's Accumulo system: http://ubm.io/12jwDfh
Coverlet
50%
50%
Coverlet,
User Rank: Strategist
7/15/2013 | 8:21:28 PM
re: Why Prism Is The Right Investment
Doug- Nice piece. I obviously don't have inside information on the NSA's system. The way I describe it is how I'd architect it. The access control pieces that you mention are particularly interesting because they're the gray "safeguards" that start to build civil liberties into the analytics core.
jries921
50%
50%
jries921,
User Rank: Ninja
7/15/2013 | 5:54:44 PM
re: Why Prism Is The Right Investment
I agree in part. I agree that government needs better analytics tools and I'm definitely concerned that the feds buy closed source systems that they have to pay the original vendor to maintain for them, when they're probably the only customer (it's one thing to license a closed source word processing program; quite another to license software designed to identify terrorists). The feds would have never tolerated this 30 years ago, and probably do so now because some lobbyist was able to talk Congress into making them.

The questions that continue to disturb me are when should private businesses (or other organizations) be required to hand over records to the police or other government agencies, and what sorts of record keeping (over and above those required for internal purposes or tax assessment) should such organizations be required to perform. A requirement that phone companies hand over all of their call records on an continuing basis looks a lot to me like a general search and it probably would have seemed much the same to James Madison (the author of the Fourth Amendment). And even if we allow it, where do we draw the line between that and having every retail establishment in the country keep detailed customer records so they can be handed over to law enforcement in hopes that they can use them to build a super model to predict who is and is not a criminal?

And no, Edward Snowden doesn't strike me as being that heroic either, but like Julian Assange, it looks like he's picked his own prison.
zman58
50%
50%
zman58,
User Rank: Strategist
7/15/2013 | 5:57:41 PM
re: Why Prism Is The Right Investment
The perfect world. No moral dilemmas. Data collected and gathered for a single perfect reason in a single perfect way. All so easy and convenient for law enforcement. All good on that, but consider:

Data collected for a good cause does not always get used that way. The very information the "government" is not interested in, may be a treasure trove for another person or organization who may somehow get access to the information.

The people who collect, analyze, oversee, and store this information are only human. They can fall victim to vices, threats, collusion, temptation for illegal personal gain, just like others do. Access to data can be breached, bought, or leveraged for other purposes--it happens all the time.

Having this valuable broad data set available is a problem because it creates a liability for everyone who's data it contains--basically everyone that uses technology--all of us. There are no assurances anyone can make about the data falling into the wrong hands, or being used for immoral, criminal, or other devious behavior in the future. This is why it should not be collected, en mass, and maintained as it currently is. It is clearly wrong to do so.

So yes, dismantle it and instead work to make sure others can't collect it. Make the networks secure, not insecure. If you need to collect information on someone who is likely up to something illegal, then get a valid legal warrant, and focus on them and their information--and yes, do use the best technology for that purpose.
MarkPorter
50%
50%
MarkPorter,
User Rank: Apprentice
7/15/2013 | 6:02:44 PM
re: Why Prism Is The Right Investment
What I get worked up about is that Prism and it's ilk are done as black projects with little or no oversight. And, as we've recently learned, the definitions used to define and control the activity of these projects, get expanded, again without oversight. By all means, let's have the systems in place to collect, analyze and direct action. But this needs to be publicly acknowledged, funded and open to debate. Sure, that may impair the effectiveness of some of these activities, but, as far as I'm aware, living in a democracy brings with it similar impairments...but I, for one, am unwilling to cede that effectiveness in the name of security. And yes, easy for me to say, until the next successful terrorist strike, but, lacking this, what sort of a state have we created?
Coverlet
50%
50%
Coverlet,
User Rank: Strategist
7/15/2013 | 8:40:19 PM
re: Why Prism Is The Right Investment
Agreed Mark. There is a misguided notion that awareness of the system allows the bad actors to avoid it... so we should keep it secret. The reality is that those more sophisticated actors are what intelligence agencies call the dogs that don't bark-- they'll stay under the radar with or without awareness. Good analysis tracks them indirectly-- not by what they do themselves but by what their social network does. There is always a weak link in the (social) chain. That's the real value of an inference engine.
rman23
50%
50%
rman23,
User Rank: Apprentice
7/15/2013 | 8:23:19 PM
re: Why Prism Is The Right Investment
Talk about missing the real issue. So the only problem with our government
collecting private information on persons not suspected of a crime is that they
arenGÇÖt using the best tools? What about the 4th Amendment? Does anyone actually read history anymore? General Warrants always lead to tyranny thatGÇÖs why they added the 4th Amendment. Rationalizing that things are different now because we have more technology is just plan ignorant.
Coverlet
50%
50%
Coverlet,
User Rank: Strategist
7/15/2013 | 8:57:57 PM
re: Why Prism Is The Right Investment
That's what I forgot to do-- read history.

I'm sure that once I do, I'll understand that "general warrants always lead to tyranny." I love anything that "always" leads to tyranny. It's so neat and predictable. Doesn't need a tool.

If I do end up reading history at some point-- like when I finally turn off the internets-- let's hope that I get a better understanding of how our historical context should help refine our collective understanding of civil liberties.

It's not like the constitution was ever "amended" to account for things being different than when it was first written.
jries921
50%
50%
jries921,
User Rank: Ninja
7/15/2013 | 10:52:22 PM
re: Why Prism Is The Right Investment
My reading of history says that the Fourth Amendment, and similar prohibitions in contemporary state constitutions were enacted mostly in response to the British use of general searches to catch smugglers. If the Fourth Amendment means nothing else, then at the very least, general searches are unconstitutional on their face. If there is a valid reason to conduct general searches, then the Constitution should be amended accordingly (the real way).
walkfish55
50%
50%
walkfish55,
User Rank: Apprentice
7/15/2013 | 11:15:19 PM
re: Why Prism Is The Right Investment
In 1975 I was questioned by the FBI because I had dated someone who lived with someone who was suspected of conspiring to bomb something. No PRISM that time, just good investigative footwork. The agents were very polite and just wanted to know if I had seen the guy. But It gave me pause. The government is watching me, even though I am "irrelevant."
You can't ammend the broad concept of search and seizure without a warrant.No matter how inconvenient, it protects our liberties, and the concept is not made irrelevant by technology. So our challenge is to use the power of the turducken of data without violating what makes us a free society.
I agree that private companies with too much access to data could pose a great threat to our security.
cbabcock
50%
50%
cbabcock,
User Rank: Strategist
7/16/2013 | 12:35:26 AM
re: Why Prism Is The Right Investment
I loathe the fence builders and fear mongers, but it is inevitable that another attack is coming and our own common sense should dictate that we be vigilant. It will be hard for a vigilant system not to end up being be misused, and Coverlet probably glosses over part of that danger. But if such a system is audit-able, it will also be able to be made accountable -- more accountable than the typical government security agency. That's possibly too easy to say -- made accountable. Inevitably, humans involved will find ways of disrupting accountability. But we need to understand, up and down the ranks of society, that we are attempting to apply technology in way that guards the parapets without giving away the keys to our private homes' front doors..If enough knowledgeable people are watching, deviations from the core mission will be noted, hopefully, debated..Coverlet is on the right track. There is no completely assured answer but we must try to build such a system. Charlie Babcock, editor at large, InformationWeek
TerryB
50%
50%
TerryB,
User Rank: Ninja
7/16/2013 | 5:10:39 PM
re: Why Prism Is The Right Investment
Everyone seems to be worked up because the government owns the system. I just read a book called Exploding the Phone during a recent vacation, which explores the origin of phone hacking. Back in the 1950's and 1960's, Ma Bell (the then monopoly) was so concerned about the hacking they deployed a system they called GreenStar to attempt to catch and stop them. That system not only recorded the call information but actually recorded minutes of the phone conversation itself.
The government (FBI) was very happy to discover this during it's battle with illegal bookmaking. The bookies loved these hacking boxes which gave them free phone calls and even hid the call origin and destination. The FBI quickly got cozy with AT&T to get this information when they felt it would help them build a case.
Now it's just a much more high tech system targeting terrorists instead of phone phreaks. Interestingly, they darn near gathered up Steve Wozniak and Steve Jobs with GreenStar. Long before Apple, Wozniak was one of the early phreaks and built hacking boxes he sold to people. AT&T caught many of their customers, just never were able to trace back to those two or we may not have an Apple company today.
I'll leave to all of you to decide if what AT&T did was right or wrong. I see no difference in what NSA doing with Prism, just more outrage because it's the government doing it.
Tim
50%
50%
Tim,
User Rank: Apprentice
7/19/2013 | 11:41:03 AM
re: Why Prism Is The Right Investment
The greater the apparent separation between how government acts and what people what/hope/expect/vote for, the more such outrage is justified.
Thomas Claburn
50%
50%
Thomas Claburn,
User Rank: Author
7/16/2013 | 7:41:03 PM
re: Why Prism Is The Right Investment
Your assertion that Prism doesn't scare you would be more credible if you weren't writing under a pseudonym.

Analytics matter if you have terrorist buy-in. But I'd bet they're not giving up much these days using phones or the Internet. While intelligence agencies would benefit from better needle-in-haystack software, I would rather see investment in the development of human intelligence assets, not to mention improvements in internal security procedures.
Coverlet
50%
50%
Coverlet,
User Rank: Strategist
7/16/2013 | 10:16:25 PM
re: Why Prism Is The Right Investment
I've been writing under a pseudonym since April. And I'm certainly not doing it out of fear of the government. Given this piece's pro-Prism, pro-law-enforcement position, I'm not sure what I would have to fear. Flowers from the NSA perhaps?
pwndecaf
50%
50%
pwndecaf,
User Rank: Apprentice
7/17/2013 | 5:03:12 PM
re: Why Prism Is The Right Investment
I think you just made ThomasClaburn's point. If you were anti-Prism, would you have something to fear?
Coverlet
50%
50%
Coverlet,
User Rank: Strategist
7/17/2013 | 6:04:49 PM
re: Why Prism Is The Right Investment
There will always be bad actors -- even in law enforcement. With or without Prism, those rogues can persecute the innocent. The potential abuse of power however does not negate the need for power. It just requires checks and balances.

What's wrong with our recent discovery (as a nation) isn't that the power exists but that there might not be sufficient controls around it to address abuse. The loudest voices (always) take the extreme positions. The answer is probably a balance in the middle.

As for Tom's point, I don't think that the thousands of editorialists who have already written anti-Prism pieces need to lose sleep about NSA persecution. I wouldn't.
pwndecaf
50%
50%
pwndecaf,
User Rank: Apprentice
7/17/2013 | 8:17:05 PM
re: Why Prism Is The Right Investment
Nixon had an enemies list. What makes you think others in government don't follow that strategy? I get your point - I have spouted off on other forums about many government issues. I'm not sweating it. I just assume they are listening. So what? Nothing to be done about it.
As GW Bush would say, keep shopping! I hated him and Cheney - still do. Now Obama follows suit. I think that is why you don't want to start such things - these "rules" are impossible to take away after they have it. He just put "leaking" on a par with terrorism. Absurd.
Michael Endler
50%
50%
Michael Endler,
User Rank: Author
7/18/2013 | 4:59:25 PM
re: Why Prism Is The Right Investment
I think the "you are not special" point is valid, but that it also glosses over some of the things that make PRISM troubling. Statistically, the likelihood that the NSA is specifically targeting an InformationWeek reader is pretty low. But for the average citizen to say, "I'm not special because the government is too busy chasing bad guys" presumes that a) the government is good at differentiating good guys and bad guys, and b) that the government defines "bad" the way the rest of us do. In the current administration, maybe these assumptions are valid. But government agencies haven't always draw the right line between radical rhetoric and legitimate extremism (examples range from the targeting of Black Panthers decades ago, to whether DHS had any business monitoring Occupy protestors, to the current debate over whistle-blowing vs. national security). There's also the lack of oversight in a program like PRISM (e.g. a secret court that never says "no" isn't how most people would define "oversight"). I don't think something like PRISM is inherently wrong, per se, but even if we assume the government is only interested in "bad guys," such simple assumptions can still become messy in practice.
Tim
50%
50%
Tim,
User Rank: Apprentice
7/19/2013 | 11:43:27 AM
re: Why Prism Is The Right Investment
Did you vote for it? No? Then there is a problem.

Of course saying `I'm not special' is the ultimate naivety, right up there with ostriches and sand - it doesn't stop the fact that there will be false positives as well as false negatives.
Tim
50%
50%
Tim,
User Rank: Apprentice
7/19/2013 | 11:36:18 AM
re: Why Prism Is The Right Investment
An intriguing article, and certainly asking important questions.

The one thing I find questionable is "the craptastic tools that we hand to our police and intelligence communities.". For the most part, we don't hand them anything. I worked as a linux consultant around 2000-2002 and would dearly have loved to have slapped some people in the NHS into seeing the advantages of open-source and standards-based solutions - notably, the people being decision-makers and bureaucrats who make choices based on the mythical `bottom line' with insufficient regard to best practices. I see the police as no different in terms of interfacing IT with society. If their tools are clumsy and thuggish, it's because they've chosen them, not that we've handed them - *none* our so-called "elected representatives" are interested in living up to that moniker. Why would a secret service suddenly start believing in openness and transparency?

Much as I'd like to focus on sharpening the tools for geekish reasons, aside from getting the authorities interested, there are problems with that approach too: in the interests of avoiding bad statistics, it's impossible to build a graph of communications relationships that doesn't sniff other people's data: if you're analyzing whether T2 is a terrorist because she talks to T1 then you have to consider how many non-terrorist communicants she also has, to decide whether their communication is significant or if she's reasonably well-balanced (talks with other friends on the same network equally, and is only sharing cookie recipes with T1). And that's where the whole civil liberties thing comes in.
Coverlet
50%
50%
Coverlet,
User Rank: Strategist
7/19/2013 | 5:21:01 PM
re: Why Prism Is The Right Investment
The technology in question isn't particularly sophisticated right now. The column was meant to question the commonly-held fallacy that a system (any system) can figure out who's a terrorist. It can't. The best it can do with today's state-of-the-art is to narrow the research that a limited resource pool (intelligence or law enforcement) needs to drill down on. And yes, civil liberties come into play. And now that its in the open, we-- the architects and hackers-- should figure out how to help AND respect civil liberties.
Dr3wR1ck
50%
50%
Dr3wR1ck,
User Rank: Apprentice
7/25/2013 | 4:28:57 PM
re: Why Prism Is The Right Investment
"The people working at the NSA don't care about your dumb life or your stupid fetish. ... They care about stopping bad guys. And quickly."

The author is (willfully?) naive. This data can be used to undercut economic competition (by just enough that the preferred company gets the contract), to suppress political dissenters, and to keep undesired individuals from attaining positions of power.

Just because most of us aren't important enough to get this data used against us doesn't mean it is never used against anyone.
6 Tools to Protect Big Data
6 Tools to Protect Big Data
Most IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest, Dec. 9, 2014
Apps will make or break the tablet as a work device, but don't shortchange critical factors related to hardware, security, peripherals, and integration.
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on InformationWeek.com for the week of December 7, 2014. Be here for the show and for the incredible Friday Afternoon Conversation that runs beside the program!
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.