FBI Shows Off Counterterrorism Database - InformationWeek
IoT
IoT
Software // Information Management
News
8/30/2006
12:27 PM
50%
50%
RELATED EVENTS
What You Need to Know about GDPR
Aug 29, 2017
GDRP is an acronym that stands for General Data Protection Regulation and it's designed to give co ...Read More>>

FBI Shows Off Counterterrorism Database

The FBI demonstrates its 659 million-record Investigative Data Warehouse and boasts about its speed.

Still smarting from the failure of its old IT systems, the Federal Bureau of Investigation Tuesday gave a public demonstration of its Investigative Data Warehouse (IDW) and bragged that the 659 million-record counterterrorism database functions well.

At a meeting in Washington, the FBI said the system had been developed by Chiliad Inc. of Amherst, Mass., whose president and CEO Paul McOwen attended the demonstration.

"It was developed over the course of many years," said McOwen in an interview Wednesday. "In a nutshell, (IDW) has an ability to analyze data, both structured and unstructured, as well as relational databases. It goes across all major platforms, across entirely separate systems."

Noting that the sensitive nature of the intelligence system keeps him from discussing many details, McOwen said the "enormously scalable" system represents a productivity improvement of 60,000 times over previous law enforcement database systems. "It scales to the size of the entire Internet," he said.

By showcasing the counterterrorism database, the FBI was trying in part to offset criticism of its Virtual Case File (VCF), which was supposed to replace aging paper files. The VCF system never worked properly and critics excoriated the FBI for wasting $170 million on it before it was scuttled.

At Tuesday's demo, FBI officials noted that the system can match and cross-link social security numbers and drivers license information and tie disparate data together -- all across hundreds of millions of records. Press reports observed that a search of 1,000 names across 50 databases, which took 32,000 hours to run on old search systems, can be performed in less than a half-hour with the Chiliad-built system.

Chiliad was organized in the late 1990s by former University of Massachusetts academics. McOwen is a former deputy chairman of the university's Computer Science Department.

Chiliad -- the name represents the cardinal number which is the product of 10 and 100 -- was partially financed by a $24 million investment by Hewlett Packard. HP owns less than 15 percent of Chiliad.

McOwen said Chiliad does business with other agencies in the "intelligence world."

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
IT Strategies to Conquer the Cloud
Chances are your organization is adopting cloud computing in one way or another -- or in multiple ways. Understanding the skills you need and how cloud affects IT operations and networking will help you adapt.
Video
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll