Data Mine This: Government Challenges Scientists - InformationWeek
Data Management // Big Data Analytics
02:10 PM
Ransomware: Latest Developments & How to Defend Against Them
Nov 01, 2017
Ransomware is one of the fastest growing types of malware, and new breeds that escalate quickly ar ...Read More>>

Data Mine This: Government Challenges Scientists

Federal standards organization NIST seeks participants for upcoming conference that will focus on search techniques for large, challenging data collections.

Government Innovators
Slideshow: Government Innovators
(clickimage for larger view and for full slideshow)
The federal technology standards organization is challenging experts to develop advanced text retrieval techniques to create better ways to find information in large digital collections of data.

The National Institute of Standards and Technology has announced the eight tracks--or task topics for data-mining research--for its 21st annual Text Retrieval Conference (TREC), which highlights the latest in data mining research.

NIST is inviting participants to submit applications for the November conference so they can begin data mining document sets related to those tracks beginning in March.

[ Read how data mining is being used to snare terrorists. See Government Developing Data Mining Tools To Fight Terrorism. ]

This year's TREC tracks are as follows:

--Contextual Suggestion, which investigates how to search information that's dependent on context and user interests; --Crowdsourcing, which looks at crowd-based methods for search evaluation and/or developing hybrid systems that leverage both automation and crowd search; --Knowledge Base Acceleration, which aims to improve the efficiency of people who maintain knowledge bases by having the system itself monitor data streams and suggest modifications or extensions; --Legal, which aims to develop search capabilities to meet the needs of attorneys searching through digital document collections; --Medical Records, which promotes research on providing content-based access to the free-text fields of electronic medical records; --Microblog, which looks at search and evaluation methods for information that seeks behaviors in microblogging environments; --Session, which aims to provide ways to query IR systems by sequence and a series of user interactions rather than for single, one-shot queries; and --Web, which looks at Internet-specific retrieval tasks for collections of up to 1 billion Web pages.

Contextual Suggestion and Knowledge Base Acceleration are two new tracks for 2012; the others carried over from the 2011 TREC conference, according to NIST.

Once NIST releases the tracks and data sets to be mined, scientists from academia as well as public and private-sector organizations will focus on improving information retrieval by developing algorithms to find information from the data collections.

Because much of the data-mining research and development is done before the conference, typically TREC attendees use the meetings to discuss their findings.

NIST's work with text retrieval is the leading experimental effort in the field, and it's proven to have a positive effect on current methods for retrieving digital data, according to the organization.

NIST recently had an economic impact study (PDF) prepared that found improvements related to TREC are responsible for about one-third of the Web-search advances between 1999 and 2009. Moreover, these improvements might have saved up to 3 billion hours of time searching on the Web, according to NIST.

Data mining is of particular interest for the federal government, particularly among intelligence agencies that are seeking new ways to identify clues in data for counter-terrorism and other activities.

The National Counterterrorism Center and the Intelligence Advanced Research Projects Agency are among federal organizations that have projects in the works to develop new data-mining software and other technology to search for information in intelligence-related data sets.

NIST is accepting applications for TREC 2012 through Feb. 22.

InformationWeek is conducting our third annual State of Enterprise Storage survey on data management technologies and strategies. Upon completion, you will be eligible to enter a drawing to receive an Apple 32-GB iPod Touch. Take our Enterprise Storage Survey now. Survey ends Jan. 13.

Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
2017 State of IT Report
In today's technology-driven world, "innovation" has become a basic expectation. IT leaders are tasked with making technical magic, improving customer experience, and boosting the bottom line -- yet often without any increase to the IT budget. How are organizations striking the balance between new initiatives and cost control? Download our report to learn about the biggest challenges and how savvy IT executives are overcoming them.
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll