Publications

Taking Spying to Higher Level, Agencies Look for More Ways to Mine Data

By JOHN MARKOFF, The New York Times, February 25, 2006

Intelligence agencies, hardly newcomers to data mining, are using new technologies to take the practice to another level.

PALO ALTO, Calif., Feb. 23 — A small group of National Security Agency officials slipped into Silicon Valley on one of the agency's periodic technology shopping expeditions this month.

On the wish list, according to several venture capitalists who met with the officials, were an array of technologies that underlie the fierce debate over the Bush administration's anti-terrorist eavesdropping program: computerized systems that reveal connections between seemingly innocuous and unrelated pieces of information.

The tools they were looking for are new, but their application would fall under the well-established practice of data mining: using mathematical and statistical techniques to scan for hidden relationships in streams of digital data or large databases.

Here is the rest of the story.