DHS Chief Wants Better Algorithms For Analyzing Intelligence Data

coondoggie writes "Better algorithms to spot patterns and trends within the mass of information the Department of Homeland Security sees everyday are key to national security. That was but one of the talking points DHS chief Janet Napolitano focused on in a lecture on the role of science and technology at the Massachusetts Institute of Technology today. 'DHS is part of the nation's Intelligence Community, which receives more terabytes of data each day than the entire text holdings of the Library of Congress. The National Counterterrorism Center's 24-hour Operations Center receives 8,000 to 10,000 pieces of counterterrorist information every day. We receive data about all of this, and it is clearly too much to suggest that the simplistic "connect the dots" analogy accurately represents what an analyst must do. Very quickly, you can see that "Big Data" – more so than the lack of data – becomes the most pressing problem. At the same time, the threats implicated by the data are not static.'"

better agorithms

[theheadlessrabbit]

Well, if the DHS Chief wants better algorithms for analyzing intelligence data, maybe he can have the department's funding cut, so more money can be put to use educating a generation of better students.

Here's an idea for you DHS geniuses

[GodfatherofSoul]

Step One: cut down on the clutter. That means stop chasing after everyone in a turban or every angry blogger named Mohamed or Assad who criticizes your government or sticking GPS monitoring devices under their cars.

There are two major reasons we've historically said NO to dragnets. They violate civil rights and they...surprise surprise!...clutter your intelligence channels with worthless drivel.

Too much funding, not enough results

[Darkness404]

The DHS has far too much funding if they have too much data and can't analyze it with current algorithms. And really, why do they need all this data in the first place? Chances are the vast majority of it is unconstitutional and shouldn't be collected to begin with.

Re:Yeah right

[rtb61]

That points to the heart of the matter. Incompetent political appointees want computers to do their job for them so that they can take the credit.

Better algorithms to sort filter and collate the data, how stupid can they be. The bigger and more complex the database the easier it is to poison it with false data. Once that false data is in, it make all sorts of false connections, and more false connections based upon those.

Intelligence services do no need better algorithms, they need to dump contractors who make a living out of creating false data, they need to get rid of political appointees and most of all they need to quality manage data entering the system.

The insanity of working from the basis that everyone is guilty and, stupidly thinking that somehow computers will sort that planet full of evidence you have created with the idiot's assumption that everyone is guilty, well, it just really points to what kind of fuck up the DHS chief is as well as the DHS itself.