Got a tip for Noah?
SEND IT!
(Guaranteed Confidential)
Subscribe

Subscribe via RSS

Archives by Date
February 2007
January 2007
December 2006

See all Archives
Archives by Category
'Canes
Ammo and Munitions
Armor
Axe in Iraq (and Elsewhere)
Bizarro
Blimps
Blog Bidness
Bomb Squad
Cammo Green
Chem-Bio
Cloak and Dagger
Comms
Cops and Robbers
Data Diving
Dissent Tech
Drones
Eat My Dust
Eye on China
FCS Watch
FOS Files
Gadgets and Gear
Ground Vehicles
Guns
Homeland Security
Info War
Iraq Diary
Lasers and Ray Guns
Less-lethal
Logistics
Los Alamos and Labs
Medic!
Mercs
Missiles
Money Money Money
Net-Centric
Nukes
Planes, Copters, Blimps
Politricks
Rapid Fire
Raptor Watch
Red Team
Retro-Futuro
Roll Your Own
Sabra Tech
Ships and Subs
Space
Strategery
Terror Tech
The Deadlies
Those Nutty Norks
Training and Sims
War Update
You can run...

See all Archives
Related Links
News and Intel
Military.com News
Aviation Week
Natl Defense Mag
Strategy Page
Global Security Newswire
Soldiers for the Truth
Security News
Defense Review
Fed Comp Week

Security Sources
GlobalSecurity.Org
Fed Am Sci
CSIS
Ctr for Defense Info
Defense & Natl Interest
Instit for Sci & Intl Secy
Secrecy News
POGO
Cryptome
The Memory Hole
Natl Security Archive

Geeks and Mad Scientists
Slashdot
Wired News
Security Focus
The Register
Gizmodo
Geek Press
Robots.Net
Cosmic Log
Space Daily
New Scientist
TechCentralStation
Engadget
Space.Com
Technology Review
Gyre
Near Near Future
Fed Dev Blog

Bloggers and Buddies
Phil Carter
Global Guerillas
Jeffrey Lewis
Milblogging
OPFOR
Laura Rozen
Larisa Alexandrovna
Juan Cole
Ryan Singel
Josh Marshall
Cursor
Boing Boing
InstaPundit
Winds of Change
Tapped
TalkLeft
Brad DeLong
Mountain Runner
Gene Healy
Clive Thompson
Greg Djerejian
Jeff Quinton
Workbench
Electrolite
Jim Henley
War in Context
Kathryn Cramer
Wash Park Prophet
Blogs of War
Tom Shachtman

Official Dispatches
DARPA
AF Research Lab
Marine War Lab
Soldier Systems Ctr
Naval Research
Army Research Lab
UK Def Sci Lab
NASA News
DoJ Cybercrime

Military Network
Military Benefits
Veteran Employment
GI Bill Express
Personnel Locator
Free ASVAB
The Few
Fred's Place
Army Insider
Navy Insider
Air Force Insider
Marine Corps Insider
Coast Guard Insider



Edited by Noah Shachtman | Contact

"TIA" Techniques in NSA Sweeps

It's not just about who calls who. The NSA phone-monitoring project looks at how terrorists place their calls – and then applies that model to everyone, to see who else might be a suspect. It's a form of predictive data mining made famous by the notorious Total Information Awareness project.

step_2.gif"Armed with details of billions of telephone calls, the National Security Agency used phone records linked to the Sept. 11, 2001, attacks to create a template of how phone activity among terrorists looks," according to USA Today. "The template, officials say, was created from a secret database of phone call records collected by the spy agency. It has been used since 9/11 to identify calling patterns that indicate possible terrorist activity. Among the patterns examined: flurries of calls to U.S. numbers placed immediately after the domestic caller received a call from Pakistan or Afghanistan."

That's new. When the NSA's phone-monitoring programs came to light – first in December, then again two weeks ago – the projects were said to focus on "social network analysis." Who knows who, in other words. If Osama calls your friend, and he turns around and calls you, the logic goes, you and Osama and probably linked in a common plot. If you don't share anyone in common, you're in the clear.

But, for prominent social network analysts, something didn't quite add up. Building a database of "every call ever made" didn't really help find those personal connections. If anything, the additional records made things even harder.

Today, we learn why everyone's calls had to be in the target set. The NSA wasn't just conducting social network analysis. It was using a more controversial data mining technique, dragged into the popular imagination by Darpa's Total Information Awareness project. It focuses on prediction, not connections.

Under this approach, sophisticated algorithms hunt for patterns of terrorist behavior in information-trails, and then apply those patterns to average citizens, seeing which ones fit. It doesn't matter who you know. It's what you do that gets you in trouble. If you spend money and buy plane tickets like Mohammed Atta did, then maybe you're a terrorist, too. Same goes for the kind, and frequency, of phone calls you make.

Using computer programs, the NSA searches through the database looking for suspicious calling patterns, the officials say. Because of the size of the database, virtually all the analysis is done by computer. Calls coming into the country from Pakistan, Afghanistan or the Middle East, for example, are flagged by NSA computers if they are followed by a flood of calls from the number that received the call to other U.S. numbers.

The spy agency then checks the numbers against databases of phone numbers linked to terrorism, the officials say. Those include numbers found during searches of computers or cellphones that belonged to terrorists.

It is not clear how much terrorist activity, if any, the data collection has helped to find.

(Big ups: Eric)

UPDATE 12:57 PM: "The NSA spying program... is fundamentally a system for identifying criminals by statistical analysis. Americans need to come to grips with whether they approve of this," says Kevin Drum.

Take a different, but equally incendiary example. Suppose that we could semi-reliably create a statistical portrait of child molesters: their age, geographical location, gender, and calling and buying patterns...

Needless to say, the FBI could track these patterns using the same methods as the NSA and then exploit the results to create lists of "possible child molesters." And it might work. But would we be OK with the FBI tapping someone's phone just because they fit a statistical profile? Or staking out their house? Or investigating their friends?

And if we can do it for suspected terrorists and child molesters, how about tax evaders and unlicensed gun owners? ... And if not, why not? After all, if you're not doing anything wrong, why would you object to being investigated?

UPDATE 3:26 PM: Eric makes another great catch, unearthing these nuggets from an interview that First Amendment lawyer Floyd Abrams did on Charlie Rose's show the other night. Abrams, it turns out, was on a privacy panel overseeing TIA:

We basically said if you want to engage in data mining, which we said was a very good way to gather information to fight terrorism, you should go to the FISA court to get permission...


The panel presented its conclusions to Secretary Rumsfeld--who, it might be noted, is also a boss the NSA, since it's a military agency. Rummy thanked them, got some good P.R. and sent them on their way.

Asked by guest host Brian Ross, "Do you feel used?" Floyd said:

[I]t's one thing to be on a commission and then be ignored. That's --that's life. But not even to be told that the government was then engaged in the very activities that we were writing about does seem as if we were being used, yes.

Latest Comments

Bush broke the law and c-low supports that. He supports unlawful criminal activity and malfeasance by government officials.

Has nothing to do with being a Bush basher-everything to do with FISA and the rule of law. If you don't like our American ways, C-Low, go live somewhere else-like China.

Posted by: captain crunch at July 30, 2007 9:54 AM


Eric

I do trust the NSA. I don’t trust every person in it (human nature) but I do trust that the majority is above board and do want to do their job protect national security. Of course there is going to be some bad apples but where and in what is their not? Is their anything in today’s technology world that cannot be abused by bad apples?

The FISA court issue is ridiculous we are talking about millions of pings the vast majority of such are followed up and dropped in the search for that proverbial needle. But do you really think the FISA court is capable of processing that many pings do you really thinks the NSA bureaucracy is large enough to make enough paper work to present such millions of cases to the FISA court in a reasonable time frame? So in that case the FISA court would have to basically give a blank check and self dissolve their own organization by such or they would be swamped and the reasonable time frame needed in case we hit that needle would be destroyed.

The current set up I believe is best approve limited massive pinging (with a temporary presidential decry by way of war) then when we get a hit or something calling for more intrusive follow up take that to the FISA and get it approved. I also like the additional insurance by making the gathered info only usable on Terrorism no other domestic stuff and that is backed up by the program being in the NSA a organization that is not even allowed to tread on FBI domestic toes.

The millions pinged in a non-intrusive minor privacy violating sweep is an acceptable price compared to other sacrifices of privacy like the air port searches, surveillance cameras, and other that have already been made.

If those anti-war groups or those oil company executives were making phone calls to questionable people or places or even people who by way of spider web is attached to terrorist then I hope they are followed up on and cleared or pursued.

It’s no different than the airport screener that got caught abusing his job by feeling up women awhile back he was caught fired and run out. We didn’t end the whole program of searches because of one bad apple and we didn’t refuse to even use that tool of defense because such abuse could happen back when we enacted that policy after 9-11.

Bottom line you have to give a benefit of doubt to those attempting to defend US and fight this war. When and if we find a bad apple abusing the program for political, financial, whatever reasons then I will be with ya holding the rope.

Don't let partisan mistrust blind you Right or Left when it comes to the Nations interest.

Posted by: C-Low at May 24, 2006 12:42 PM


C-Low,
First of all, I don't see why you trust that every single person in the NSA will always behave in an above-board way. Isn't your whole theory of "can't wait for the crime to be committed" based on not trusting that everyone acts in above-board way? That fact is exactly why there's an oversight process, namely the FISA courts. That keeps some bad egg from doing the unthinkable and targetting his enemies with this software. And that's exactly what so unnverving about the way this program was created - the NSA and the administration have been making all possible efforts to operate without oversight. If nobody's targetting any political enemies, and everything's hunky-dory, why run this program as if something shady were being done?

Second, several anti-war groups have already reported being spied on by the FBI in conjunction with this program. So there is a reason to believe that it might well be used against someone's political enemies. And there's plenty of liberals over at DailyKos just waiting to tap every call the oil execs make. After all, they've got plenty of reason to call Kazakhstan themselves, or to get calls from Nigeria, Sudan or Indonesia.

Posted by: Eric E at May 24, 2006 11:37 AM


Sarge
“First a crime is committed, and THEN it is prosecuted. It is NOT the other way around.”

That policy is just fine for domestic crimes but after 9-11 I am pretty sure most of US came to the conclusion we had to make exception for terrorist who couldn’t be allowed to commit their crime first.

Bonus question if we enact this policy you recommend after they hit US again killing another 3k civilians will the WOT be supported by you then? Will a wide-ranging war be OK or should we stick to a handful of cruise missiles like the good old days of Clinton? If not what exactly is your personal limit of acceptable US civilian’s casualties you are you willing to sacrifice before taking action (don’t forget some of those actions may not be pretty or nice, some may even have the potential to be abused)?

“As to his question of "After all, if you're not doing anything wrong, why would you object to being investigated?"
I know some really nice, older retired guys, that spent time in Soviet gulags who said more or less the same thing as they were led away in the middle of the night.”

“Yeah, suspects like Quakers, Sierra Club members, and PETA.”

What world does this come from short the one I had mentioned in my previous post? Terrorist are not political opponents they are terrorist who’s goal is to kill US. The last quote is baseless can you name one instance were Quakers, Sierra Club, PETA members were rounded up? Even if they did ping on the scan they were followed up and dropped because they are not terrorist. These are the wild eyed statements that come from nowhere but your partisan starting point that Bush is evil so through the NSA he is going to do evil rounding up political opponents, ala Stalin in this case. Before hyperventilating and throwing wild-eyed baseless accusations I would suggest you live by your own words “First a crime is committed, and THEN it is prosecuted. It is NOT the other way around”.

Constitutionality? Don’t you mean “interpretation” of constitutionality? I have not seen nor heard of any instance proven constitutionally to be in violation that is indisputable. And besides isn’t the constitution a “living document”?

And by the way read that misquote you did on me again in its FULL form. I will try to translate for you to.

“If you guys could only hate and want to destroy our enemy the terrorist half as much as you unconditionally hate Bushitler this war would be over by now.” (that last half changes the whole point huh)

Translation: Your Bush hatred blinds you to the real threats that threaten our nation today.

“To have to fight a foreign enemy and a portion of this nation that is at best not helping at worst outright fighting every effort we try to win or defend ourselves is devastating to our nation.”

Translation: We are in a active hot WAR right now like it or not and those to the left either being neutral at best, or outright fighting every effort the rest of US who are trying to defend the nation and fight this war is hurting our nations effort. Tying up our defenses in red tape or forcing them to be made public in detail for our enemies to see leaves US needlessly vulnerable to attack, and for what your paranoia of non-existent abuses.

When you find some examples of abuse like a PETA guy or maybe a Dem that is arrested for political reasons under this new NSA terrorist surveillance program then I will bite. Until then put your paranoid Bush hatred away and give the benefit of doubt to those trying to protect US all from another 9-11.

Posted by: C-Low at May 24, 2006 12:12 AM


The NSA/CIA have been listening and watching Usama since 1996 and could have prevented 9-11 and stopped the 2nd Iraq War and this upcoming Iran conflict; "The NSA" are a bunch of Jackasses and Pussys. They spy on Americans but
remember what they are, they are Bald, Fat, Stupid, But kissing, Ugly, Lazy, Government and Military workers who are underpaid, overworked and understaffed. They watched Walker, Ames, Hanson and Pollard and barely caught them! These people could not catch a cold and my taxes are paying their salaries, ouch! My trust is in God, not in these fools! PS Where is Usama??? National Super A. holes! And please stop calling the 1-900-sex #s at work! PS If there is another 9-11 the OSI, ONI, DIA, NSA, CIA, FBI will again fail to stop it and the Patriot ACT 4 will really be cool! Thanks and Peace.
Sincerely, Jaye

Posted by: Jaye at May 23, 2006 8:04 PM


» View All 13 Comments

» Post a Comment