Where Do Terrorists Want To Go To College? (Thesis Months)

Choosing a college is always difficult but imagine how much more challenging the issue is if you are a terrorist.  You have been told that you are a smart young person, you have aced all your exams, and it has been suggested to you by several bearded men in assorted caves that you should go somewhere to learn how to build a nuke.

How to choose?

Not every college or university has a nuclear engineering program and, to the best of my knowledge, none of them offer a course in "Nuclear Weapons Building 101".  Even if you find the right program with the right teachers and labs, etc., you probably also want to make sure you pick a place where you will not excite the interests of the local security services too much.

While it may be easier to imagine a terrorist group recruiting (or hiring) someone who already has the requisite knowledge to build a WMD, the attacks on the World Trade Center prove that Al Qaeda, at least, had (and may still have) the patience to execute a long-term plan involving the education of one of their best and brightest.

Cyndi Lee, in her thesis, Deadly Education:  Evaluating Which Universities Are Attractive To International Terrorists, explores this issue in some depth.

Specifically, Cyndi used German universities as the testbed for her case study (The German university system provides most of the data, including indications of quality, that Cyndi needed to demonstrate her concept.  The same system could be applied to any country where the data is available, however.)

Her goal was, first, eliminate any college or university that did not offer the possibility of getting the appropriate education and, second, rank order the remaining universities according to their perceived attractiveness to the international terrorist (in terms of program quality and ability to remain anonymous).

While Cyndi is careful to acknowledge the limitations of her study (not the least of which would be the unacceptably high false positive rate should her work be taken too literally), it does suggest that, in a resource constrained environment, there may well be ways to reduce uncertainty about possible terrorist courses of action and, in turn, allocate what resources that do exist more efficiently.

You can see the full text of the thesis below or download it directly from here.

Deadly Education -- Evaluating Which Universities Are Attractive To International Terrorists

Excellent Guidebook On Cognitive Biases, Free To Download (Royal Society Of Account Planning)

OK, so the Royal Society of Accounting Planning is a bit of a joke but the document that Eric Fernandez has put together on different kinds of cognitive biases is actually quite useful for anyone teaching or training analysts.  

Even better, all the text is licensed under Creative Commons and all the pictures are either public domain or also licensed under Creative Commons which means you can download it, remix it and share it as you see fit.

One warning, though:  Much of the information comes from Wikipedia and is currently under revision (to a large extent due to the first version of this publication).  Fernandez has highlighted this by indicating that this publication is in "Beta" and has included a prominent warning label on the front cover.

That said, it is still a useful and engaging compilation of biases that could easily serve as a supplement to a variety of analytic methods or critical thinking courses.

While I have posted the full document below, you can also go here to download it.

Finally, many thanks to all of the alumni and friends who pointed this document out to me!  

Cognitive Biases - A Visual Study Guide

Multi-Criteria Intelligence Matrices: A Promising New Method (Thesis Months)

One of the more interesting theses I have supervised over the last several years was Lindsey Jakubchak's The Effectiveness Of Multi-Criteria Intelligence Matrices In Intelligence Analysis.  

Lindsey's thought was to take a version of the well-tested school of operational methodologies often referred to as multi-criteria decisionmaking methods (MCDM) and flip it on its head to turn it into an intelligence method.  The results of her experiment show the method as promising in a number of different respects, though, clearly, there is still work to be done.

For those of you unfamiliar with MCDMs in general, there are many, many variants of the process and each is accompanied with all of the arguments and counter arguments typically associated with academe.  Lindsey just wanted to see if there was any value in her proposition at all, so she chose one of the simplest, and most common forms of MCDM to "flip" -- a streamlined version of the US Army's Staff Study Method.

What do I mean by "flip"?  Well, MCDMs are typically used to help select the most logical course of action based on a given set of criteria.  Say, for example, you were looking to buy a car.  You had down selected to three particular SUVs but you couldn't make up your mind which one was best for your family.  An MCDM would ask you to select the criteria you thought were important to you and your family (seating, reliability, gas mileage, storage, etc) and then rate each car, using a matrix to sort the results.  Arguably, the car that best meets your criteria is the one you should select (Anyone familiar with Consumer Reports, for example, knows that this is the way they come to their conclusions about various products).

What if it is not you buying the car, though?  What if you are trying to figure out what kind of car a friend might buy?  Your friend might prefer sports cars to SUVs and have an entirely different set of criteria for choosing one.  That's what I mean by "flip".  What if you could use an MCDM not as a tool to help you make better decisions but as an intelligence analysis method to help you figure out what an enemy, a criminal or a competitor is likely to do?  That was what Lindsey set out to test and she gave her method a name -- the Multi-Criteria Intelligence Matrix.

While, due to the topic she decided to explore -- Russia's relationship with OPEC -- she was not able to evaluate forecasting accuracy (though I give her full points for trying), she was able to compare her experimental group to the control group in a number of other interesting ways.  Using the standards in ICD 203 as a guideline, she was able to say a couple of interesting things like:

"Although the experimental group indicated a lower level of knowledge in regards to the topic (Russia’s relationship to OPEC) and expressed a lower level of interest with the topic, both of which were found to be statistically significant, the experimental group was able to arrive at a broader range of possible Courses Of Action (COAs)."

"The average completion time for the control group was 70 minutes and the average time for the experimental group was 58.6 minutes. Therefore, when looking at the big picture, although the experimental group seemed less knowledgeable and less interested, they were able to arrive at a more complete list of relevant possible COAs, and they completed their analysis in less time."

"While a few students in the control group provided one or two alternative COAs, the majority of the student-analysts merely provided one COA with few comparisons to any alternatives, thus not providing any insight to whether or not alternative solutions were considered.  In the experimental group, the student-analysts, who used MCIM, provided a list of all possible COAs, and identified the importance of specific criterion or various factors to those COAs."

In the end, the study suggests the method has promise and, with Lindsey's results in hand, it has more evidence to back it than many other, more widely taught, methods.  I have embedded the full text below or you can download it here. 

Related Posts:
Top 5 Intelligence Analysis Methods

The Effectiveness of Multi-Criteria Intelligence Matrices In Intelligence Analysis

Global Intelligence Forum Slides And Notes Now Available To Everyone!

The recently completed Global Intelligence Forum discussing analytic best practices and held in Dungarvan, Ireland was, by all accounts, a huge success.  

We have just finished compiling all of the notes, slides and speeches into a single place for viewing and download and are now making those slides and notes available to anyone interested.

If you are not sure where to start, look at the menu on the far left of the landing page (you can see a screenshot of what the landing page looks like in the picture to the right).  Kathleen Moore, one of our grads (and recent recipient of an AFIO Scholarship for graduate school -- Hooray, Kathleen!) has put together a very useful conference re-cap that points to all of the various presentations and puts them into the broader context of the conference.

If you just want the conference slides and speeches, though, they are all in one place for downloading.  We are still pulling together a number of other resources (we hope to get the full text of Gov. Ridge's speech, for example, as well as some video) but most of the stuff is up there now.

If you are interested in any of the press or other commentary surrounding the conference, our public relations department has helpfully compiled it all on the Facebook page dedicated to the conference.

Enjoy!  

IBM Creates Interactive Map/Infographic Of CIA World Factbook (IBM.com)

IBM, in order to demonstrate some of their latest web based technologies, has taken the data from the CIA's World Factbook and re-mixed it in the form of a stunning, interactive infographic.  

The final product allows the user to much more quickly engage and compare the data for the various countries in the world.  The screenshot to the right does not (as usual) do the product justice.  I have zoomed in on central Africa to show some of the detail but you can just as easily take a look at the whole world and can instantly get a sense of where various regions lie with respect to any of the data the World Factbook contains.  

I strongly recommend you go here to see the full product.  Play around with it; I think you will be impressed.

If you are interested in additional information about IBM's initiative, you can go to the cryptically named IBM ILOG Elixir Blog or to Information Aesthetics, where I first picked up on this product.

Note:  This has been a very good week for maps (See also here and here) ...