Showing posts with label cognitive biases. Show all posts
Showing posts with label cognitive biases. Show all posts

Tuesday, November 19, 2013

Reduce Bias In Analysis By Using A Second Language

In a world where the majority of analysts are bi- if not multi-lingual, the question of how language affects both the analytic process and analytic product is an important one. Emotion, language processing and cognitive biases aside, the intriguing question remains: Would you make the same decision in English as you would in, say, Chinese? Most analysts would likely answer yes to this question, but recent research led by Boaz Keysar out of the University of Chicago suggests otherwise[1].


Thinking of learning another language? This infographic is a good
suggestion of which language you might want to consider
tackling first.
http://visual.ly/hardest-language-learn
The study, published in Psychological Science, concludes that “people are not as loss averse in a foreign language as they are in their native tongue.” Being less loss averse, that is more willing to take on risk, might sound like a dangerous characteristic to possess from an intel analyst’s perspective. In this case, however, being less risk averse means that people more systematically assessed the problem and came to a more rational conclusion. At the root of this finding is the conclusion that “people rely more on systematic processes…when making decisions in a foreign language.” Regardless of how accepting of risk we are as analysts, the ability to make decisions driven more by rational thought and less by emotion is a capability to which every analyst likely aspires.

In three studies, Keysar showed that while participants made different decisions based on how the problem was framed[2] (as more or less risky), they made the same decision for both risk conditions when using their foreign language. The three groups of participants had English as a first language and Japanese as a second, Korean as a first language and English as a second or English as a first language and French as a second, indicating that this effect is replicable within and across language family boundaries.

So why, then, do we make more rational, less biased decisions in our second language than in our first? It largely has to do with the lack of “emotional resonance” that we derive from foreign language text. Literature on second language acquisition unanimously agrees that people perceive messages delivered in their second language as less emotional (and consequently less impactful) than messages delivered in their first language; this concept applies to everything from political opinion to curse words[3].

How we perceive emotion then ties directly to our internal cognitive processes. According to Daniel Kahneman, the most widely respected authority on these internal processes, we have two broad systems of thinking – System 1 and System 2 thinking[4]. System 1 is automatic (and often times uncontrollable) while System 2 is more deliberate and rational. Think of System 1 as the mechanism driving impulse buys and split second decisions, whereas System 2 is more like making a grocery list in advance. Cognitive biases, or internal heuristics (shortcuts) that influence both our analytic process and analytic product, originate in System 1 thinking. Examples of cognitive biases particularly relevant to intelligence analysis are confirmation bias, anchoring bias and the framing effect (addressed directly in Keysar’s article).

Cognitive biases originate in System 1 thinking along with our gut instincts, emotional reactions and a less credible substantiation for intelligence analysis, intuition. Consequently, it makes sense to pursue analysis derived from System 2 processes as it will likely be less biased, more rational and more systematically attained. The argument here is that conducting analysis within the domain of a second, third or fourth language will lead to an increased reliance on System 2 processes, thereby reducing bias and ultimately resulting in more systematically-derived analysis. The results of Keysar’s study, while still relatively new, support this perspective.

In practice, with bilingualism now practically a pre-requisite for analysis work, the benefit of this argument to intelligence analysts is obvious (coupled with the other known benefits of bilingualism).[5] The traditional view is that an analyst is at an automatic disadvantage when operating in a non-native linguistic domain to conduct analysis, fearing the loss of meaning and context. The argument in this article, however, sheds new light on the quality of the analytic product obtained in a non-native language. Would you make the same decision in English as you would in, say, Chinese? The answer is that you might not, and your Chinese decision just might be more impartial.





[1] Keysar, B., & Hayakawa, S.L. (2012). The Foreign-Language Effect: Thinking in a Foreign Tongue Reduces Decision Biases. Psychological Science, 23, 661-668.
[2] Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47(2), 263-292. The bias phenomenon Keysar’s article claims to neutralize is what Kahneman and Tversky call The Framing Effect, and is one of the many known cognitive biases to affect intelligence analysis.
[3] Emotion and Lying in a Non-Native Language (2009). International Journal of Psychophysiology, 71, 193-204. Puntoni, S., Langhe, B. D., & Van Osselaer, S. M.J. (2009). Bilingualism and the Emotional Intensity of Advertising Language. Journal of Consumer Research, 35(6), 1012-1025.
[4] Kahneman, D., & Frederick, S. (2002). Representativeness Revisited: Attribute Substitution in Intuitive Judgment. Heuristics and Biases: The Psychology of Intuitive Judgment, 49-81.
[5] Bialystock, E. (2011). Reshaping the mind: The benefits of bilingualism. Canadian journal of experimental psychology, 65(4), 229-235. Though there are many studies that demonstrate the known benefits of bilingualism, this is a recent article that reviews many of these previous articles.  

Wednesday, June 12, 2013

Teaching People To Overcome Biases With Games At Origins, Global Intelligence Forum

Inspired by the announcement of Intelligence Advanced Research Project
Agency's Sirius Program a couple of years ago, I set out to design a tabletop (i.e. card) game that would help people learn more about cognitive biases and hopefully learn to limit the effects of some of the worst of them.

My first two attempts were ... OK ... but I couldn't quite get them to work.  Either they took too long to play or playtesting suggested that the learning effects were too small. 

One day, though, it hit me - a design that was both manageable in terms of time and had good evidence to suggest that it would teach people not only how to identify bias situations in real life but also to apply effective strategies for mitigating the effects of those biases!  In short, I had a good game with proven mechanics and a testable hypothesis -- I was off to the races!

This summer (finally), I am taking my best design, The Mind's Lie, on the road to actually test it.  First up is the Origins Game Fair this week in Columbus, Ohio.  I need participants to test the game and I figured where better to go than one of the world's largest tabletop game fairs?

We have a booth and will be recruiting potential participants for an experiment to see if the game actually works (we are also recruiting for new students, so if you are in the Columbus area and are interested in learning more about our program for you or your son or daughter, do not hesitate to drop by). 

We will be playing the same game at the Global Intelligence Forum in Ireland in early July.  GIF is unquestionably my favorite conference (and not only because Mercyhurst sponsors it...). 

It is the only place I know where intel professionals from all over the world and from across all three major intelligence sub-disciplines - national security, law enforcement and business - meet to talk about how to improve the practice of intelligence.  It is exciting intellectually, in a beautiful town on the coast of Ireland, and is still small enough to actually get to know some people (some pretty interesting people, actually...) instead of just bumping into them.

This year, if The Mind's Lie works like I think it will, the participants will get the opportunity to walk away with a better ability to evaluate evidence in an unbiased manner as well - worth the price of admission, I think!

If you are in the Columbus area this weekend drop by.  We will be showcasing The Mind's Lie and all our other games for intelligence analysts in booth 745 in the exhibit hall.  If you haven't made plans to go to the Global Intelligence Forum, there is still time to register - hope to see you there!