Monday, June 25, 2012

How To Replace "Class Participation" With "Professionalism" (Brilliant Idea!)

Sometimes you go to a conference and come away energized - full of new thoughts and ideas.  And sometimes you go to a conference and are lucky to come away with just one new idea.  The American Association of University Professor's Annual Conference in DC a few weeks ago was more of the latter than the former for me -- but that one idea was a real doozy!

I had been paired serendipitously with Dr. Alice Armstrong, a computer science professor from Shippensberg University, on a pedagogy panel.  While I gave my presentation on "The 5 Myths Of Game-based Learning" (more on this later this week) to the, shall we say, "modest" crowd that had assembled for the 0830 start time, Alice really engaged both me and the crowd with her approach to instilling professional standards in her students (It all revolves around the chart below -- but more on that in a moment).

Alice (and her co-author, Dr. Carol Wellington) were facing a serious problem.  Their capstone class, like many capstone classes, asked their students to pursue an independent, long term project.   Despite their best efforts to keep these students in the game, they were still facing failure and incomplete rates that were (combined) hovering around 33%.

Their analysis of this problem indicated that the difficulties were not technical or knowledge based - the students had the skills to do the projects.  Instead, the problems were behavioral; sticking with a schedule, staying in touch with their technical mentors, meeting intermediate deadlines, etc.  Solving this problem seemed difficult if not impossible.

Now comes the brilliant part...

Their solution to the problem was to separate the course grade into two components.  The first part is your standard, old grading system based on how well the students did the various assignments.  Like any standard course grade, you start with a zero and then, as tests and assignments accumulate, your grade emerges as a function of the average of how well you did on those tests and assignments.

The second part is where they did something different and very, very cool.  The second half of the grade is a "professionalism" grade.  Students start with 100% and can only lose points for being "unprofessional." 

I will define "unprofessional" in a second but think for a moment just how clever this is.  In the first place, it does away with the nebulous "class participation" grade.  In the second place, it emphasizes something that faculty in applied professions, like law, medicine, engineering, architecture, computer science and intelligence, value dearly -- professionalism.  Third (and I love this one), it mimics the employer's opinion of an employee.

Think about it:  You just got hired by a company or agency.  You were selected to fill a slot over a bunch of other qualified applicants.  The assumption is that you are the best available candidate for that job.  Because you are new, you are going to be watched and because you are being watched you are going to have chances to disappoint - to make the boss wonder if he really did hire the best candidate - not just with respect to your knowledge but also with respect to your behavior.  It may not be particularly fair, but it is true.

Talking about it is all fine and good, but how do you make it real in the classroom?  If you are like me, you have probably seen a number of potential flaws in this approach.  Here is once again where our friends at Shippensburg impress.  Look at the list below.  I am hard pressed to find much that is objectionable about it.  Lateness, missing appointments, etc.  Those are things we are probably counting off for anyway.
To get the final grade for each student, Alice and her colleagues multiply the content and professionalism scores.  Look at the chart near the top of this post again:  This effectively means that the best you can ever do is the lower of the two grades and that, quite often, your overall grade will be less than the average of your two grades.  Alice and her colleagues believe that this is the key innovation in this approach.

I have to disagree with that a bit.  I think the key innovation is not in the specifics but in the approach itself.  By focusing on professionalism as an attribute that you are expected to have and can only lose, Alice and her colleagues have changed its psychological value.  Loss aversion is a well understood effect and Alice reported that her students responded as any good psychologist would expect:  They hated to lose professionalism points!

Regardless why it works, it certainly seems to be working.  They cut their failure and incomplete rates in half.  They are so happy with the system that they are pushing in down their curriculum to their freshman classes (there they do give students the opportunity to earn points back, though).  One of the most important endorsements of the process actually came from outside the university:  The computer science department's industry advisory council loves it.

I am thinking about implementing some aspects of this system in my own classes.  While I think the Shippensburg system is pretty harsh, I can understand their reasoning.  I would not want half or more of my points tied up with issues like lateness and missing deadlines, though.  Frankly, those kinds of things have  rarely been a problem in any of my classes here at Mercyhurst. 

More important to me is the point of such a system:  To send a signal that professionalism matters and that it is something you are expected to have and can only lose.  Getting away from the more wishy-washy "class participation" grade and moving towards something that is both important and helps the students is a strong step in the right direction, in my opinion.

Monday, June 11, 2012

Best Professional Development Event For Intel Professionals This Year

That's right, the Institute of Intelligence Studies is sponsoring a professional development conference for its alumni, students and faculty this summer from 8-11 July at Mercyhurst University.

And you can register here!

This is not an alumni "weekend", "retreat" or an "escape".  It is not "homecoming".  This is a premiere opportunity to hone your skills as an intelligence professional at the same place where you all got your start -- Mercyhurst.

We are bringing in top notch speakers (many of which are former classmates!) and are going to offer an extraordinary opportunity to network both inside and outside your chosen field (Quick:  How many Mercyhurst intel alums currently work in the banking industry?  In energy?  In almost any field you can name?  You will be surprised at the number!) and across the generations (We have been doing this for 20 years - I know, I find it hard to believe myself!).

If you need more enticement, the faculty will all be here to bring you up to speed on our current research activities (AKA "What we have learned about intel since you've been gone...") and where we are going in the future.  With over 1000 alumni, 100's of research projects, dozens of full and part time faculty, and the opportunities represented by the new building, these are results you will want to know about.

This isn't just about us, though.  We also want to learn from you, too.  Our program is 20 years old this year and it is time to plot our course for the next 20 years.  What are the problems you are having?  What research do you need done to improve your ability to provide actionable intelligence to the decisionmakers you support?  What skills and abilities do the intelligence analysts of tomorrow need today?  Getting your input at this conference is crucial.

If you are a current student or alum you can register here to attend.  I personally look forward to seeing each and every one of you!

Thursday, May 24, 2012

Geospatial Analysis Of Gerrymandering In Pennsylvania (An Advanced Analytic Techniques Project)

One of my students, Karl Gustafson, used an interesting combination of geospatial and political data to create a video (see below) that examines some historic cases of gerrymandering in Pennsylvania.  He used this as background for looking into what appears to be some pretty clear cases of gerrymandering in the making.


While the production quality on the video is none too slick, Karl does a good job of using a series of overlays, a clear, direct script and the features of Google Earth to explain what gerrymandering is and how it has been used ion the past and how it is currently being used to literally re-shape Pennsylvania politics.

You can see Karl's evaluation of the methods and processes he used here.

Monday, May 21, 2012

DC Based CI Courses Now Open For Registration (Shameless Self Promotion)

How would you like to take counterintel courses for graduate credit from some of the most experienced CI professionals in the world?  Now you can...

Mercyhurst University has been teaching counterintelligence courses in the DC area for a number of years.  Traditionally, we have done this in coordination with a government or private partner.  Last year, though, we opened these classes up to qualified students throughout the DC area.

These courses (there are three of them) make up our Graduate Certificate in Counterintelligence.  All of the classes are accredited, of course, and are taught one per quarter for three quarters.  If you want the certificate, you would need to take all three and take them in series.  If you are just interested in learning more about the CI field, then you could opt to take just the first course -- it is entirely your call.

The first course in this series will be offered in early September and run for approximately 10 weeks.  The course is not offered online and will meet once a week in the evening at a location in the vicinity of Tyson's Corner.  There are no pre-requisites other than a bachelors degree from an accredited university.

The courses are taught by Ray Batvinis, Bob Stephan and Tim Almon.  Stephan is the author of Stalin's Secret War and has over 20 years experience with CIA, DIA and the USAF; Batvinis spent 25 years at the FBI working on CI issues at the highest levels, Almon spent 25 years at the FBI before becoming the Director of Counterintelligence and Security Programs on the National Security Council Staff for Presidents Clinton and Bush.

Because of their experience and contacts, one of the unique aspects of these classes are the kinds of guest speakers they can draw.  For example, they have been able to bring together Plato Cacheris and John Martin (the defense attorney and the federal prosecutor in the Robert Hanssen case) for a one-of-a-kind roundtable.

This brief note cannot do either this course or the guys teaching it justice.  If you want more information, please do not hesitate to contact the director of our online and distance learning programs, Linda Bremmer, at 814 824 2170 or lbremmer at mercyhurst dot edu.

Registration is now open!

Monday, May 14, 2012

Entry-level Competitive Intelligence Analyst Jobs Report Out Now!

Here it is!

The 1st Annual Entry-level Hiring Projections For Competitive Intelligence Report!

This final report completes our series which also includes:
All three reports take a look at the market for entry-level analysts for the next 12 months.  The primary source of our information is a survey we conducted of professionals in all three sub-disciplines of intelligence who had direct or significant indirect knowledge of hiring intentions within their firm or organization (Many thanks once again to all who participated!).  We added to that information a variety of secondary sources to help us draw our conclusions.

All three reports were put together by one of our top quality grad students, Whitney Bergendahl (full credit to Whitney for sticking this thing through - None of us knew just how difficult it was going to be...) with an assist from another grad student for editing and packaging and from my colleague Prof. Shelly Freyn.

We intend to conduct the same survey in the fall so keep an eye out for it.  Finally, and as always, send your comments to me or leave one below!