May 05, 2006
Law School Exams, Multiple Choice, and the "Wrong Answer Penalty"
Posted by Christine Hurt

This semester in my BA class I opted to have part of the exam multiple choice.  I did this for a number of reasons.  Obviously, a machine grades multiple choice exams, but it took me quite a bit of time on the front end to create the exam.  Secondly, BA is a survey class that has many unrelated topics.  I'm not creative enough to squeeze most of them into three essay questions, so the exam ends up being a testing just a slice of the curriculum.  Many multiple choice questions seems more thorough.  Anyway, I'm happy with the outcome of part objective, part essay, but I wanted to ask readers what they thought about the "wrong answer penalty" in multiple choice exams.

When I took the scantrons to be graded, I had to answer a number of questions:  how many points per question, were they all the same, and did I want to assess a penalty for wrong answers?  I felt dirty just being asked the question.  I understand that this structure would get a curve in a hurry, but is it pedagogically sound?  Could this format be pedagogically sound in some disciplines but not others?  To me, penalizing wrong answers has but one attractive result: not allowing good guessers to be treated the same as people who know the answers.  (So, at the last minute you circle in all "c"s.)  But unless your test aims for a median grade of 25-30%, then guessers will never be on the same footing as the knowledgeable test-takers, right?

Penalizing wrong answers has the effect of making test-takers very risk-averse.  Students may not circle an answer they are 75% sure of, which is actually correct, and they may take more time per question than necessary.  In affect, you're grading their strategy, not their knowledge.  In law, it's hard to know the answer to an application question 100% (unless you are 100% sure the other answers are wrong).  Maybe the penalty system works better on tests with computations where you are either 100% sure or you're guessing.  In classes like that in my experience, professors have exams where you "show your work" to ensure that there's no guessing.  Maybe in a large university system this is impossible.  Anyway, that is not the typical law school exam.

Anyway, I did not choose that system.  And I had one student who did not circle in the last ten questions.  I wanted to call the student:  "Why didn't you just bubble in "c"?"

Law Schools/Lawyering | Bookmark

TrackBacks (0)

TrackBack URL for this entry:
http://www.typepad.com/services/trackback/6a00d8345157d569e200d8348830ee53ef

Links to weblogs that reference Law School Exams, Multiple Choice, and the "Wrong Answer Penalty":

Comments (15)

1. Posted by Jared on May 5, 2006 @ 16:39 | Permalink

I'm actually surprised that your students didn't raise the question before the exam and force you to think this issue through up front.


2. Posted by Christine on May 5, 2006 @ 16:44 | Permalink

Jared, have you taken an exam recently (or given one) in which this was the system? I thought about it briefly while creating the exam, but dismissed it. In thinking back upon my education, I remember exam administrators (PSAT, SAT, etc.) saying "wrong answers won't be penalized," but I honestly don't remember taking an exam where wrong answers were penalized. I was just suprised that the testing center asked as a matter of course, somehow signalling that the structure was common. How common is it?


3. Posted by Former Lawyer on May 5, 2006 @ 17:50 | Permalink

I can't think of a discipline where it is worse to be wrong and not know it than law. Well, medicine, maybe.

Knowing when you are unsure and being able to admit it to yourself is a critical skill.

Apply the "wrong penalty."


4. Posted by Lawyer on May 5, 2006 @ 18:03 | Permalink

On the SAT, 1/4 of a point is subtracted for wrong answers. This is the basis of the Princeton Review's "Joe Bloggs" technique (named pre-blogs)--as they say:

"Instead of trying to find the right answer, try to find the wrong answers. By eliminating wrong answers, you greatly improve your chances of getting the question right because even if you can't narrow your choices to a single answer at the end, you will have only two or three to choose from instead of all five. Physically cross out the wrong answer choices in your test booklet, and then guess among whichever answer choices remain.

Only a quarter point is subtracted for every wrong answer, while a full point is added for every right answer. So, if you can eliminate at least one answer choice, guess among the two, three, or four remaining choices."

http://tinyurl.com/qjn24

(I taught Princeton Review before law school--it's not that I remember this from my long, long ago high school days.)


5. Posted by Larry on May 5, 2006 @ 19:42 | Permalink

If you don't take off points for wrong answers on essay exames, I don't see why you would do it for a MC exam.

This semester, I had my first law school exam that took off points for wrong answers. I personally think it's a bit silly to do that.


6. Posted by ac on May 5, 2006 @ 22:31 | Permalink

There is another option. I remember one multiple choice exam where the professor gave half credit for the second best answer.


7. Posted by PK on May 6, 2006 @ 11:45 | Permalink

There's a better way to do give a law school exam in a survey course: ask short answer questions rather than multiple choice. Limit students to 100 words or so per answer. That way, you can hit all the topics you want without going to an all-or-nothing system like multiple choice.


8. Posted by Anon. Student on May 6, 2006 @ 12:24 | Permalink

At Texas, a well-known BA (and Securities Regulation) professor awards most of his points on True/False questions, deducting for wrong answers. This is much worse than multiple-choice. It was the most arbitrary exam that I've ever taken. Ex. "A University of Chicago professor wrote . . . ." Correct answer: False, it was a Harvard professor.

On the other hand, I've had some very well constructed multiple-choice exams that IMHO did a good job of testing students' comprehension of the material. FWIW, I've seen multiple choice work really well on Evidence and Federal Income Tax, and really poorly on Civ. Pro. I don't know if the difference is the subject or the author, but I suspect the latter.


9. Posted by Kristin on May 8, 2006 @ 9:09 | Permalink

I disagree with "Former Lawyer" that the wrong answer penalty should be applied. First, if it was not mentioned prior to the exam, it cannot be applied. To do so would be unfair to the students who did not take this into consideration before the exam. Law school exams are just as much about method as arriving at the correct answer. Second, many students will dismiss the answers that are clearly wrong and end up with two answers, one of which is clearly right (in the Professor's viewpoint) and one in which the student could justify by simply applying the answer (perhaps in a context/manner not considered by the Professor).

To answer Jared's question about why students did not raise this question prior to the exam; the answer is simple. Students are generally taking four to five law school exams in less than six or seven days. They rely on the Professor to lay out the intricacies of that particular Professor's exam. Students do not have the time or energy to devote themselves to considering questions that have not crossed their minds since taking the SAT. Most law school professors do not employ the "wrong answer penalty." Most law professors at Marquette University Law School do not employ the "wrong answer penalty." It is not a question that students consider, unless raised by another student, professor, or perhaps, blog.

I also like the suggestion by "ac." Second best answers get a partial point deduction, and would satisfy both goals: to penalize "guessers" and to give partial credit to students who may have arrived at their answer in an unconventional manner (i.e. employing a method that the Professor had not considered).

I also like the suggestion by "PK." But, as a law student, I got three of my best grades on short answer exams, so I may be a bit biased.


10. Posted by Mat on May 8, 2006 @ 15:43 | Permalink

"Students are generally taking four to five law school exams in less than six or seven days."

Where? Who? Hyperbole?

Post a comment

If you have a TypeKey or TypePad account, please Sign In

Bloggers
Papers
Posts
Recent Comments
Popular Threads
Search The Glom
The Glom on Twitter
Archives by Topic
Archives by Date
February 2012
Sun Mon Tue Wed Thu Fri Sat
      1 2 3 4
5 6 7 8 9 10 11
12 13 14 15 16 17 18
19 20 21 22 23 24 25
26 27 28 29      
Syndicate The Glom
Subscribe

The Glom's Blog Network on Facebook:

Miscellaneous Links
LexisNexis Top Business Blogs 2011

 LexisNexis Tax Law Community 2011 Top 20 Blogs