Take the 2-minute tour ×
Cognitive Sciences Stack Exchange is a question and answer site for practitioners, researchers, and students in cognitive science, psychology, neuroscience, and psychiatry. It's 100% free, no registration required.

Is there any reason not to include fantasy distractors (made-up wrong answers) in multiple choice tests.

Examples: What is the name of the compound HCl?

a) Hydrochloric acid

b) Chlorohydride acid

c) Chlorohydric acid etc

What is the term for a parasite that cannot complete its life cycle without its host?

a) Obligate parasite (correct)

b) Parasitic obligate (fantasy word)

c) Mandatory parasite (fantasy combination)

Fantasy distractor definition: Usually one chooses distractors that a student could confuse with the correct answer, based on knowledge of common cognitive models of the field. I call a fantasy distractor a distractor that is a made-up word - typically it would be used for testing/learning complex terms that consist of a combination of etymological roots by rearranging them or mixing them up.

Potential concerns: How high is the risk that students remember the fantasy distractor? What is the best practice on such fantasy items?

Rationale for having fantasy items: The reason for asking is that it seems having a greater number of distractors can make the test more of a retrieval test than a recognition test. Getting plausible non-fantasy distractors (eg in chemistry can be tough).

share|improve this question
    
Can you clarify how you are defining "fantasy distractors"? Obviously without incorrect options, it would not be a test. But from your single example, I can't discern the exact distinction you are making between different types of distractors. –  Jeromy Anglim Mar 5 '13 at 7:56
    
Yes, that was unclear. I changed and added definition - hope this makes it clearer. –  toksing Mar 5 '13 at 12:00
add comment

1 Answer 1

up vote 2 down vote accepted

I would say no, there's no reason not to, and in fact it might be better, based on the following rather speculative reasoning.

In general, despite the general benefits of testing for learning, multiple choice testing can also lead to subsequent memory for incorrect responses, i.e. it can cause students to learn false responses.

Marsh, Roediger, Bjork, & Bjork (2007) "The memorial consequences of multiple-choice testing." Psychonomic Bulletin & Review, 14(2) 194-199

This doesn't explicitly compare fantasy answers to other misleading answers, but intuitively, it seems that such "false learning" would be MORE likely to be reinforced in the future for plausible responses than for fantasy responses. The reason is that fantasy responses are unlikely to ever be encountered again, while plausible responses might be, leading to reinforcement of the false learning.

See also here regarding avoidance of false learning from multiple choice testing:

Little and Bjork (2012) "The persisting benefits of using multiple-choice tests as learning." Proceedings of the 34th Annual Conference of the Cognitive Science Society.

share|improve this answer
    
Thanks - yes, the false learning literature was my main concern. –  toksing Mar 7 '13 at 1:53
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.