15,398 reputation
634110
bio website jeromyanglim.blogspot.com
location Melbourne, Australia
age
visits member for 2 years, 8 months
seen 6 hours ago

I am a Lecturer in the School of Psychology at Deakin University bridging I/O psychology and statistics.

I'm quite active on the Cognitive Sciences and Statistics Stack Exchanges.

You can find me also on:


Mar
24
comment What is the standard error of measurement for teacher made multiple choice tests?
With regards to absolute performance: I agree that making claims about absolute performance from a test in a rigorous way is very difficult. But ultimately any teacher who is asked to decide what is the passing grade is forced to draw an absolute line in the sand somewhere. This might be a particular value of theta or a proportion correct on a test. My guess is that many teachers feel more comfortable talking about proportion correct (e.g., less than 50%, 60%, or whatever is the custom is a fail).
Mar
24
comment What is the standard error of measurement for teacher made multiple choice tests?
With regards to heuristics: Any heuristic would be based on the assumption that the teacher would be writing a set of additional items of roughly comparable quality, difficulty, and variety as the existing items. I acknowledge that some teachers might differ in their skill in doing this, but at the same time, a heuristic could be frame in terms of a ball park or a typical range.
Mar
21
answered Are cortisol measures more reliable than self-reported fear measures for looking at difference scores?
Mar
21
asked Are cortisol measures more reliable than self-reported fear measures for looking at difference scores?
Mar
21
awarded  Revival
Mar
21
revised Free online survey and diary software for conducting experience sampling studies
turned into more complete answer
Mar
19
revised Why do humans like being touched?
edited tags
Mar
19
comment Why do humans like being touched?
You might want to read this review of social touch research: Thayer, S. (1986). History and strategies of research on social touch. Journal of Nonverbal Behavior, 10(1), 12-28.
Mar
19
revised Why do humans like being touched?
edited tags; edited title
Mar
18
comment What is the standard error of measurement for teacher made multiple choice tests?
In addition to difficulties in implementation, I think IRT is not applied in teacher constructed test settings because there is often an implicit contract with the students. That is, a student's mark is directly related to the proportion of items answered correctly. Thus, in IRT there is still the question of how thetas will be mapped on to exam grades. Of course this can be overcome, but I think it presents another obstacle to uptake, particularly where the test is used to make judgements about absolute performance and not just normative performance.
Mar
17
comment What is the standard error of measurement for teacher made multiple choice tests?
+1 I agree IRT (bayesian IRT in particular) provides a great framework for modelling multiple choice tests. In my particular case, I'm looking for heuristics that teachers might use to guide their decision about how many items to include in a test. I'd like to be able to give teachers a rough sense of how much more accurate their test could be if they for example increased their test from 80 to 100 items.
Mar
13
revised Analyzing control questions data for a survey
edited tags
Mar
11
revised How to compute Chi-square value and degrees of freedom in Excel?
added 159 characters in body
Mar
11
revised How to compute Chi-square value and degrees of freedom in Excel?
deleted 33 characters in body
Mar
11
answered How to compute Chi-square value and degrees of freedom in Excel?
Mar
10
comment What is the standard error of measurement for teacher made multiple choice tests?
Standard error of measurement is the standard deviation that would be obtained if you were able to repeatedly obtain a measure for a particular individual under hypothetical identical circumstances. I.e., it's a measure of the uncertainty you have about a measure you have obtained on a person.
Mar
10
answered Analyzing control questions data for a survey
Mar
8
answered What is the standard error of measurement for teacher made multiple choice tests?
Mar
8
asked What is the standard error of measurement for teacher made multiple choice tests?
Mar
6
comment Is fear rational?
As a related topic you may want to read up about the evolution of emotions and arguments for their adaptive functions: en.wikipedia.org/wiki/Evolution_of_emotion