For questions about statistical methods that might be appropriate for certain paradigms within psychology, psychiatry, neuroscience, or cognitive science.

learn more… | top users | synonyms

18
votes
5answers
798 views

Can response time be incorporated into signal detection theory?

In signal detection theory, one typically uses "signal" and "no signal" responses to analyze the data (that is, the analysis is based on a discrete choice for each trial, effectively generating the ...
13
votes
6answers
5k views

How to analyze reaction times and accuracy together?

Is there a good way to analyze reaction times and accuracy together, other than MANOVA? I have data from an experiment in which participants had to respond to stimuli in two different conditions in a ...
11
votes
2answers
358 views

Fitting a psychometric function when data does not lend itself to a sigmoidal fit

I'm fitting a psychometric function to a range of data. The majority of this data lends itself to a sigmoidal fit (i.e. participants can do the task), but some individuals are absolutely unable to do ...
10
votes
3answers
2k views

What is the standard way to analyze EEG data in a mismatch negativity paradigm?

I'm running an EEG experiment using a modified auditory mismatch negativity (MMN) design, and I'm wondering if anyone can tell me the best method for data analysis (and recommend any stats ...
9
votes
3answers
775 views

Which R packages have good collections of psychology datasets?

The open source statistical software R has a range of contributed packages. Some of them include datasets. I teach research methods in psychology and I'm looking for interesting real-world dataset ...
9
votes
3answers
457 views

Introductory resources on bayesian modeling for cognitive sciences

On Cross Validated there is a great question about best introductory books for bayesian statistics. Also, Jeromy Anglim blogged recently about use of JAGS, rjags, and Bayesian Modelling, with some ...
9
votes
2answers
998 views

What articles use structural equation modelling in a meta-analytic context to model mediation?

I'm interested in structural equation modelling (SEM) meta-analysis and its application to modelling mediation relationships. Mike W.-L. Cheung has written a few articles on the topic of SEM ...
9
votes
1answer
158 views

Are there any journal articles in psychology that have promoted and discussed reproducible data analysis?

I consider reproducible analysis to be really important. In particular, I'd like to see more researchers in psychology: sharing their data producing their journal articles using literate programming ...
9
votes
1answer
150 views

Which statistical test should I use when there are multiple latent predictors and multiple latent outcomes?

Which statistical method should I use when Predicting organization commitment (composed of 3 latent variables) using the five factors of personality? Its a cross-sectional design with survey data. ...
8
votes
2answers
1k views

When is it defendable to use manifest instead of latent variables in psychological research?

In psychology, most of the concepts, theories, ideas etc. of interest refer to latent variables, where a latent variable is one that can't be observed directly. Instead, one has to find a manifest ...
8
votes
2answers
370 views

How to estimate an expected effect size for a planned psychology study?

When planning a psychological study, researchers are often asked to formulate an estimate of expected effect sizes for important hypotheses in the study. This might be the expected group mean ...
8
votes
1answer
3k views

What are the real life applications for Probability Learning?

Probability learning is a principle that states probability of a response tends to match the probability of the reinforcement. How does one achieve such rationality under uncertainty? What are ...
8
votes
1answer
104 views

Reproducible meta-analysis in psychology

I am a big proponent of reproducible data analysis. In particular, I like when researchers share documents in formats like Sweave and knitr which weave statistical output (e.g., text, tables, and ...
8
votes
1answer
94 views

Are there any models of the human visual field of view taking into account head, neck and eye movements and calculating likelihood of fixation?

I would like to know if there are studies that (1) model the field of view taking into account all degrees of freedom of the head, neck and eyes and (2) if there is any probabilistic model assigned to ...
7
votes
2answers
181 views

The current recommended text for statistics in behavioural sciences

I have an old book: Statistics for the Behavioural Sciences (4th ed.) by Gravetter & Wallnau. I want to transition my textbooks to eBook format, but this book doesn't come like that (as far as I ...
7
votes
1answer
160 views

Do we need a pre-test to compare the effectiveness of two treatments?

Assume, I want to evaluate how effective two teachers are in teaching English to German children. Both teachers have been teaching at the same high school for twenty years, and both use a distinctly ...
7
votes
2answers
149 views

How should results from linear mixed models (LMMs) be reported?

Are there any official APA guidelines for reporting linear mixed model results? Can I take an approach similar to what would be done with an ANOVA (i.e., report the p-value, standard error and .95-CI ...
7
votes
1answer
282 views

Analysis of parameter estimates from Ratcliff diffusion model

I would like to analyze a dataset in which subjects' reaction time and error rate have been recorded. In order to account for potential speed-accuracy trade-off I am planning to make use of the ...
7
votes
2answers
186 views

Which statistical tests to use when analyzing NASA TLX?

The NASA Task Load Index (NASA-TLX) is a subjective, multidimensional assessment tool that rates perceived workload. A set of different scales (Mental Demand, Physical Demand, Temporal Demand, ...
7
votes
1answer
133 views

Significant baseline, Oddball paradigm

I recently conducted an EEG experiment using a passive Oddball paradigm with two experimental conditions : standard stimuli (occurring with a 85% probability) and deviant stimuli (occurring with a 15% ...
7
votes
1answer
78 views

What paper discussed the cognitive properties of Likert/visual analogue scales in ratings?

I seem to recall a recent paper investigating whether ratings created using Likert or Visual Analogue Scales formats had the cognitive properties of interval or ratio data (since they are generally ...
7
votes
1answer
334 views

Minimizing Halo Error

I'm working with a dataset wherein participants rate five different attributes of six device variants; the attribute ratings different variants are very tightly correlated, suggesting that this ...
7
votes
2answers
302 views

Best practice to handle double negatives when using the expectancy-value model?

My question is regarding the multiplicative combination rule in the Expectancy-value model developed by Fishbein and Ajzen, and the issues regarding the expectancy value-muddle, or the case of "double ...
7
votes
1answer
108 views

What are the most used statistical methods in WM research besides (generalized) linear modeling?

I mean, by cognitive psychologists. I skimmed over a few articles from Journal of Cognitive Neuroscience and Trends in Cognitive Science and concluded that ANOVAs and t-tests are mostly used (without ...
6
votes
1answer
678 views

What tools are available for EEG analysis on the R platform?

I'm starting some EEG studies on attention, and would really like to use R for preprocessing (filtering/artifact rejection), visualization, and analysis, but I can find very little in the way of ...
6
votes
1answer
203 views

Correct measure of central tendency for reaction times analysis

I'd like to know what would be the less biased measure of central tendency to compare RTs in two conditions with a lot of trials (~700). Mean is really sensitive to outliers, and median really robust, ...
6
votes
1answer
158 views

Controlling for response bias in a forced choice memory task

I want to present participants a pair of items $a$ and $b$, each with an association $x$ or $y$. Later on participants will presented with the items singularly, and asked 'what was the association?'. ...
5
votes
1answer
86 views

How is sample size determined in animal research?

In human research, we define our universe and estimate the effect size we expect to observe, then we can draw the a sample of a given size. How is sample size determined for experiments in the animal ...
5
votes
1answer
88 views

Are there any standard psychometric scales that are only applicable to within-subject designs?

A while ago, I asked the question whether Presence questionnaires are valid in between-subject designs (see the question for the background to this assumption). While the question garnered some ...
5
votes
1answer
157 views

Inferring relationships between psychological variables in clinical samples and issues in generalisation

Context I sometimes speak to researchers studying the relationship between variables in clinical psychology samples. A typical example is as follows: 100 patients with diagnosed depression many ...
5
votes
1answer
45 views

Is it reasonable to have a factor with only two levels in a carry-over design for an fMRI study?

I'm planning a carry-over design for an fMRI study. To save time, since it seems that I'll need a huge number of trials for my purpose, I'm wondering if it's reasonable to have a matrix 2x3x3, ...
5
votes
0answers
115 views

What to do when you have a speed-accuracy trade-off in your data?

Many studies report that a speed-accuracy trade-off (SATO) did not occur in the data since there is a positive correlation between RTs and error rates. In other words, people took longer to respond ...
4
votes
3answers
3k views

How to calculate composite factor scores post factor analysis for a questionnaire?

I have a question with regard to calculating composite factor scores after running a factor analysis in SPSS. My research is on work related stress and I collected my data through a perceived stress ...
4
votes
2answers
54 views

How should I report results of a likelihood ratio test?

I'm using likelihood ratio testing to assess whether a behavioral model is a better description of my data than a simpler (so called restricted) model. How should results of such statistical tests be ...
4
votes
2answers
102 views

Origin of group-level statistics in psychology and cognitive neuroscience

In experimental psychology and cognitive neuroscience today, with the exception of a few specific subdisciplines, the consensus seems to be that an experimental study has to be performed on a group of ...
4
votes
1answer
13k views

How to calculate IQ score based on raw score and adjust for age?

I am having a hard time grasping how IQ scores are calculated. I think it has something to do with their age score ratio multiplied by 100. Say I have a test that holds 30 questions. How would I ...
4
votes
1answer
58 views

How to measure precision in classical test theory framework?

What methods or approaches exist or might be developed to measure precision of measurement in a classical test theory framework? Standards for Educational and Psychological Testing (American ...
4
votes
1answer
56 views

Optimal number of dimensions in multidimensional scaling

I have run an experiment on consonance-dissonance evaluation of musical intervals on 40 individuals using all the possible intervals from 3 registers (plus their inversions), and I want to apply a ...
4
votes
1answer
65 views

How many samples are there when test subjects come through different recruitment strategies?

Let's assume I want to conduct a survey. To find test subjects, I post an ad in a local newspaper, one on a locally relevant website, distribute flyers in front of the train station, and have managed ...
4
votes
1answer
300 views

Facet versus scale prediction of Big 5 personality

NEO facets and scales: The NEO model of personality has 5 scales (i.e., extraversion, neuroticism, agreeableness, openness, and conscientiousness). For each scale there are 6 facets (e.g., neuroticism ...
4
votes
0answers
25 views

Is there an extension of multinomial process models that incorporates response latencies?

In an experimental setting where a categorical response has to be given, the same response can, in theory, be generated by different latent processes. For example, in an experiment where participants ...
4
votes
0answers
155 views

How to analyse accuracy, hits and false alarms in e-prime?

It's the first time for me to do analyses with e-prime, and I have to analyse some data from an experiment. The data are, at the moment, in e-prime. I'd like to have the accuracy, the hits, and the ...
3
votes
2answers
107 views

How to analyse 3 by 3 design with Likert scale ratings?

I want to understand what would be the best way to analyze the results of an online likert-scale ratings of pictures on 3 dimensions. I have 3 groups of participants from different countries. They are ...
3
votes
2answers
70 views

Statistics books for educational psychologists?

I plan to study educational psychology in the near future. I know research methods is a big thing for educational psychologists, so I wanted to get a firm grip on the statistical knowledge required ...
3
votes
2answers
94 views

Calculating d-prime

I'm currently working on a research that has to use and calculate D Prime values for a task where subjects are presented an image at different speeds and they have to report if they saw the image or ...
3
votes
1answer
55 views

Analysis of RTs when speed-accuracy trade-off leading to ceiling accuracy has occurred

I know that it is not desirable for behavioural data to show a (within-subjects) speed-accuracy trade-off, as it can lead to e.g. the wrong interpretation of a single subject's decreased RTs as ...
3
votes
3answers
53 views

Qualitative scoring for responses to design fluency task

Before I can ask my questions, I have to give a little background information. I'm involved in a study using a measure of design fluency. Subjects are shown a page full of squares, like the one ...
3
votes
1answer
37 views

Correlation between BIS and BAS responses

As a part of my lab experiment, participants had to answer questions for BIS and BAS (BAS reward, drive and fun) scales. The correlation matrix shows that BIS is significantly positively correlated ...
3
votes
2answers
2k views

How long does physical attraction typically last in a permanent relationship?

How long, on average (and with as much other statistical data, e.g. standard deviation, as possible) does physical attraction between male and female in a permanent relationship last? I believe this ...
3
votes
1answer
3k views

How to compute Chi-square value and degrees of freedom in Excel?

I am trying to understand the statistical test of the chi-square in Excel. I already made the test but I still don't know how to compute the χ² value and what it means, how to compute the degrees of ...