Tag Info

Hot answers tagged

20

My research group has gone pure python for coding experiments; we've been burned too many times by glitches and implicit behaviour in boxed experiment-building software to bother trusting it. Moving from a point-and-click experiment design interface to pure code does have a large learning curve, and you want to be careful to model your own code on well ...


14

I'd suggest checking out the Linear Ballistic Accumulator (Donkin et al., 2011) model for a scenario like this. While LBA can be used to model any number of alternatives in a speeded choice task, to model signal detection you'd want to model just two accumulators, one for the "signal" response and one for the "no signal" response. With this scenario, ...


12

MANOVA is definitely a bad idea given that one dv is continuous and the other is binomial. After exploring a number of different approaches to combining RT and accuracy data, I've come to conclude that the best current approach is to use linear ballistic accumulator model (e.g., see Donkin et al 2011). The LBA is a simple (structurally and computationally) ...


11

I would recommend Matlab and the Psychophysics Toolbox. It lets you display all sorts of stimuli in full-screen mode, and it lets you capture key strokes and mouse clicks.


11

PEBL is a free open source programming language to help construct psychological experiments. A wiki and developer community provide some documentation and support. PEBL has a Psychological Test Battery of many common or simple psychological tests so you may be able to use it out of the box without constructing your own test. PEBL includes free versions of ...


10

A paper comparing the performance of Inverse Efficiency Scores and diffusion models for the quantification of RT and accuracy can be found here. Rach et al. (2011) "On quantifying multisensory interaction effects in reaction time and detection rate " Psychological Research Volume 75, Number 2, 77-94, DOI , PDF


9

A consensus within cognitive psychology is that there really is no such thing as "computation", though that depends how you define it. It seems all arithmetic ( + - * / ) is simply fact retrieval from long-term memory. More complex problems simply rely on the fact that we can break them down into simpler problems. For instance, when you learn to solve ...


9

In addition to Mike's suggestion, see the Ratcliff diffusion model and variants thereof. E.g.: Ratcliff, R., & Rouder, J. N. (1998). Modeling response times for two–choice decisions. Psychological Science, 9, 347–356. Ratcliff, R., & Tuerlinckx, F. (2002). Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction ...


9

There are a variety of models solving accuracy and RT that have been pretty well tested and LBA is probably fine (I haven't used it). If you don't want to go that far there is a rather simple way to analyze data controlling for SAT that has much better mathematical properties than IE scores (which, as Mike said were named by me, but offhandedly proposed by ...


8

FingerFriendlySoft has created an app for all iOS devices (that is, iPod touch, iPhone and iPad) that is called N-back Suite. This is, as the name suggests, an app which lets you take the n-back test. Included are both the single and the dual n-back test and you can chose different amounts of n (from 1 to 10), five different speeds, and different type of ...


8

The basic approach that you are describing sounds like inverse efficiency scores (e.g., see Townsend and Ashby, 1978,1983), which are measured as $$\frac{r}{1-e} = \frac{r}{c}$$ where $r$ is reaction time, $e$ is proportion error, and $c$ is proportion correct. John Christie provides a critique of inverse efficiency scores here or see the discussion in ...


8

Answer based on your original depression example Note that this answer was originally written based on your initial example, where you asked: Assume, I have developed a new intervention for people with light depression. I want to compare the effectiveness of this intervention (E) with an existing intervention (C). For this, I recruit test subjects ...


7

Programs/packages for EEG analysis There are decent MatLab toolboxes with good tutorials for for the analysis of EEG data. The EEGLAB toolbox (tutorial) can be operated by both GUI and command-line (and script). The fieldtrip toolbox (tutorial) is mainly operated by command line / script. Of course there are also (commercial) software packages for EEG ...


7

Procedures like this are often called "funnel debriefing" procedures, and they basically consist of an extended version of what you already had in mind. You begin with some very general questions about the nature of the experiment (e.g., "Do you have any initial thoughts or reactions about this experiment?"), then move on to some questions that are slightly ...


7

I would say there are no such tests/toolboxes, that would allow you to properly conduct any cognitive testing on iPhone, iPad or even using web-based applications. There are some games that attempt to do it, like the one suggested by @Speldosa, but nothing really serious. At the moment there seem to be no way to control and record different variables (like ...


7

The Open Science Framework will do some of what you ask for. Additionally, it will allow you to preregister your hypotheses to properly distinguish confirmatory and exploratory research. Features (quoted from the homepage). Document and archive studies Share and find materials, scripts, data Detail individual contributions Increase transparency ...


7

Bias can be quantified in many different ways. In human memory research carried out in the cognitive psychology tradition, there are simple ways to think about it. One basic measure of cognitive bias is merely called bias, and it's a measure of the absolute accuracy of an individual's probability judgments. You average probability judgments across a given ...


7

@Jeromy Anglim: I'm actually creating a serial response time task (a widely used learning task) for the iPad now. We hope to get it up in the appstore soon but I'm using it along with a few others for my master's thesis. We're almost done putting the finishing touches on the task and hope to post a youtube video soon of the task. We're not intending to make ...


7

OpenSesame is a recent entry that is cross-platform and seems to promote GUI-based design while allowing customization via Python scripting. It can be found at their website (link above). A recent article has references and summarizes 16 other tools as well (including some reported in the other stackexchange responses). I found great video tutorials and ...


7

Schroedingers Cat nailed a couple of important points and I need to expand it further. I believe the important roadblock in the creation of an absolutely intelligent machine is the fact that human brain is still not decrypted. There isn't a holistic cognitive model that describes how the brain functions, reacts or take decisions. Even in case such a model ...


7

If you come to this question from the bayesian tradition, then there is only one place where you can sneak in bias: your prior. This dovetails nicely with the wikipedia definition: a pattern of deviation in judgment that occurs in particular situations, leading to perceptual distortion, inaccurate judgment, illogical interpretation, or what is broadly ...


7

I'd like to address important issues that Jeromy Anglim raised in the "Personal thoughts" section of his answer, namely that correlation parameters (i.e., true, population, or infinite-sample correlations) often vary and covary among studies, and this between-studies\interstudy heterogeneity implies heterogeneity in studies' parameters for a structural ...


7

I think it's a basic concept of experimental design that you have control groups. So for example, if you want to study the effect of X (e.g., a drug) on Y (e.g., performance), you could manipulate X (e.g., give half the drug and the other half no drug) and randomly assign the participants to either group. Random assignment is a strategy for making the groups ...


7

Sites: The social psychology network has a page for posting online social psychology studies. There are a range of requirements. In particular, it needs to be closely related to social or personality psychology. SampleSize Subreddit is a community dedicated to completing surveys. They like it when results will be provided at study completion. It has close ...


7

The primary difference is two-fold: 1) Methods : Social sciences use mostly qualitative methods and content analysis, psychology and cognitive sciences use quantitative methods and statistical analysis. The one basic standard tool in psychology and cognitive sciences is the laboratory experiment, while social sciences usually collect data in the field. 2) ...


6

I use the FieldTrip toolbox in Matlab to analyze my own modified auditory MMN experiment :) But I use MEG, so I don't have that many software options. The toolbox is very powerful but it has a steep learning curve and I would recommend it only if you already have both Matlab and EEG data analysis experience. I don't analyze my data in the classical MMN way ...


6

Resonance methods can be used to measure neurotransmitter levels. Magnetic Resonance Spectroscopy can measure the levels of a large number of neurotransmitters. However, this has always been viewed as a fairly static measure of neurotransmitter levels, and so has not been widely used as a measure of neural activity. However, Paul Mullins at Bangor University ...


6

Measures of arousal surely do play a role in subject performance on a wide variety of cognitive tasks. Generally, scientists can safely ignore this factor as it is assumed to introduce random noise between participants. From a hypothesis testing perspective, scientists are much more worried about factors that introduce systematic bias, or factors that skew ...


6

Paper IQ Test: EDIT: There is a list of printable tests including an IQ test at http://personality-testing.info/printable_tests.htm , it looks to be of standard internet IQ test quality... Here is a printable version of an IQ test developed on this website. It is no where near the quality of a professional IQ test but may be interesting and its ...


6

You should probably also check out: Pleskac & Busemeyer (2010). Two-stage dynamic signal detection: A theory of choice, decision time, and confidence. Psychological Review. Also, I believe Busemeyer has a dynamic signal detection theory paper but I don't know that it has been published. The Pleskac & Busemeyer paper probably draws on this ...



Only top voted, non community-wiki answers of a minimum length are eligible