# Tag Info

20

My research group has gone pure python for coding experiments; we've been burned too many times by glitches and implicit behaviour in boxed experiment-building software to bother trusting it. Moving from a point-and-click experiment design interface to pure code does have a large learning curve, and you want to be careful to model your own code on well ...

14

I'd suggest checking out the Linear Ballistic Accumulator (Donkin et al., 2011) model for a scenario like this. While LBA can be used to model any number of alternatives in a speeded choice task, to model signal detection you'd want to model just two accumulators, one for the "signal" response and one for the "no signal" response. With this scenario, ...

12

MANOVA is definitely a bad idea given that one dv is continuous and the other is binomial. After exploring a number of different approaches to combining RT and accuracy data, I've come to conclude that the best current approach is to use linear ballistic accumulator model (e.g., see Donkin et al 2011). The LBA is a simple (structurally and computationally) ...

11

I would recommend Matlab and the Psychophysics Toolbox. It lets you display all sorts of stimuli in full-screen mode, and it lets you capture key strokes and mouse clicks.

11

PEBL is a free open source programming language to help construct psychological experiments. A wiki and developer community provide some documentation and support. PEBL has a Psychological Test Battery of many common or simple psychological tests so you may be able to use it out of the box without constructing your own test. PEBL includes free versions of ...

10

A paper comparing the performance of Inverse Efficiency Scores and diffusion models for the quantification of RT and accuracy can be found here. Rach et al. (2011) "On quantifying multisensory interaction effects in reaction time and detection rate " Psychological Research Volume 75, Number 2, 77-94, DOI , PDF

10

The basic approach that you are describing sounds like inverse efficiency scores (e.g., see Townsend and Ashby, 1978,1983), which are measured as $$\frac{r}{1-e} = \frac{r}{c}$$ where $r$ is reaction time, $e$ is proportion error, and $c$ is proportion correct. John Christie provides a critique of inverse efficiency scores here or see the discussion in ...

9

A consensus within cognitive psychology is that there really is no such thing as "computation", though that depends how you define it. It seems all arithmetic ( + - * / ) is simply fact retrieval from long-term memory. More complex problems simply rely on the fact that we can break them down into simpler problems. For instance, when you learn to solve ...

9

In addition to Mike's suggestion, see the Ratcliff diffusion model and variants thereof. E.g.: Ratcliff, R., & Rouder, J. N. (1998). Modeling response times for two–choice decisions. Psychological Science, 9, 347–356. Ratcliff, R., & Tuerlinckx, F. (2002). Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction ...

9

There are a variety of models solving accuracy and RT that have been pretty well tested and LBA is probably fine (I haven't used it). If you don't want to go that far there is a rather simple way to analyze data controlling for SAT that has much better mathematical properties than IE scores (which, as Mike said were named by me, but offhandedly proposed by ...

9

Answer based on your original depression example Note that this answer was originally written based on your initial example, where you asked: Assume, I have developed a new intervention for people with light depression. I want to compare the effectiveness of this intervention (E) with an existing intervention (C). For this, I recruit test subjects ...

9

Sites: The social psychology network has a page for posting online social psychology studies. There are a range of requirements. In particular, it needs to be closely related to social or personality psychology. SampleSize Subreddit is a community dedicated to completing surveys. They like it when results will be provided at study completion. It has close ...

9

In speaking to constructs vs. measures, I believe that the difference is clear and implied in your background: constructs are that which cannot be directly measured (but we assume exists), where measures are directly measurable attributes that we assume relate to the construct. The process you seem to be questioning is that of the operational definition, or ...

8

Programs/packages for EEG analysis There are decent MatLab toolboxes with good tutorials for for the analysis of EEG data. The EEGLAB toolbox (tutorial) can be operated by both GUI and command-line (and script). The fieldtrip toolbox (tutorial) is mainly operated by command line / script. Of course there are also (commercial) software packages for EEG ...

8

Procedures like this are often called "funnel debriefing" procedures, and they basically consist of an extended version of what you already had in mind. You begin with some very general questions about the nature of the experiment (e.g., "Do you have any initial thoughts or reactions about this experiment?"), then move on to some questions that are slightly ...

8

FingerFriendlySoft has created an app for all iOS devices (that is, iPod touch, iPhone and iPad) that is called N-back Suite. This is, as the name suggests, an app which lets you take the n-back test. Included are both the single and the dual n-back test and you can chose different amounts of n (from 1 to 10), five different speeds, and different type of ...

8

If you come to this question from the bayesian tradition, then there is only one place where you can sneak in bias: your prior. This dovetails nicely with the wikipedia definition: a pattern of deviation in judgment that occurs in particular situations, leading to perceptual distortion, inaccurate judgment, illogical interpretation, or what is broadly ...

8

The primary difference is two-fold: 1) Methods : Social sciences use mostly qualitative methods and content analysis, psychology and cognitive sciences use quantitative methods and statistical analysis. The one basic standard tool in psychology and cognitive sciences is the laboratory experiment, while social sciences usually collect data in the field. 2) ...

8

Antoine Tremblay has just released an advanced analysis toolbox: http://onlinelibrary.wiley.com/doi/10.1111/psyp.12299/abstract It's missing about half the features on your list, although fundamentally, spectral density is a simple task and LORETA is a stand-alone package anyways (although similar approaches, e.g. general CSD estimation, are implemented in ...

7

I would say there are no such tests/toolboxes, that would allow you to properly conduct any cognitive testing on iPhone, iPad or even using web-based applications. There are some games that attempt to do it, like the one suggested by @Speldosa, but nothing really serious. At the moment there seem to be no way to control and record different variables (like ...

7

The Open Science Framework will do some of what you ask for. Additionally, it will allow you to preregister your hypotheses to properly distinguish confirmatory and exploratory research. Features (quoted from the homepage). Document and archive studies Share and find materials, scripts, data Detail individual contributions Increase transparency ...

7

Bias can be quantified in many different ways. In human memory research carried out in the cognitive psychology tradition, there are simple ways to think about it. One basic measure of cognitive bias is merely called bias, and it's a measure of the absolute accuracy of an individual's probability judgments. You average probability judgments across a given ...

7

@Jeromy Anglim: I'm actually creating a serial response time task (a widely used learning task) for the iPad now. We hope to get it up in the appstore soon but I'm using it along with a few others for my master's thesis. We're almost done putting the finishing touches on the task and hope to post a youtube video soon of the task. We're not intending to make ...

7

OpenSesame is a recent entry that is cross-platform and seems to promote GUI-based design while allowing customization via Python scripting. It can be found at their website (link above). A recent article has references and summarizes 16 other tools as well (including some reported in the other stackexchange responses). I found great video tutorials and ...

7

Schroedingers Cat nailed a couple of important points and I need to expand it further. I believe the important roadblock in the creation of an absolutely intelligent machine is the fact that human brain is still not decrypted. There isn't a holistic cognitive model that describes how the brain functions, reacts or take decisions. Even in case such a model ...

7

I'd like to address important issues that Jeromy Anglim raised in the "Personal thoughts" section of his answer, namely that correlation parameters (i.e., true, population, or infinite-sample correlations) often vary and covary among studies, and this between-studies\interstudy heterogeneity implies heterogeneity in studies' parameters for a structural ...

7

I think it's a basic concept of experimental design that you have control groups. So for example, if you want to study the effect of X (e.g., a drug) on Y (e.g., performance), you could manipulate X (e.g., give half the drug and the other half no drug) and randomly assign the participants to either group. Random assignment is a strategy for making the groups ...

7

In Germany, most students and many researchers conduct their online surveys using the portals soscisurvey.de and unipark.info. Soscisurvey.de includes a so-called "panel", a pool of currently more than 100.000 persons interested in partaking in surveys. To use the panel, you do not have to host your survey on soscisurvey.de, but you must apply a month in ...

7

Apologies in advance for the long answer. I tried to narrow down the scope by focusing on only a single construct, and only a single aspect of validity, and it still turned out like an essay... Let's take intelligence research as an example. This work started with an intelligence concept – a fairly vague and ambiguous idea about a personality trait that ...

7

Try the IAPS--International Affective Picture System; they have disgusting images as well as norming procedures and data. You can read about it here and request it (as long as you have a faculty advisor) here.

Only top voted, non community-wiki answers of a minimum length are eligible