For questions about experimental and theoretical methods, procedures, and tools used while conducting research in the cognitive sciences.

learn more… | top users | synonyms

4
votes
0answers
32 views

What to do when you have a speed-accuracy trade-off in your data?

Many studies report that a speed-accuracy trade-off (SATO) did not occur in the data since there is a positive correlation between RTs and error rates. In other words, people took longer to respond ...
3
votes
0answers
106 views

Where to recruit paid participants for online Inquisit experiments?

My team and I are trying to use Inquisit for a reaction-time based experiment looking at attentional bias. However, with the no download policy on Mturk and CrowdFlower, we don't know a good site to ...
3
votes
0answers
31 views

Manipulating cognitive load in online experiments

I'm under the impression that standard cognitive load manipulations (e.g., remember a 7-digit number while completing some other task) wouldn't work for online subject pools like Mechanical Turk. Are ...
12
votes
10answers
1k views

Are there any cognitive test (or test suites) available on the iPad?

I find the IPad to be a great piece of hardware that is easy to bring along and that has an intuitive touch interface. This would make it an ideal platform for many cognitive tests such as n-back. As ...
1
vote
4answers
55 views

Best way to capture effect of making people upset?

I am an undergrad, I am planning to do some research to see how much I enjoy it before I apply for grad programs. I am researching the effects of a certain characteristic of a presenter making people ...
3
votes
2answers
67 views

List of affective states for a study?

I am putting together a study that attempts to assess whether people assign particular affective or emotional states to images--specifically, animated GIFs. Is there a "standard" list of emotional ...
1
vote
2answers
37 views

How many trials are needed to estimate a response time distribution?

I want to estimate the properties of a response time distribution (mean, variance, tail-length) for individual subjects. How many samples (trials) do I need to collect to get reliable estimates? ...
2
votes
1answer
38 views

How can I design a staircase function that converges on a given hit-rate?

I'm in the process of creating a simple contrast staircase function where subjects are initially presented with high-contrast Gabor patches and are subsequently queried as to their orientation in a ...
1
vote
1answer
57 views

Getting analysis of changes in MY brain upon cannabis consumption [closed]

I want to know if/how my brain differs from other brains. I'm also interested in knowing exactly how my brain changes when I smoke marijuana, as it is claimed that it affects individuals differently. ...
3
votes
0answers
21 views

Is there an extension of multinomial process models that incorporates response latencies?

In an experimental setting where a categorical response has to be given, the same response can, in theory, be generated by different latent processes. For example, in an experiment where participants ...
2
votes
3answers
124 views

Name needed for psychological practice which uses objects that represent humans [dolls/pictures/etc.] during patient treatment

What is the name of practice/method (if such exists) where psychologist uses a doll (or any other form of human-being representation) for patient to talk to? I believe I have seen it in a movie or ...
2
votes
2answers
38 views

How are research participants normally divided into equal groups to allow scientific comparison?

I'm neither a academic nor familiar with the proper English choice of words regarding research. However, I would really like to know a few things about the process of doing a research with people ...
3
votes
1answer
120 views

How to design an experiment to measure coffee preferences?

Imagine a population of people in an office environment. There is a small war going on about whether this brand of coffee machine is better than that one. How would you go about testing which coffee ...
-2
votes
2answers
161 views

Should questions in psychology always be objective questions? [closed]

Is it correct that a subjective question is not a psychological question? I.e. for a question to be psychological, must it be an objective question? E.g. a question about an objective probability ...
15
votes
5answers
637 views

Software for online psychological experiments that don't require users to download anything

We are currently using Inquisit to conduct Internet experiments. Since it is not compatible with non-Windows systems, we lose a lot of potential subjects. Ideally, we would like to implement something ...
11
votes
5answers
3k views

Open source software for running Internet psychological experiments that collect reaction time data

I've often used Inquisit to run psychological experiments online. The software enables delivery of stimuli (e.g., text, images, etc.) and collection of reaction times. Obviously general purpose ...
13
votes
6answers
3k views

How to analyze reaction times and accuracy together?

Is there a good way to analyze reaction times and accuracy together, other than MANOVA? I have data from an experiment in which participants had to respond to stimuli in two different conditions in a ...
0
votes
0answers
13 views

What is the thought process to solving anagrams à la Countdown

I'm wondering what the thought process behind solving anagrams is, as in, pulling words out of random letters, like in the game Countdown. I am never very good at this game, and I think it's because ...
16
votes
2answers
5k views

Free online intelligence test with norm table, high reliability, and must be printable?

I am looking for a general intelligence test which meets the following requirements: available online for free there is a table which translates "points" to IQ (I don't want a hidden online ...
8
votes
2answers
515 views

When is it defendable to use manifest instead of latent variables in psychological research?

In psychology, most of the concepts, theories, ideas etc. of interest refer to latent variables, where a latent variable is one that can't be observed directly. Instead, one has to find a manifest ...
0
votes
2answers
54 views

Is cognitive science hypothesis-based or bound to strict experiments involving statistics?

When I look at medical journal articles on Google Scholar I see a lot of stuff based on double blind placebo tests. From this, I've gathered that medicine often performs experiments. I've been in ...
13
votes
3answers
415 views

Longitudinal mobile mood tracking app with random reminders

The goal is to take simple measurements of mood using Likert scale over an extended period of time (e.g. two months). I know there is a large number of mobile apps for tracking mood on every ...
4
votes
1answer
58 views

Button box recommendations for a reaction time study

I am running a language production study, and I want to collect reaction times. I am considering getting a button box, because I understand that my laptop (macbook pro) keyboard is not precise enough ...
3
votes
1answer
38 views

Which ready-made programs can I use for running a preference-rating experiment?

I'd like to run an experiment in which 64 images are presented (1 at a time) and participants rate their preference for the image on a slider scale, and I'm wondering what the best and cheapest way to ...
4
votes
1answer
79 views

What are “Stimulus locked” and “Response locked” in Philiastides & Sajda (2006)

While going through the below-mentioned paper, I came across some plots which were said to be "locked" with reference to either response or stimulus. Does the locking refer to the initiation of the ...
4
votes
2answers
72 views

Extending a 5 point ordinal scale to 9 points while maintaining comparability

We have a lot of data regarding a 5 point ordinal scale with descriptors for each point like 'very little' to 'very much'. I am worried that this scale will show insufficient variance in a further ...
4
votes
2answers
74 views

Is there any (free) program that allows the recording of text input and the speed of input?

I am planning to run a study where participants will been shown questions on a computer monitor and their task is to type their responses in a text box as quickly as they can. Their input and input ...
-1
votes
1answer
60 views

Build model to explain data [closed]

I'm not a psychology student, but I'm doing a subjective experiment which is similar to magnitude estimation: simply measure the effect of different stimulus through a number from 1-10. Now I need to ...
2
votes
3answers
65 views

Why did Richard Feynman appear to recommend replication before manipulation when conducting lab experiments?

In Richard Feynman's classic Cargo Cult Science speech. He talks about a type of scientific error made, where a person takes a previous experimental result for granted when designing an experiment. ...
7
votes
1answer
103 views

Significant baseline, Oddball paradigm

I recently conducted an EEG experiment using a passive Oddball paradigm with two experimental conditions : standard stimuli (occurring with a 85% probability) and deviant stimuli (occurring with a 15% ...
4
votes
2answers
120 views

Is it possible to objectively measure the amount of pleasure a person is experiencing?

I'd like to know if it's possible to quantify somebody's "fun meter". Maybe by measuring the amount of endorphin produced. Because every person is unique, I don't expect that amount to make another ...
5
votes
0answers
60 views

Which study design to use: nested case-control or case-cohort?

I am following a cohort of patients over time from which I am planning to sub-sample a sub-group of patients to pilot a new intervention. The plan is to compare the effectiveness of the new ...
1
vote
1answer
38 views

What is the best way to structure an ethnographic study?

I'm writing an ethnographic study for a human computer interaction module and I understand all the processes of conducting ethnography. I am unsure of how to structure my study. Is it conventional ...
6
votes
1answer
274 views

Reducing ceiling effect with a Likert scale measure

I am designing a psychology study in which the main endpoint is the perceived effectiveness of various medical treatments. In pilot trials, we used a bipolar Likert scale to measure perceived ...
3
votes
1answer
44 views

How can I create a set of comparable symbols of different shapes?

I was thinking about doing a small experiment during university course where participants have to answer a personality quiz and then they have to compare different symbols (like triangles, rectangles ...
9
votes
3answers
1k views

What is the standard way to analyze EEG data in a mismatch negativity paradigm?

I'm running an EEG experiment using a modified auditory mismatch negativity (MMN) design, and I'm wondering if anyone can tell me the best method for data analysis (and recommend any stats ...
3
votes
3answers
78 views

Research software for conducting a task between card sorting and sketch map drawing

I'm doing research in Spatial Cognition and am looking for software which will allow me to conduct the following task: Participants will walk around a space and sit down to a computer task ...
6
votes
1answer
230 views

Descriptive models of different types of consciousness

In behavioral experiments we get the first-person responses of the participants. The third-person perspective is available through the collected data. There is a second-person perspective collected ...
6
votes
2answers
125 views

Are there third party providers of Mechanical Turk psychology experiment services?

For various reasons it can be difficult to run a Mechanical Turk experiment (i.e., you don't have the technical expertise, you don't reside in the United States, etc.) Have any third-party providers ...
2
votes
0answers
146 views

How does a researcher typically go about conducting a survey-based psychological experiment? [closed]

What is a typical approach to conducting a survey-based psychological experiment? There seems to be a host of issues involved; some that seem particularly important are: the appropriate design of ...
4
votes
0answers
157 views

Plot a schematic outline of the brain

I know that I can read, write and analyse different type of brain scanning data using various Medical Imaging Tools available for R. But I am looking for something very simple - a possibility to just ...
7
votes
3answers
962 views

Where to post online psychology studies for participant recruitment?

A common challenge when running psychological studies is getting enough participants. Of course, there are many general strategies for recruiting participants, but I was specifically interested in ...
7
votes
1answer
313 views

What is the relationship between sociology and cognitive sciences?

I want to know what is the relationship between sociology and cognitive sciences. Let me start by short consideration of both: Sociology - well established discipline or a field of research ...
9
votes
1answer
406 views

What were the long-term effects on the participants of the Stanford Prison Experiment?

It has been maintained by Dr. Philip Zimbardo that the experiment has had no long-term harm on the participants. However, one out of the 24 initial participants, who had suffered a breakdown within 36 ...
8
votes
1answer
158 views

How to measure student activity, participation, tendency to ask questions, etc?

We would like to compare students from different education systems on the following variables: tendency to actively participate on lessons tendency to ask questions tendency and experience in ...
6
votes
1answer
166 views

Minimizing Halo Error

I'm working with a dataset wherein participants rate five different attributes of six device variants; the attribute ratings different variants are very tightly correlated, suggesting that this ...
3
votes
2answers
42 views

Are there guidelines in the peer reviewing process on assessing methodology?

Usually an article goes through a peer-review process before it is published, and from what I here it is quite common that the reviewers "demand" some changes. Are there guidelines for peer- ...
5
votes
1answer
160 views

Status of introspection in psychological research today

Historically, psychological understanding was largely gained by introspection: the philosopher observed the workings of his own mind and deduced the principles of the human psyche from that. During ...
4
votes
0answers
44 views

Resource on how to effectively develop within-subjects vignette based study

Background: Where I used to work fellow researchers used to have a task known as the CV task. The task required participants to answer a number of questions about a set of CVs (e.g., is this a good ...
6
votes
2answers
256 views

How should multiple Mechanical Turk research subjects from the same IP address be handled?

I saw this question on Twitter from Jay Van Bavel (@jayvanbavel), and thought it was a good fit for the site. Does anyone find that multiple subjects from the same IP address in their #MTurk ...