For questions about experimental and theoretical methods, procedures, and tools used while conducting research in the cognitive sciences.

learn more… | top users | synonyms

0
votes
0answers
7 views

What is the thought process to solving anagrams à la Countdown

I'm wondering what the thought process behind solving anagrams is, as in, pulling words out of random letters, like in the game Countdown. I am never very good at this game, and I think it's because ...
0
votes
2answers
52 views

Is cognitive science hypothesis-based or bound to strict experiments involving statistics?

When I look at medical journal articles on Google Scholar I see a lot of stuff based on double blind placebo tests. From this, I've gathered that medicine often performs experiments. I've been in ...
4
votes
1answer
41 views

Button box recommendations for a reaction time study

I am running a language production study, and I want to collect reaction times. I am considering getting a button box, because I understand that my laptop (macbook pro) keyboard is not precise enough ...
4
votes
1answer
46 views

What are “Stimulus locked” and “Response locked” in Philiastides & Sajda (2006)

While going through the below-mentioned paper, I came across some plots which were said to be "locked" with reference to either response or stimulus. Does the locking refer to the initiation of the ...
3
votes
1answer
32 views

Which ready-made programs can I use for running a preference-rating experiment?

I'd like to run an experiment in which 64 images are presented (1 at a time) and participants rate their preference for the image on a slider scale, and I'm wondering what the best and cheapest way to ...
4
votes
2answers
54 views

Extending a 5 point ordinal scale to 9 points while maintaining comparability

We have a lot of data regarding a 5 point ordinal scale with descriptors for each point like 'very little' to 'very much'. I am worried that this scale will show insufficient variance in a further ...
2
votes
2answers
98 views

Name needed for psychological practice which uses objects that represent humans [dolls/pictures/etc.] during patient treatment

What is the name of practice/method (if such exists) where psychologist uses a doll (or any other form of human-being representation) for patient to talk to? I believe I have seen it in a movie or ...
2
votes
0answers
64 views

Where to recruit and run experiments using Inquisit?

My team and I are trying to use Inquisit for a reaction-time based experiment looking at attentional bias. However, with the no download policy on Mturk and CrowdFlower, we don't know a good site to ...
2
votes
3answers
60 views

Why did Richard Feynman appear to recommend replication before manipulation when conducting lab experiments?

In Richard Feynman's classic Cargo Cult Science speech. He talks about a type of scientific error made, where a person takes a previous experimental result for granted when designing an experiment. ...
7
votes
1answer
96 views

Significant baseline, Oddball paradigm

I recently conducted an EEG experiment using a passive Oddball paradigm with two experimental conditions : standard stimuli (occurring with a 85% probability) and deviant stimuli (occurring with a 15% ...
4
votes
2answers
106 views

Is it possible to objectively measure the amount of pleasure a person is experiencing?

I'd like to know if it's possible to quantify somebody's "fun meter". Maybe by measuring the amount of endorphin produced. Because every person is unique, I don't expect that amount to make another ...
5
votes
0answers
56 views

Which study design to use: nested case-control or case-cohort?

I am following a cohort of patients over time from which I am planning to sub-sample a sub-group of patients to pilot a new intervention. The plan is to compare the effectiveness of the new ...
1
vote
1answer
37 views

What is the best way to structure an ethnographic study?

I'm writing an ethnographic study for a human computer interaction module and I understand all the processes of conducting ethnography. I am unsure of how to structure my study. Is it conventional ...
-1
votes
1answer
56 views

Build model to explain data [closed]

I'm not a psychology student, but I'm doing a subjective experiment which is similar to magnitude estimation: simply measure the effect of different stimulus through a number from 1-10. Now I need to ...
3
votes
1answer
44 views

How can I create a set of comparable symbols of different shapes?

I was thinking about doing a small experiment during university course where participants have to answer a personality quiz and then they have to compare different symbols (like triangles, rectangles ...
6
votes
1answer
222 views

Reducing ceiling effect with a Likert scale measure

I am designing a psychology study in which the main endpoint is the perceived effectiveness of various medical treatments. In pilot trials, we used a bipolar Likert scale to measure perceived ...
3
votes
3answers
70 views

Research software for conducting a task between card sorting and sketch map drawing

I'm doing research in Spatial Cognition and am looking for software which will allow me to conduct the following task: Participants will walk around a space and sit down to a computer task ...
6
votes
2answers
85 views

Are there third party providers of Mechanical Turk psychology experiment services?

For various reasons it can be difficult to run a Mechanical Turk experiment (i.e., you don't have the technical expertise, you don't reside in the United States, etc.) Have any third-party providers ...
6
votes
1answer
240 views

What is the relationship between sociology and cognitive sciences?

I want to know what is the relationship between sociology and cognitive sciences. Let me start by short consideration of both: Sociology - well established discipline or a field of research ...
9
votes
1answer
334 views

What were the long-term effects on the participants of the Stanford Prison Experiment?

It has been maintained by Dr. Philip Zimbardo that the experiment has had no long-term harm on the participants. However, one out of the 24 initial participants, who had suffered a breakdown within 36 ...
3
votes
2answers
41 views

Are there guidelines in the peer reviewing process on assessing methodology?

Usually an article goes through a peer-review process before it is published, and from what I here it is quite common that the reviewers "demand" some changes. Are there guidelines for peer- ...
6
votes
1answer
220 views

Descriptive models of different types of consciousness

In behavioral experiments we get the first-person responses of the participants. The third-person perspective is available through the collected data. There is a second-person perspective collected ...
4
votes
0answers
39 views

Resource on how to effectively develop within-subjects vignette based study

Background: Where I used to work fellow researchers used to have a task known as the CV task. The task required participants to answer a number of questions about a set of CVs (e.g., is this a good ...
4
votes
1answer
139 views

Status of introspection in psychological research today

Historically, psychological understanding was largely gained by introspection: the philosopher observed the workings of his own mind and deduced the principles of the human psyche from that. During ...
6
votes
3answers
610 views

Where to post online psychology studies for participant recruitment?

A common challenge when running psychological studies is getting enough participants. Of course, there are many general strategies for recruiting participants, but I was specifically interested in ...
5
votes
2answers
187 views

How should multiple Mechanical Turk research subjects from the same IP address be handled?

I saw this question on Twitter from Jay Van Bavel (@jayvanbavel), and thought it was a good fit for the site. Does anyone find that multiple subjects from the same IP address in their #MTurk ...
5
votes
1answer
129 views

Minimizing Halo Error

I'm working with a dataset wherein participants rate five different attributes of six device variants; the attribute ratings different variants are very tightly correlated, suggesting that this ...
7
votes
2answers
411 views

When is it defendable to use manifest instead of latent variables in psychological research?

In psychology, most of the concepts, theories, ideas etc. of interest refer to latent variables, where a latent variable is one that can't be observed directly. Instead, one has to find a manifest ...
3
votes
1answer
413 views

Is there a Dot-Probe Paradigm / visual-probe task available online?

Is there an online resource to take the Dot-probe paradigm test> When I searched I could only find a guide to set up a server for such a test. However, I don't have the ability to do that. I'm ...
5
votes
1answer
125 views

Do we need a pre-test to compare the effectiveness of two treatments?

Assume, I want to evaluate how effective two teachers are in teaching English to German children. Both teachers have been teaching at the same high school for twenty years, and both use a distinctly ...
3
votes
1answer
59 views

How many samples are there when test subjects come through different recruitment strategies?

Let's assume I want to conduct a survey. To find test subjects, I post an ad in a local newspaper, one on a locally relevant website, distribute flyers in front of the train station, and have managed ...
4
votes
2answers
60 views

Is there any (free) program that allows the recording of text input and the speed of input?

I am planning to run a study where participants will been shown questions on a computer monitor and their task is to type their responses in a text box as quickly as they can. Their input and input ...
3
votes
2answers
321 views

How to conduct surveys using facebook?

More and more often I read in papers, that an online survey has been conducted through Facebook. What I have yet to understand is how this can best be done. I understand that Facebook allows the ...
5
votes
1answer
444 views

How to use Mechanical Turk for longer studies (i.e., 30 minutes+)?

I'm interested in using Mechanical Turk as a means of recruiting participants for online psychology studies. I have never used it for any research. However, many of my studies take around 30 minutes ...
0
votes
0answers
32 views

How to identify participants answering online questionnaires who have not paid attention? [duplicate]

I often analyse data that involves participants completing a selection of psychological tests online. A concern with online testing is that some participants may not complete the task conscientiously. ...
2
votes
0answers
43 views

What Quantified Self reserach tools are there for measuring performance while playing videogames?

I've recently became aware that there's a whole field of quantified self - using various methodology to collect data about human performance in an attempt to "quantify" how the human body/brain works. ...
6
votes
0answers
87 views

Are there any rules about masking?

I am currently programming an experiment where participants have to do a divided visual field task. In a paper about the correct methodology about these tasks, it is said that you should use a ...
2
votes
1answer
286 views

How to design research participant recruitment flyer to maximise participant response?

I often supervise student research projects. Often these projects involve recruiting participants by placing one page flyers in strategic locations. The most common scenario is that the flyer is ...
7
votes
2answers
288 views

How to estimate an expected effect size for a planned psychology study?

When planning a psychological study, researchers are often asked to formulate an estimate of expected effect sizes for important hypotheses in the study. This might be the expected group mean ...
-2
votes
2answers
150 views

Should questions in psychology always be objective questions? [closed]

Is it correct that a subjective question is not a psychological question i.e. for a question to be psychological it must be an objective question e.g. about an objective probability or so instead of ...
3
votes
1answer
1k views

How to compute Chi-square value and degrees of freedom in Excel?

I am trying to understand the statistical test of the chi-square in Excel. I already made the test but I still don't know how to compute the χ² value and what it means, how to compute the degrees of ...
5
votes
3answers
463 views

Analyzing control questions data for a survey

I have an experimental study with a list of demographic and related questions and in order to identify data from participants that were potentially just answering the questions at random (to get ...
2
votes
3answers
164 views

Lexical Decision (Web-)App

I want to make a lexical decision experiment, is there any freely available software for this? A Javascript-based webapp would suit me best, as it would run in the browser without the need to install ...
4
votes
2answers
452 views

Is the Raspberry Pi capable of operating as a stimulus presentation system for experiments?

I'm outfitting a small behavioural lab with a fiscal-austerity-induced budget. I'm considering trying out a Raspberry pi for individual participant systems. My tentative plan is to run linux and code ...
7
votes
2answers
247 views

Best practice to handle double negatives when using the expectancy-value model?

My question is regarding the multiplicative combination rule in the Expectancy-value model developed by Fishbein and Ajzen, and the issues regarding the expectancy value-muddle, or the case of "double ...
7
votes
1answer
74 views

How does one study the effect of a dietary supplement on cognition?

I've really enjoyed this talk by Molly Crockett: Beware neuro-bunk. The speaker outlines the limitations of modern neuroscience when accessing the effectiveness of dietary supplements intended to ...
5
votes
1answer
74 views

Are there professional cognitive science test subjects?

I'm interested in how cognitive science experiments are designed and executed. Up until now, all of the papers I've seen dealing with cognition use availability of test subjects as one of the major ...
7
votes
1answer
218 views

Analysis of parameter estimates from Ratcliff diffusion model

I would like to analyze a dataset in which subjects' reaction time and error rate have been recorded. In order to account for potential speed-accuracy trade-off I am planning to make use of the ...
8
votes
1answer
473 views

How to measure group differences incorporating reaction time / accuracy trade-off?

In a psychological experiment I am measuring subjects' reaction time as well as their error rate. Now I would like to compare two groups (males & females). There might be a bias in the sense that ...
13
votes
3answers
380 views

Longitudinal mobile mood tracking app with random reminders

The goal is to take simple measurements of mood using Likert scale over an extended period of time (e.g. two months). I know there is a large number of mobile apps for tracking mood on every ...