For questions about experimental and theoretical methods, procedures, and tools used while conducting research in the cognitive sciences.

learn more… | top users | synonyms

1
vote
1answer
39 views

What is the best way to structure an ethnographic study?

I'm writing an ethnographic study for a human computer interaction module and I understand all the processes of conducting ethnography. I am unsure of how to structure my study. Is it conventional ...
6
votes
1answer
380 views

Reducing ceiling effect with a Likert scale measure

I am designing a psychology study in which the main endpoint is the perceived effectiveness of various medical treatments. In pilot trials, we used a bipolar Likert scale to measure perceived ...
3
votes
1answer
45 views

How can I create a set of comparable symbols of different shapes?

I was thinking about doing a small experiment during university course where participants have to answer a personality quiz and then they have to compare different symbols (like triangles, rectangles ...
9
votes
3answers
1k views

What is the standard way to analyze EEG data in a mismatch negativity paradigm?

I'm running an EEG experiment using a modified auditory mismatch negativity (MMN) design, and I'm wondering if anyone can tell me the best method for data analysis (and recommend any stats ...
3
votes
3answers
96 views

Research software for conducting a task between card sorting and sketch map drawing

I'm doing research in Spatial Cognition and am looking for software which will allow me to conduct the following task: Participants will walk around a space and sit down to a computer task ...
6
votes
1answer
257 views

Descriptive models of different types of consciousness

In behavioral experiments we get the first-person responses of the participants. The third-person perspective is available through the collected data. There is a second-person perspective collected ...
6
votes
2answers
160 views

Are there third party providers of Mechanical Turk psychology experiment services?

For various reasons it can be difficult to run a Mechanical Turk experiment (i.e., you don't have the technical expertise, you don't reside in the United States, etc.) Have any third-party providers ...
2
votes
0answers
156 views

How does a researcher typically go about conducting a survey-based psychological experiment? [closed]

What is a typical approach to conducting a survey-based psychological experiment? There seems to be a host of issues involved; some that seem particularly important are: the appropriate design of ...
4
votes
0answers
169 views

Plot a schematic outline of the brain

I know that I can read, write and analyse different type of brain scanning data using various Medical Imaging Tools available for R. But I am looking for something very simple - a possibility to just ...
7
votes
1answer
434 views

What is the relationship between sociology and cognitive sciences?

I want to know what is the relationship between sociology and cognitive sciences. Let me start by short consideration of both: Sociology - well established discipline or a field of research ...
9
votes
1answer
573 views

What were the long-term effects on the participants of the Stanford Prison Experiment?

It has been maintained by Dr. Philip Zimbardo that the experiment has had no long-term harm on the participants. However, one out of the 24 initial participants, who had suffered a breakdown within 36 ...
8
votes
1answer
164 views

How to measure student activity, participation, tendency to ask questions, etc?

We would like to compare students from different education systems on the following variables: tendency to actively participate on lessons tendency to ask questions tendency and experience in ...
6
votes
1answer
241 views

Minimizing Halo Error

I'm working with a dataset wherein participants rate five different attributes of six device variants; the attribute ratings different variants are very tightly correlated, suggesting that this ...
3
votes
2answers
43 views

Are there guidelines in the peer reviewing process on assessing methodology?

Usually an article goes through a peer-review process before it is published, and from what I here it is quite common that the reviewers "demand" some changes. Are there guidelines for peer- ...
5
votes
1answer
214 views

Status of introspection in psychological research today

Historically, psychological understanding was largely gained by introspection: the philosopher observed the workings of his own mind and deduced the principles of the human psyche from that. During ...
4
votes
0answers
48 views

Resource on how to effectively develop within-subjects vignette based study

Background: Where I used to work fellow researchers used to have a task known as the CV task. The task required participants to answer a number of questions about a set of CVs (e.g., is this a good ...
6
votes
2answers
312 views

How should multiple Mechanical Turk research subjects from the same IP address be handled?

I saw this question on Twitter from Jay Van Bavel (@jayvanbavel), and thought it was a good fit for the site. Does anyone find that multiple subjects from the same IP address in their #MTurk ...
5
votes
1answer
646 views

How to use Mechanical Turk for longer studies (i.e., 30 minutes+)?

I'm interested in using Mechanical Turk as a means of recruiting participants for online psychology studies. I have never used it for any research. However, many of my studies take around 30 minutes ...
3
votes
1answer
586 views

Is there a Dot-Probe Paradigm / visual-probe task available online?

Is there an online resource to take the Dot-probe paradigm test> When I searched I could only find a guide to set up a server for such a test. However, I don't have the ability to do that. I'm ...
3
votes
2answers
431 views

How to conduct surveys using facebook?

More and more often I read in papers, that an online survey has been conducted through Facebook. What I have yet to understand is how this can best be done. I understand that Facebook allows the ...
6
votes
1answer
148 views

Do we need a pre-test to compare the effectiveness of two treatments?

Assume, I want to evaluate how effective two teachers are in teaching English to German children. Both teachers have been teaching at the same high school for twenty years, and both use a distinctly ...
4
votes
1answer
65 views

How many samples are there when test subjects come through different recruitment strategies?

Let's assume I want to conduct a survey. To find test subjects, I post an ad in a local newspaper, one on a locally relevant website, distribute flyers in front of the train station, and have managed ...
2
votes
3answers
228 views

Lexical Decision (Web-)App

I want to make a lexical decision experiment, is there any freely available software for this? A Javascript-based webapp would suit me best, as it would run in the browser without the need to install ...
6
votes
3answers
750 views

Analyzing control questions data for a survey

I have an experimental study with a list of demographic and related questions and in order to identify data from participants that were potentially just answering the questions at random (to get ...
1
vote
0answers
35 views

How to identify participants answering online questionnaires who have not paid attention? [duplicate]

I often analyse data that involves participants completing a selection of psychological tests online. A concern with online testing is that some participants may not complete the task conscientiously. ...
2
votes
0answers
48 views

What Quantified Self reserach tools are there for measuring performance while playing videogames?

I've recently became aware that there's a whole field of quantified self - using various methodology to collect data about human performance in an attempt to "quantify" how the human body/brain works. ...
8
votes
2answers
840 views

What articles use structural equation modelling in a meta-analytic context to model mediation?

I'm interested in structural equation modelling (SEM) meta-analysis and its application to modelling mediation relationships. Mike W.-L. Cheung has written a few articles on the topic of SEM ...
7
votes
2answers
333 views

How to estimate an expected effect size for a planned psychology study?

When planning a psychological study, researchers are often asked to formulate an estimate of expected effect sizes for important hypotheses in the study. This might be the expected group mean ...
2
votes
1answer
425 views

How to design research participant recruitment flyer to maximise participant response?

I often supervise student research projects. Often these projects involve recruiting participants by placing one page flyers in strategic locations. The most common scenario is that the flyer is ...
10
votes
2answers
1k views

Public domain scientific intelligence test available for use in research

The IPIP is an example of a public domain scientific personality inventory that can be used for research. Are there any good public domain scientific measures of intelligence? Requirements Do ...
7
votes
1answer
262 views

Analysis of parameter estimates from Ratcliff diffusion model

I would like to analyze a dataset in which subjects' reaction time and error rate have been recorded. In order to account for potential speed-accuracy trade-off I am planning to make use of the ...
3
votes
1answer
2k views

How to compute Chi-square value and degrees of freedom in Excel?

I am trying to understand the statistical test of the chi-square in Excel. I already made the test but I still don't know how to compute the χ² value and what it means, how to compute the degrees of ...
7
votes
2answers
279 views

Best practice to handle double negatives when using the expectancy-value model?

My question is regarding the multiplicative combination rule in the Expectancy-value model developed by Fishbein and Ajzen, and the issues regarding the expectancy value-muddle, or the case of "double ...
4
votes
2answers
549 views

Is the Raspberry Pi capable of operating as a stimulus presentation system for experiments?

I'm outfitting a small behavioural lab with a fiscal-austerity-induced budget. I'm considering trying out a Raspberry pi for individual participant systems. My tentative plan is to run linux and code ...
7
votes
1answer
75 views

How does one study the effect of a dietary supplement on cognition?

I've really enjoyed this talk by Molly Crockett: Beware neuro-bunk. The speaker outlines the limitations of modern neuroscience when accessing the effectiveness of dietary supplements intended to ...
5
votes
1answer
80 views

Are there professional cognitive science test subjects?

I'm interested in how cognitive science experiments are designed and executed. Up until now, all of the papers I've seen dealing with cognition use availability of test subjects as one of the major ...
10
votes
3answers
213 views

Is there a random walk theory that can account for situations with more than two choices?

In the article "Two-stage Dynamic Signal Detection: A Theory of Choice, Decision Time, and Confidence" from 2010 by Pleskac and Busemeyer, a random walk model is presented for situations where a ...
3
votes
2answers
281 views

What skills are required to build simulations of the human brain? [closed]

I want to build a system that has the ability to gather data from the internet in order to build a cognitive model of the human brain. The model should be able to answer the questions required by a ...
8
votes
1answer
685 views

How to measure group differences incorporating reaction time / accuracy trade-off?

In a psychological experiment I am measuring subjects' reaction time as well as their error rate. Now I would like to compare two groups (males & females). There might be a bias in the sense that ...
13
votes
1answer
524 views

Is there a reasonably valid and reliable self-measure of computer literacy?

Measuring computer literacy or skill is important when grouping respondents for usability studies and other Human Computer Interaction studies. But for the life of me I can't find a good, simple but ...
10
votes
2answers
410 views

Is it possible to quantify cognitive bias?

We know that bias exists, and that it affects our judgment and perception. This effect has to do with user's experience in life. That experience is taken care of by the brain, and if you counter a ...
6
votes
2answers
140 views

Utility or software to visualize Neural Network?

I am using Octave to generate a Neural Network with a single hidden layer, and saving it as two CSV files. Is there a utility or software that will load the files and create an image, PDF or HTML ...
6
votes
1answer
148 views

Controlling for response bias in a forced choice memory task

I want to present participants a pair of items $a$ and $b$, each with an association $x$ or $y$. Later on participants will presented with the items singularly, and asked 'what was the association?'. ...
10
votes
5answers
159 views

Web-based tools for documenting studies?

I am interested in how open science could be done in psychology. Are there good web-based tools that could house and share a study? When I say "study" I mean: Lab notes from collecting data Raw ...
7
votes
0answers
78 views

What research exists in the areas of formulating questions and “problem shaping”?

After recalling Eric Steven Raymond and Rick Moen's How to Ask Questions The Smart Way and a discussion in a systems engineering course regarding the impact of the proper formulation of a problem in ...
8
votes
1answer
295 views

What is the test-retest improvement in Block Design test?

Background: My lab is conducting a research on perceptual training. We train participants on different tasks, and assess them pre- and post- training on a large battery of tests. Obviously, people ...
4
votes
1answer
43 views

Is it reasonable to have a factor with only two levels in a carry-over design for an fMRI study?

I'm planning a carry-over design for an fMRI study. To save time, since it seems that I'll need a huge number of trials for my purpose, I'm wondering if it's reasonable to have a matrix 2x3x3, ...
5
votes
1answer
131 views

Inferring relationships between psychological variables in clinical samples and issues in generalisation

Context I sometimes speak to researchers studying the relationship between variables in clinical psychology samples. A typical example is as follows: 100 patients with diagnosed depression many ...
9
votes
3answers
525 views

Neurotransmitter based imaging techniques

All the brain imaging techniques I know fall into two categories: Tracking blood Either by looking at the magnetic (fMRI), or near-infared absorption (diffuse optical imaging, NIRS) properties of ...
7
votes
1answer
180 views

Appropriate metric(s) for quantifying the accuracy gain obtained from averaging dyads of estimates instead of adopting individual estimates?

Background The question relates to research I am doing into the Wisdom of Crowds effect (Galton, 1907; Page, 2007; Surowiecki, 2004), in which an average of the estimates made by individuals proves ...