# Tag Info

7

Answer based on your original depression example Note that this answer was originally written based on your initial example, where you asked: Assume, I have developed a new intervention for people with light depression. I want to compare the effectiveness of this intervention (E) with an existing intervention (C). For this, I recruit test subjects ...

6

Sites: The social psychology network has a page for posting online social psychology studies. There are a range of requirements. In particular, it needs to be closely related to social or personality psychology. SampleSize Subreddit is a community dedicated to completing surveys. They like it when results will be provided at study completion. It has close ...

6

Experimental psychologists seem quite happy working with single item ad hoc self-report scales, physiological measures, etc. with very little psychometrical assessment so even before talking about a full-fledged latent variable modeling approach, confirmatory factor analysis and the like you might want to wonder why they appear relatively unconcerned with ...

6

Does the locking refer to the initiation of the measurement with starting cue being being the presentation of stimulus or the response of the subject? More or less, yes. When measuring brain activity, you usually make a long, continuous recording during which you expose your study participants to a task over and over again. There's a lot of noise ...

5

The primary difference is two-fold: 1) Methods : Social sciences use mostly qualitative methods and content analysis, psychology and cognitive sciences use quantitative methods and statistical analysis. The one basic standard tool in psychology and cognitive sciences is the laboratory experiment, while social sciences usually collect data in the field. 2) ...

5

In Germany, most students and many researchers conduct their online surveys using the portals soscisurvey.de and unipark.info. Soscisurvey.de includes a so-called "panel", a pool of currently more than 100.000 persons interested in partaking in surveys. To use the panel, you do not have to host your survey on soscisurvey.de, but you must apply a month in ...

5

Murphy & Cleveland (1995) mention, that a good way to reduce rater errors in general is to inform raters of the existence and nature of these errors and then to simply urge to avoid them. While this reduces rater errors, it also decreases the accuracy of ratings, though. These findings come from the literature on performance assessment, where halo is ...

5

It's an interesting question. Here are a bunch of thoughts that came to my mind for why researchers might focus on observed variables. Many researchers report reliability and observed relationships between variables. By adopting a few assumptions, the reader can estimate what the latent relationships would be (see for example, the formula for correction of ...

5

How many trials do you have per condition? With a small number of trials in the deviant condition, and a small number of participants, these things can happen. The ISI would not cause this per se, however, have you considered looking at effects of the previous trial? You can analyze the baseline intervals as a function of what type the previous trial was, ...

5

First off, what button-box you use is going to be influenced by what software you're using to run the experiment, so ideally you should specify that. The PST serial response box is probably the industry standard, and is what we have in my lab, although a lot of that is probably down to it coming from the makers of EPrime. EPrime doesn't work on OSX ...

4

There is now an app available on the iPad offering a cognitive test battery. It is a commercial application but fairly inexpensive. Joggle Research adapts several widely validated tests to the touch platform. Test result data is stored and instantly accessible on a cloud service (with a free tier to try it out). Some here have noted potential limitations ...

4

I'll address just the first of your three sub-questions, the others have been answered by Chuck Sherrington. What does it mean when you get two or more Mechanical Turk participants in a study with the same IP address? IP addresses are rarely "fixed" to an individual computer. Each provider has a range of IP addresses available and assigns them to ...

4

Here are a few thoughts: Work out whether the construct has ceiling effects or whether it is a measurement issue: You need to consider whether people actually discriminate between the rated objects. Multiple items per rated object: For each medical treatment you could ask participants to answer several questions. You could then take the mean of their ...

3

Okay, let's see if I can tackle this... Almost all of my answer to this question is being drawn from the first chapter of Michael Posner's Foundations of Cognitive Science. I, myself, am just a rising freshman at a decently ranked American university who has been studying the cognitive science literature on my own for the last few years. Here I will ...

3

I get the impression that good journal editors will get at least one reviewer who is skilled in the methodology used in the paper. The importance of this reviewer role would presumably vary with the statistical or other methodological complexity of the paper. That said, reviewing is well known to be imperfect particularly when it comes to checking all the ...

3

This does not really answer your question (because it doesn't deal in detail with methodological issues), but there is a nice journal article that deals with problems of the peer review process in general by evaluating "great scientific works of the past" from the perspective of current social sciences: Trafimov, D., & Rice, S. (2009). What if social ...

3

Since this is a relatively new problem for behavioral researchers, I don't know that there is a common consensus. I found two articles, one of which was a study that had used crowdsourcing for medical pictograms. Their approach was as follows: First, we checked for duplicate records. After sorting the data by participants’ IP addresses, we found ...

3

I imagine most software designed for creating psychological experiments will be able to do this. (e.g., EPrime, Direct RT, MediaLab, SuperLab, etc.). I've mainly used Inquisit to record responses and response times. These are all proprietary options. You could also readily implement a trial interface with a textbox and response times in standard programming ...

3

I've just started reading up on Mechanical Turk. This is a summary of some of the tips that I've found. Admittedly, most of it applies generally to psychological experiments, and not specifically to longer ones. David Sharek discusses his workflow which explicitly includes studies in the 30 minute range. Thus, this post is one of the most relevant for ...

3

As mentioned in the other comments, ANOVA is problematic when mixing types of predictor variables. (Generalized) mixed effects models are gaining popularity these days and actually provide a very convenient way for modelling such things. A paper demonstrating the efficacy of this approach as well as giving a tutorial-like introduction is: Davidson, D. J. ...

3

I'm currently working on a similar project and wanted to share some info. A recent paper reports a similar concern but also a solution via the iPad's built in mic. http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0057364 "The touch screen alone cannot be used for high temporal resolution measurements because of the inherent delay ...

3

Presumably to have symbols with the same area but different shapes, you could do a little geometry to work out relevant angles and sides. Then in any reasonable drawing package you could draw the shapes and check that they have appropriate angles. Programming drawing packages might also make life easier, but I don't have much experience with these (e.g., ...

3

It's a little unclear what you're asking. In general, psychologists try to build models that are parsimonious; this often means only introducing new parameters (particularly free parameters) into a model when they are absolutely necessary. You are right that with a sufficient number of free parameters, one can build a model that fits the data perfectly. But ...

3

This is a very general answer to your question. And let me say upfront that I don't know about any measurement instruments for pleasure. However, I would like to emphasize that pleasure, just as about any psychological phenomenon, has to be considered a latent construct. What this means is that it cannot be measured directly, but only indirectly and ...

3

See this question on comparing scales with different response scales. In short, you have to do it with care. A good option for ensuring comparability is to get a sample of participants to provide responses on both response scales in order to see how they relate. This could then be used to create a conversion scale. More generally, there is a large debate ...

3

You may want to have a look at our 40 questions to date that use the statistics tag. These may demonstrate the complexity of our applications in statistics. Wikipedia also has an entire psychological statistics page that seems intended to index other pages on specific applications. Psychological experiments commonly test null hypotheses (e.g., $H_0$: the ...

3

I'm still not clear on what is your question. You ask whether psychology and medicine differ in some aspect of their methodological approach. Experiments are typically analysed using statistics to test hypotheses. So those things all go together. Psychology and medicine both perform controlled experiments and observational studies. They both perform ...

2

The best thing I can find is somebody's side project on experience sampling (the code is on github), so not sure if it's being maintained or anything, but it does appear to do exactly what you want.

Only top voted, non community-wiki answers of a minimum length are eligible