Cognitive Sciences Stack Exchange is a question and answer site for practitioners, researchers, and students in cognitive science, psychology, neuroscience, and psychiatry. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am a big proponent of reproducible data analysis. In particular, I like when researchers share documents in formats like Sweave and knitr which weave statistical output (e.g., text, tables, and graphs) into a statistical report.

I previously asked for examples of reproducible research of any kind on Stats.SE and for advocating articles in psychology. However, at present I'm particularly interested in complete examples of reproducible meta-analysis.

Meta-analyses involve a number of steps. Summary statistics and study information is extracted from source studies. Various transformations and steps are applied to the data (e.g., corrections for reliability, conversion from one statistic to another, etc.). Various models are tested; tables and graphs are produced. Some journals are requiring that researchers supply tables of data used (e.g., references used, summary statistics). However, I can see meta-analysis as an area which could benefit from a more comprehensive reproducible approach: (1) it would permit greater inspection of specific methods used; (2) researchers could more easily build on the analyses used.

Thus, my questions:

  • Are there any complete examples of reproducible meta-analysis preferably in psychology or a related discipline?
  • Is there any published advocacy for reproducible meta-analysis?
share|improve this question

I have started to see a fair bit of discussion about reproducible meta-analysis.

Tim Churches seems to have a github repository with a few examples of meta-analyses in R.

See in particular the public health example:

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.