Archives


Resources for Incorporating Pre-registration and Replication in the Classroom

Nicole Janz (University of Nottingham, @PolSciReplicate) has a set of great resources for those looking for an example of a pre-registration assignment for undergraduates (this for a political science course). The slides to accompany the assignment are here. The template…

Read More

Huge Replication Project in Social and Behavioral Sciences Looking for Collaborators

[From the press release “Can machines determine the credibility of research claims? The Center for Open Science joins a new DARPA program to find out” from the Center for Open Science] “The Center for Open Science (COS) has been selected…

Read More

Predicting Reproducibility

[From the working paper “Predicting the Replicability of Social Science Lab Experiments” by Altmejd et al., posted at BITSS Preprints] “We have 131 direct replications in our dataset. Each can be judged categorically by whether it succeeded or failed, by a…

Read More

A Course Syllabus in Social Science Replication

[From the syllabus for “POLI 229: Social Science Replication”, taught by Gareth Nellis at the University of California San Diego] “The purpose of this class is to learn how to do cutting-edge empirical research in the social sciences by replicating…

Read More

How to Win Friends (or at Least Not Maximize Enemies) and Influence People When Doing Replications

[From the paper “Good and Bad Replications in Political Science: How Replicators and Original Authors (Should) Talk to Each Other” by Nicole Janz and Jeremy Freese, prepared for presentation at the MZES Open Social Science Conference 2019] “We propose two main…

Read More

BROWN: Is the Evidence We Use in International Development Verifiable? Push Button Replication Provides the Answer

[This post is cross-published on FHI 360’s R&E Search for Evidence blog] There are many debates about the definitions and distinctions for replication research, particularly for internal replication research, which is conducted using the original dataset from an article or study. The…

Read More

Using Bayesian Reanalysis to Decide Which Studies to Replicate

[From the preprint “When and Why to Replicate: As Easy as 1, 2, 3?” by Sarahanne Field, Rink Hoekstra, Laura Bringmann, and Don van Ravenzwaaij, posted at PsyArXiv Preprints.] “…a flood of new replications of existing research have reached the…

Read More

Making Meta-Analyses More Replicable

[From the article “Automatic extraction of quantitative data from ClinicalTrials.gov to conduct meta-analyses” by Richeek Pradhan et al., published in the Journal of Clinical Epidemiology] “Systematic reviews and meta-analyses are labor-intensive and time-consuming. Automated extraction of quantitative data from primary…

Read More

Oh No! Not Again!

[From the article “Push button replication: Is impact evaluation evidence for international development verifiable?” by Benjamin Wood, Rui Müller, and Annette Brown, published in PLoS ONE] “…We drew a sample of articles from the ten journals that published the most…

Read More

Excellent, Cross-Disciplinary Overview of Scientific Reproducibility in the Stanford Encyclopedia of Philosophy

[From the article “Reproducibility of Scientific Results”, by Fiona Fidler and John Wilcox, published in The Stanford Encyclopedia of Philosophy] “This review consists of four distinct parts. First, we look at the term “reproducibility” and related terms like “repeatability” and…

Read More