Archives


A Random Sampling of the State of Transparency and Reproducibility in Social Science Journals

[From the preprint “An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017)” by Tom Hardwicke, Joshua Wallach, Mallory Kidwell, & John Ioannidis posted at MetaArXiv Preprints] “In this study, we evaluated a broad range of…

Read More

Another Journal Adopts the “Pottery Barn Rule”

[From the editorial “SA Editorial About Next Phase of More Open Science” by Michael Seto, published in the journal Sexual Abuse] “It is now widely recognized that there are publication biases toward novel and exciting findings, which has contributed to a replication…

Read More

EBERHARDT: Revisiting the Causal Effect of Democracy on Long-run Development

[This Guest Blog is a repost of a blog by Markus Eberhardt, published at Vox – CEPR Policy Portal] Recent evidence suggests that a country switching to democracy achieves about 20% higher per capita GDP over subsequent decades. This column…

Read More

BÉDÉCARRATS et al.: Lessons from Replicating an RCT

In 2015, Crépon, Devoto, Duflo and Pariente (2015, henceforth CDDP), published the results of a randomized control trial (RCT) in a special issue of the AEJ: Applied Economics. CDDP evaluated the impact of a microcredit program conducted in Morocco with…

Read More

Resources for Incorporating Pre-registration and Replication in the Classroom

Nicole Janz (University of Nottingham, @PolSciReplicate) has a set of great resources for those looking for an example of a pre-registration assignment for undergraduates (this for a political science course). The slides to accompany the assignment are here. The template…

Read More

Huge Replication Project in Social and Behavioral Sciences Looking for Collaborators

[From the press release “Can machines determine the credibility of research claims? The Center for Open Science joins a new DARPA program to find out” from the Center for Open Science] “The Center for Open Science (COS) has been selected…

Read More

Predicting Reproducibility

[From the working paper “Predicting the Replicability of Social Science Lab Experiments” by Altmejd et al., posted at BITSS Preprints] “We have 131 direct replications in our dataset. Each can be judged categorically by whether it succeeded or failed, by a…

Read More

A Course Syllabus in Social Science Replication

[From the syllabus for “POLI 229: Social Science Replication”, taught by Gareth Nellis at the University of California San Diego] “The purpose of this class is to learn how to do cutting-edge empirical research in the social sciences by replicating…

Read More

How to Win Friends (or at Least Not Maximize Enemies) and Influence People When Doing Replications

[From the paper “Good and Bad Replications in Political Science: How Replicators and Original Authors (Should) Talk to Each Other” by Nicole Janz and Jeremy Freese, prepared for presentation at the MZES Open Social Science Conference 2019] “We propose two main…

Read More

BROWN: Is the Evidence We Use in International Development Verifiable? Push Button Replication Provides the Answer

[This post is cross-published on FHI 360’s R&E Search for Evidence blog] There are many debates about the definitions and distinctions for replication research, particularly for internal replication research, which is conducted using the original dataset from an article or study. The…

Read More