The Replication Network
Furthering the Practice of Replication in Economics
Category: NEWS & EVENTS
Original Study Finds A Result. Follow-up Studies Fail to Replicate It. The Record is Corrected. Right?
[From the post “A study fails to replicate, but it continues to get referenced as if it had no problems. Communication channels are blocked.” by Andrew Gelman at Statistical Modeling, Causal Inference, and Social Science] “In 2005, Michael Kosfeld, Markus Heinrichs,…
Read MoreA Primer on Pre-Registration
[From the article “The preregistration revolution” by Brian Nosek, Charles Ebersole, Alexander DeHaven, and David Mellor, published in PNAS] “Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. This distinction between postdiction and prediction…
Read MoreMore Pre-Registration, More Null Results
[From the article, “First analysis of ‘pre-registered’ studies shows sharp rise in null findings” by Matthew Warren, published at Nature.com] “Studies that fail to find a positive result are often filed away, never to see the light of day, which…
Read MoreCall for Replication Papers in Empirical Legal Studies
[From the website of Claremont McKenna College, USA] “Claremont McKenna College’s Program on Empirical Legal Studies (PELS) is pleased to announce the second annual Empirical Legal Studies Replication Conference to be held on Friday, April 26, 2019, in Claremont, California.” “…We…
Read MoreJournal of Economics, Race, and Policy Announces a Special Replication Issue
[From the “Call for a special issue of the Journal of Economics, Race, and Policy”] “The Journal of Economics, Race, and Policy (JERP) has a commitment to publishing high-quality, replication research. Accordingly, we are making a call for a special issue…
Read MoreGetting Pre-Registration Right Is Not So Easy
[From the paper, “Ensuring the quality and specificity of preregistrations” by C.L.S. Veldkamp et al., posted at PsyArXiv Preprints] “…we evaluated two preregistration formats that are available on the OSF: a lightweight format that maximizes flexibility for the researcher to…
Read MoreData Sharing in Political Science: Glass Half Empty? Or Full?
[From the article “Data Access, Transparency, and Replication: New Insights from the Political Behavior Literature” by Daniel Stockemer, Sebastian Koehler, and Tobias Lentz, in the October issue of PS: Political Science & Politics] “How many authors of articles published in journal with no mandatory data-access…
Read MoreFailure of Justice: p-Values and the Courts
[From the abstract of the working paper, “US Courts of Appeal cases frequently misinterpret p-values and statistical significance: An empirical study”, by Adrian Barnett and Steve Goodman, posted at Open Science Framework] “We examine how p-values and statistical significance have been interpreted…
Read MoreShould Null Results Require Greater Justification?
In a recent editorial in Management Review Quarterly, the journal invited replications, and put forth the following “Seven Principles of Effective Replication Studies”: #1. “Understand that replication is not reproduction” #2. “Aim to replicate published studies that are relevant” #3….
Read More
