The Replication Network
Furthering the Practice of Replication in Economics
Category: GUEST BLOGS
COUPÉ: So You Want To Do a Replication – Here Are Some Things To Think About Before Starting on a Replication Project!
On October 26th, 2018, 3 colleagues and myself organized a workshop on reproducibility and integrity in scientific research at the University of Canterbury, New Zealand. Here are some things you might want to be aware of when thinking about doing…
Read MoreBROWN: How to Conduct a Replication Study – Which Tests, Not Witch Hunts
[This post is based on a presentation by Annette Brown at the Workshop on Reproducibility and Integrity in Scientific Research, held at the University of Canterbury, New Zealand, on October 26, 2018. It is cross-published on FHI 360’s R&E Search for…
Read MoreREED: An Update on the Progress of Replications in Economics
[This post is based on a presentation by Bob Reed at the Workshop on Reproducibility and Integrity in Scientific Research, held at the University of Canterbury, New Zealand, on October 26, 2018] In 2015, Duvendack, Palmer-Jones, and Reed (DPJ&R) published…
Read MoreVLAEMINCK & PODKRAJAC: Do Economics Journals Enforce Their Data Policies?
In the past, the findings of numerous replication studies in economics have raised serious concerns regarding the credibility and reliability of published applied economic research. Literature suggests several explanations for these findings: Beyond missing incentives and rewards for the disclosure…
Read MoreMUELLER-LANGER et al.: Replication in Economics
[This blog is based on the article “ Replication studies in economics—How many and which papers are chosen for replication, and why?” by Frank Mueller-Langer, Benedikt Fecher, Dietmar Harhoff, and Gert Wagner, published in the journal Research Policy] Academia is…
Read MoreHIRSCHAUER et al.: Why replication is a nonsense exercise if we stick to dichotomous significance thinking and neglect the p-value’s sample-to-sample variability
[This blog is based on the paper “Pitfalls of significance testing and p-value variability: An econometrics perspective” by Norbert Hirschauer, Sven Grüner, Oliver Mußhoff, and Claudia Becker, Statistics Surveys 12(2018): 136-172.] Replication studies are often regarded as the means to…
Read MoreVASISHTH: The Statistical Significance Filter Leads To Overoptimistic Expectations of Replicability
[This blog draws on the article “The statistical significance filter leads to overoptimistic expectations of replicability”, authored by Shravan Vasishth, Daniela Mertzen, Lena A. Jäger, and Andrew Gelman, published in the Journal of Memory and Language, 103, 151-175, 2018. An open…
Read MoreBROWN, LAMBERT, & WOJAN: At the Intersection of Null Findings and Replication
Replication is an important topic in economic research or any social science for that matter. This issue is most important when an analysis is undertaken to inform decisions by policymakers. Drawing inferences from null or insignificant finding is particularly problematic…
Read MoreREED: How “Open Science” Can Discourage Good Science, And What Journals Can Do About It
In a recent tweet (or series of tweets) Kaitlyn Werner shares her experience of having a paper rejected after she posted all her data and code and submitted her paper to a journal. The journal rejected the paper because a…
Read More
