The Replication Network
Furthering the Practice of Replication in Economics
Category: GUEST BLOGS
REED: Replications in Economics are Different from Replications in Psychology, and Other Thoughts
In July 2017, Economics: The Open Access, Open Assessment E-Journal issued a call for papers for a special issue on the practice of replication. The call stated, “This special issue is designed to highlight alternative approaches to doing replications, while…
Read MoreGOODMAN: When You’re Selecting Significant Findings, You’re Selecting Inflated Estimates
Replication researchers cite inflated effect sizes as a major cause of replication failure. It turns out this is an inevitable consequence of significance testing. The reason is simple. The p-value you get from a study depends on the observed effect…
Read MoreMILLER: The Statistical Fundamentals of (Non-)Replicability
“Replicability of findings is at the heart of any empirical science” (Asendorpf, Conner, De Fruyt, et al., 2013, p. 108) The idea that scientific results should be reliably demonstrable under controlled circumstances has a special status in science. In contrast…
Read MoreGOODMAN: Hold the Bus!
A recent news piece in Nature reported in glowing terms on the “first analysis of ‘pre-registered’ studies”, stating that “[pre-registration] seems to work as intended: to reduce publication bias for positive results.” There are reasons to be somewhat dubious about…
Read MoreROODMAN: Hookworms and Malaria and Replications, Oh My!
About 10 years ago, the economist Hoyt Bleakley published two important papers on the impact of health on wealth—more precisely, on the long-term economic impacts of large-scale disease eradication campaigns. In the Quarterly Journal of Economics, “Disease and Development: Evidence…
Read MoreREED: The Devil, the Deep Blue Sea, and Replication
In a recent article (“Between the Devil and the Deep Blue Sea: Tensions Between Scientific Judgement and Statistical Model Selection” published in Computational Brain & Behavior), Danielle Navarro identifies blurry edges around the subject of model selection. The article is a tour…
Read MoreBROWN: How to Conduct a Replication Study – What Not To Do
[This post is based on a presentation by Annette Brown at the Workshop on Reproducibility and Integrity in Scientific Research, held at the University of Canterbury, New Zealand, on October 26, 2018. It is cross-published on FHI 360’s R&E Search for Evidence blog]…
Read MoreCOUPÉ: So You Want To Do a Replication – Here Are Some Things To Think About Before Starting on a Replication Project!
On October 26th, 2018, 3 colleagues and myself organized a workshop on reproducibility and integrity in scientific research at the University of Canterbury, New Zealand. Here are some things you might want to be aware of when thinking about doing…
Read MoreBROWN: How to Conduct a Replication Study – Which Tests, Not Witch Hunts
[This post is based on a presentation by Annette Brown at the Workshop on Reproducibility and Integrity in Scientific Research, held at the University of Canterbury, New Zealand, on October 26, 2018. It is cross-published on FHI 360’s R&E Search for…
Read More
