The Replication Network
Furthering the Practice of Replication in Economics
Archives
REED: The State of Replications in Economics – A 2020 Review (Part 3)
This final instalment on the state of replications in economics, 2020 version, continues the discussion of how to define “replication success” (see here and here for earlier instalments). It then delves further into interpreting the results of a replication. I…
Read MoreWhat Can Stop Bad Science? Open Science and Modified Funding Lotteries
[From the working paper, “Open science and modified funding lotteries can impede the natural selection of bad science” By Paul Smaldino, Matthew Turner, and Pablo Contreras Kallens, posted at OSF Preprints] “…we investigate the influence of three key factors on the…
Read MoreChoosing the Right α: What You Need to Know
[From the article “The quest for an optimal alpha” by Jeff Miller and Rolf Ulrich, published in PLOS One] “The purpose of the present article is to show exactly what is necessary to provide a principled justification for a particular α…
Read MoreMILLER: The Statistical Fundamentals of (Non-)Replicability
“Replicability of findings is at the heart of any empirical science” (Asendorpf, Conner, De Fruyt, et al., 2013, p. 108) The idea that scientific results should be reliably demonstrable under controlled circumstances has a special status in science. In contrast…
Read MoreBattle of the p-Hackers: The HARKer Versus The Accumulator
[From the blog, “Gazing into the Abyss of P-Hacking: HARKing vs. Optional Stopping” by Angelika Stefan and Felix Schönbrodt, posted at Felix Schönbrodt’s website at http://www.nicebread.de%5D “Now, what does a researcher do when confronted with messy, non-significant results? According to several…
Read MoreCOVILLE & VIVALT: Should We Trust Evidence On Development Programs?
[From the working paper, “How Often Should We Believe Positive Results? Assessing the Credibility of Research Findings in Development Economics” by Aidan Coville and Eva Vivalt] Over $140 billion is spent on donor assistance to developing countries annually to promote…
Read MoreREED: The Replication Crisis – A Single Replication Can Make a Big Difference
[This post is based on the paper, “A Primer on the ‘Reproducibility Crisis’ and Ways to Fix It” by the author] In a previous post, I argued that lowering α from 0.05 to 0.005, as advocated by Benjamin et al….
Read MoreREED: Why Lowering Alpha to 0.005 is Unlikely to Help
[This blog is based on the paper, “A Primer on the ‘Reproducibility Crisis’ and Ways to Fix It” by the author] A standard research scenario is the following: A researcher is interested in knowing whether there is a relationship between…
Read More
The Replication Network 
You must be logged in to post a comment.