The Replication Network
Furthering the Practice of Replication in Economics
Archives
When Peer Review is Too Slow – How About a Red Team?
[Excerpts taken from the article, “Pandemic researchers — recruit your own best critics” by Daniël Lakens, published in Nature] “As researchers rush to find the best ways to quell the COVID-19 crisis, they want to get results out ultra-fast. Preprints…
Read MorePre-Registration as a Severe Testing Device
[Excerpts are taken from the preprint, “The Value of Preregistration for Psychological Science: A Conceptual Analysis” by Daniël Lakens, posted at PsyArXiv Preprints] What is Preregistration For? “If the only goal of a researcher is to prevent bias, it suffices…
Read MoreHave Registered Reports Uncovered Massive Publication Bias? Evidence from Psychology
[Excerpts taken from the preprint, “An excess of positive results: Comparing the standard Psychology literature with Registered Reports” by Anne Scheel, Mitchell Schijen, and Daniël Lakens, posted at PsyArXiv] “Registered Reports (RRs) are a new publication format…Before collecting data, authors…
Read MoreThe Main Reason to Pre-Register Your Research Is…
[Excerpts taken from the article, “The Value of Preregistration for Psychological Science: A Conceptual Analysis”, by Daniël Lakens, posted at PsyArXiv Preprints] “With the rise of the internet it has become feasible to create online registries that ask researchers to…
Read MorePositive Findings are Drastically Lower in Registered Reports
[From slides prepared for the talk “Positive result rates in psychology: Registered Reports compared to the conventional literature” by Mitchell Schijen, Anne Scheel, and Daniël Lakens, presented at Open Science 2019 @ZPID, Trier , and posted at OSF] Conclusion: “Positive result rate in…
Read MoreDon’t Abandon It! Learn (and Teach) to Use It Correctly
[From the paper “The practical alternative to the p-value is the correctly used p-value” by Daniël Lakens, posted at PsyArXiv Preprints] “I do not think it is useful to tell researchers what they want to know. Instead, we should teach…
Read MoreIN THE NEWS: Undark (March 21, 2019)
[From the article “Stats Experts Plead: Just Say No to P-Hacking” by Dalmeet Singh Chawla, published in Undark] “For decades, researchers have used a statistical measure called the p-value — a widely-debated statistic that even scientists find difficult to define — that is…
Read MoreSomebody Asks, How Can A Theory Be Falsified? Twitter Responds
[From the Twitter thread started by @JessieSunPsych] Jessie Sun (@JessieSunPsych) relayed the following question that was raised at a recent Psychology conference: “At what point can a theory be falsified (e.g., if the effect size is d = .02)? We often…
Read MoreRedefining RSS
[From the blog “Justify Your Alpha by Decreasing Alpha Levels as a Function of the Sample Size” by Daniël Lakens, posted at The 20% Statistician] “Testing whether observed data should surprise us, under the assumption that some model of the data is…
Read More
