The Replication Network
Furthering the Practice of Replication in Economics
Archives
GOODMAN & REED: A Friendly Debate about Pre-Registration
Background: Nat Goodman is generally pessimistic about the benefits of pre-registration. Bob Reed is generally optimistic about pre-registration. What follows is a back-and-forth dialogue about what each likes and dislikes about pre-registration. [GOODMAN, Opening Statement] We need to remember that…
Read MoreIn Two Decades, Will We Look Back And Wonder At All the Flawed Research?
[From the article, “Rein in the four horsemen of irreproducibility”, by Dorothy Bishop, published in Nature] “More than four decades into my scientific career, I find myself an outlier among academics of similar age and seniority: I strongly identify with…
Read MoreDisagreeing With Disagreeing About Abandoning Statistical Significance
[From the preprint “Abandoning statistical significance is both sensible and practical” by Valentin Amrhein, Andrew Gelman, Sander Greenland, and Blakely McShane, available at PeerJ Preprints] “Dr Ioannidis writes against our proposals to abandon statistical significance…” “…we disagree that a statistical…
Read MoreIN THE NEWS: Undark (March 21, 2019)
[From the article “Stats Experts Plead: Just Say No to P-Hacking” by Dalmeet Singh Chawla, published in Undark] “For decades, researchers have used a statistical measure called the p-value — a widely-debated statistic that even scientists find difficult to define — that is…
Read MoreWhen Trying to Explain p-Values, Maybe Try This?
[From the blog “P-values 101: An attempt at an intuitive but mathematically correct explanation” by Xenia Schmalz, posted at Xenia Schmalz’s blog] “…what exactly are p-values, what is p-hacking, and what does all of that have to do with the replication crisis?…
Read MoreHow Pre-Registration Can Lead to Higher-Powered Studies and Increase Reproducibility
[From the paper “Preregistration and reproducibility” by Eirik Strømland, forthcoming in the Journal of Economic Psychology] “I present a simple model in which the research community is populated by agents who may report their results unconditionally or conditionally on statistical…
Read MoreSearching for Specification Searching in Development Impact Evaluations
[From the paper “Specification Searching and Significance Inflation AcrossTime, Methods and Disciplines” by Eva Vivalt, published in the Oxford Bulletin of Economics and Statistics] “…This paper leverages a database of impact evaluation results collected by AidGrade, a US non-profit organization that…
Read MoreIN THE NEWS: FiveThirtyEight (December 6, 2018)
[From the article “Psychology’s Replication Crisis Has Made The Field Better” by Christie Aschwanden, published at FiveThirtyEight] “The replication crisis arose from a series of events that began around 2011, the year that social scientists Uri Simonsohn, Leif Nelson and…
Read MoreBattle of the p-Hackers: The HARKer Versus The Accumulator
[From the blog, “Gazing into the Abyss of P-Hacking: HARKing vs. Optional Stopping” by Angelika Stefan and Felix Schönbrodt, posted at Felix Schönbrodt’s website at http://www.nicebread.de%5D “Now, what does a researcher do when confronted with messy, non-significant results? According to several…
Read MoreTired of Candy Crush? Try the New and Improved p-Hacker App!
[From Felix Schönbrodt’s Twitter account, @nicebread303] “The p-hacker app just UNLOCKED the most requested PRO FEATURE: Subgroup analyses!!!” “Check if you can find the effect for, say, young males. This is soo theoretically interesting. Now you can get the p-hacking…
Read More
