The Replication Network
Furthering the Practice of Replication in Economics
Archives
Royal Netherlands Academy of Arts and Sciences Calls for Replications To Be a “Normal Part of Science”
[From the article “Make replication studies a normal part of science,” posted at the website of the Royal Netherlands Academy of Arts and Sciences] “The systematic replication of other researchers’ work should be a normal part of science. That is the…
Read MoreDON’T: Aim for significance. DO: Aim for precision
[From the recent working paper, “The statistical significance filter leads to overoptimistic expectations of replicability” by Vasishth, Mertzen, Jäger, and Gelman posted at PsyArXiv Preprints] “…when power is low, using significance to decide whether to publish a result leads to a proliferation of exaggerated…
Read MoreNational Academies of Science-Funded Committee on Research Reproducibility Holds First Meeting
[From the article “National Academies Launches Study of Research Reproducibility and Replicability” by Will Thomas, posted at FYI: Science Policy News from AIP (American Institute of Physics)] “On Dec. 12 and 13, the National Academies convened the first meeting of…
Read MoreReproducibility Making Progress at Science
[From the article, “Progress in Reproducibility” by Jeremy Berg, Editor-in-Chief Science Journals, published in the 5 January 2018 issue of Science] “Over the past year, we have retracted three papers previously published in Science. The circumstances of these retractions highlight some…
Read MoreNot Everybody Thinks the Emphasis on Reproducibility is a Good Thing
[From the article “Reproducible research: a minority opinion” by Chris Drummond, published in the Journal of Experimental & Theoretical Artificial Intelligence.] “Reproducible research, a growing movement within many scientific fields, including machine learning, would require the code, used to generate…
Read MoreHmmm. Maybe the R-Factor is NOT the answer.
In a recent post, TRN highlighted a recent working paper touting the benefits of something called an “R-Factor.” The R-Factor is a metric that would report — for each published empirical study — the reproducibility rate of that study in…
Read MoreISO-AHOLA: On Reproducibility and Replication in Psychological and Economic Sciences
[This blog is a summary of a longer treatment of the subject that was published in Frontiers in Psychology in June 2017. To read that article, click here.] Physicists have asked “why is there something rather than nothing?” They have theorized that…
Read MoreIN THE NEWS: NY Times (MAY 29, 2017)
[From the article “Science Needs a Solution for the Temptation of Positive Results” by Aaron E. Carroll at The New York Times/The Upshot website] “Science has a reproducibility problem. … As long as the academic environment has incentives for…
Read MoreIf the American Statistical Association Warns About p-Values, and Nobody Hears It, Does It Make a Sound?
[From the article, “The ASA’s p-value statement, one year on”, which appeared in the online journal Significance, a publication of the American Statistical Association] “A little over a year ago now, in March 2016, the American Statistical Association (ASA) took…
Read More
