Archives


DON’T: Aim for significance. DO: Aim for precision

[From the recent working paper, “The statistical significance filter leads to overoptimistic expectations of replicability” by Vasishth, Mertzen, Jäger, and Gelman posted at PsyArXiv Preprints] “…when power is low, using significance to decide whether to publish a result leads to a proliferation of exaggerated…

Read More

National Academies of Science-Funded Committee on Research Reproducibility Holds First Meeting

[From the article “National Academies Launches Study of Research Reproducibility and Replicability” by Will Thomas, posted at FYI: Science Policy News from AIP (American Institute of Physics)] “On Dec. 12 and 13, the National Academies convened the first meeting of…

Read More

Reproducibility Making Progress at Science

[From the article, “Progress in Reproducibility” by Jeremy Berg, Editor-in-Chief  Science Journals, published in the 5 January 2018 issue of Science] “Over the past year, we have retracted three papers previously published in Science. The circumstances of these retractions highlight some…

Read More

Not Everybody Thinks the Emphasis on Reproducibility is a Good Thing

[From the article “Reproducible research: a minority opinion” by Chris Drummond, published in the Journal of Experimental & Theoretical Artificial Intelligence.] “Reproducible research, a growing movement within many scientific fields, including machine learning, would require the code, used to generate…

Read More

IN THE NEWS: Wired (November 14, 2017)

[From the article “The Dismal Science Remains Dismal, Say Scientists” by Adam Rogers at wired.com] “WHEN HRISTOS DOUCOULIAGOS was a young economist in the mid-1990s, he got interested in all the ways economics was wrong about itself—bias, underpowered research, statistical shenanigans. Nobody wanted…

Read More

Hmmm. Maybe the R-Factor is NOT the answer.

In a recent post, TRN highlighted a recent working paper touting the benefits of something called an “R-Factor.” The R-Factor is a metric that would report — for each published empirical study — the reproducibility rate of that study in…

Read More

ISO-AHOLA: On Reproducibility and Replication in Psychological and Economic Sciences

[This blog is a summary of a longer treatment of the subject that was published in Frontiers in Psychology in June 2017.  To read that article, click here.] Physicists have asked “why is there something rather than nothing?” They have theorized that…

Read More

IN THE NEWS: NY Times (MAY 29, 2017)

[From the article “Science Needs a Solution for the Temptation of Positive Results” by Aaron E. Carroll at The New York Times/The Upshot website]   “Science has a reproducibility problem. … As long as the academic environment has incentives for…

Read More

If the American Statistical Association Warns About p-Values, and Nobody Hears It, Does It Make a Sound?

[From the article, “The ASA’s p-value statement, one year on”, which appeared in the online journal Significance, a publication of the American Statistical Association] “A little over a year ago now, in March 2016, the American Statistical Association (ASA) took…

Read More

“Rigor Mortis”: The Retraction Watch Interview with Richard Harris

Reproducibility is not just an issue in economics.  In a new book, “Rigor Mortis: How Sloppy Science Creates Worthless Cures, Crushes Hope, and Wastes Billions”, NPR science reporter Richard Harris describes and elaborates on the problem of irreproducibility for medical…

Read More