Archives


Oh No! Not Zebra Finches Too!

[From the article, “Replication Failures Highlight Biases in Ecology and Evolution Science” by Yao-Hua Law, published at http://www.the-scientist.com%5D  “As robust efforts fail to reproduce findings of influential zebra finch studies from the 1980s, scientists discuss ways to reduce bias in such…

Read More

Making Replications Mainstream: It Takes a Research Community

Just in case you missed it, the latest issue of Behavioral and Brain Sciences includes an article by Rolf Zwaan, Alexander Etz, Richard Lucas, and Brent Donnellan entitled “Making Replications Mainstream”. It is something of a tour-de-force by four prominent…

Read More

Solving the Replication Crisis: Audits Would Help

[From the article “Randomly auditing research labs could be an affordable way to improve research quality: A simulation study” by Adrian Barnett, Pauline Zardo, and Nicholas Graves, published at PLoS One] “The “publish or perish” incentive drives many researchers to increase the…

Read More

Royal Netherlands Academy of Arts and Sciences Calls for Replications To Be a “Normal Part of Science”

[From the article “Make replication studies a normal part of science,” posted at the website of the Royal Netherlands Academy of Arts and Sciences] “The systematic replication of other researchers’ work should be a normal part of science. That is the…

Read More

DON’T: Aim for significance. DO: Aim for precision

[From the recent working paper, “The statistical significance filter leads to overoptimistic expectations of replicability” by Vasishth, Mertzen, Jäger, and Gelman posted at PsyArXiv Preprints] “…when power is low, using significance to decide whether to publish a result leads to a proliferation of exaggerated…

Read More

National Academies of Science-Funded Committee on Research Reproducibility Holds First Meeting

[From the article “National Academies Launches Study of Research Reproducibility and Replicability” by Will Thomas, posted at FYI: Science Policy News from AIP (American Institute of Physics)] “On Dec. 12 and 13, the National Academies convened the first meeting of…

Read More

Reproducibility Making Progress at Science

[From the article, “Progress in Reproducibility” by Jeremy Berg, Editor-in-Chief  Science Journals, published in the 5 January 2018 issue of Science] “Over the past year, we have retracted three papers previously published in Science. The circumstances of these retractions highlight some…

Read More

Not Everybody Thinks the Emphasis on Reproducibility is a Good Thing

[From the article “Reproducible research: a minority opinion” by Chris Drummond, published in the Journal of Experimental & Theoretical Artificial Intelligence.] “Reproducible research, a growing movement within many scientific fields, including machine learning, would require the code, used to generate…

Read More

IN THE NEWS: Wired (November 14, 2017)

[From the article “The Dismal Science Remains Dismal, Say Scientists” by Adam Rogers at wired.com] “WHEN HRISTOS DOUCOULIAGOS was a young economist in the mid-1990s, he got interested in all the ways economics was wrong about itself—bias, underpowered research, statistical shenanigans. Nobody wanted…

Read More

Hmmm. Maybe the R-Factor is NOT the answer.

In a recent post, TRN highlighted a recent working paper touting the benefits of something called an “R-Factor.” The R-Factor is a metric that would report — for each published empirical study — the reproducibility rate of that study in…

Read More