Archives


Predicting Reproducibility: Rise of the Machines

[Excerpts are taken from the article “Estimating the deep replicability of scientific findings using human and artificial intelligence” by Yang Yang, Wu Youyou, and Brian Uzzi, published in PNAS] “…we trained an artificial intelligence model to estimate a paper’s replicability using…

Read More

If All the Neuroimaging Researchers Were Laid End to End, Would They Reach a Conclusion?

[Excerpts taken from the article “Variability in the analysis of a single neuroimaging dataset by many teams” by Thomas Nichols, Russell Poldrack, Tom Schonberg and 194 others, posted at BioRXiv] “Data analysis workflows in many areas of science have become…

Read More

PFEIFFER: Taking Replication Markets To a Whole New Level

Replication markets are prediction markets run in conjunction with systematic replication projects. We conducted such markets for the Replication Project: Psychology (RPP), Experimental Economics Replication Project (EERP), Social Science Replication Project (SSRP) and the Many Labs 2 Project (ML2). The…

Read More

IN THE NEWS: Wired (February 15, 2019)

[From the article “DARPA Wants to Solve Science’s Reproducibility Crisis With AI” by Adam Rogers, published in Wired] “A Darpa program called Systematizing Confidence in Open Research and Evidence—yes, SCORE—aims to assign a “credibility score” … to research findings in the…

Read More

IN THE NEWS: New York Times (November 19, 2018)

[From the article, “Essay: The Experiments Are Fascinating. But Nobody Can Repeat Them” by Andrew Gelman, published in The New York Times] “At this point, it is hardly a surprise to learn that even top scientific journals publish a lot…

Read More

Prediction Markets for Social Science Replication Project Opening Soon

The Open Science Framework announces the opening of a prediction market (PM) to accompany a new replication project.  Over the period September 2016 to September 2017, 21 experimental studies that were published from 2010-2014 in the journals Science and Nature  will…

Read More