Archives


PFEIFFER: Taking Replication Markets To a Whole New Level

Replication markets are prediction markets run in conjunction with systematic replication projects. We conducted such markets for the Replication Project: Psychology (RPP), Experimental Economics Replication Project (EERP), Social Science Replication Project (SSRP) and the Many Labs 2 Project (ML2). The…

Read More

FIDLER & MODY: The repliCATS Bus – Where It’s Been, Where It’s Going

For several years now scientists—in at least some disciplines—have been concerned about low rates of replicability. As scientists in those fields, we worry about the development of cumulative knowledge, and about wasted research effort. An additional challenge is to consider…

Read More

IN THE NEWS: Wired (February 15, 2019)

[From the article “DARPA Wants to Solve Science’s Reproducibility Crisis With AI” by Adam Rogers, published in Wired] “A Darpa program called Systematizing Confidence in Open Research and Evidence—yes, SCORE—aims to assign a “credibility score” … to research findings in the…

Read More

Huge Replication Project in Social and Behavioral Sciences Looking for Collaborators

[From the press release “Can machines determine the credibility of research claims? The Center for Open Science joins a new DARPA program to find out” from the Center for Open Science] “The Center for Open Science (COS) has been selected…

Read More

The Best Offense for Determining Research Reliability is a Good (Dept. of) Defense?

[From the article “Q&A Adam Russell: Can automated tools reliably rate research reproducibility?” by Dalmeet Singh Chawla, published at natureindex.com] “Recently the United States Defense Advanced Research Projects Agency (DARPA) solicited research proposals on developing automated tools that assign confidence…

Read More