Archives


Predicting Reproducibility. No PhD Required.

[Excerpts taken from the article “Laypeople Can Predict Which Social Science Studies Replicate” by Suzanne Hoogeveen, Alexandra Sarafoglou, and Eric-Jan Wagenmakers, posted at PsyArXiv Preprints] “…we assess the extent to which a finding’s replication success relates to its intuitive plausibility….

Read More

It May Be Intelligent, But Is It Reproducible?

[Excerpts taken from the article, “Artificial Intelligence Confronts a ‘Reproducibility’ Crisis’” by Gregory Barber, published at Wired.com] “A few years ago, Joelle Pineau, a computer science professor at McGill, was helping her students design a new algorithm when they fell…

Read More

PFEIFFER: Taking Replication Markets To a Whole New Level

Replication markets are prediction markets run in conjunction with systematic replication projects. We conducted such markets for the Replication Project: Psychology (RPP), Experimental Economics Replication Project (EERP), Social Science Replication Project (SSRP) and the Many Labs 2 Project (ML2). The…

Read More

Is It Pointless to Try and Predict Reproducibility?

[Excerpts taken from the blog “Responding to the replication crisis: reflections on Metascience2019” by Dorothy Bishop, published at her blogsite, BishopBlog] “I’m just back from MetaScience 2019…It is a sign of a successful meeting, I think, if it gets people…raising…

Read More

Your Definition of Replication is (Probably) Wrong

[From the preprint, “What is Replication?” by Brian Nosek and Tim Errington, posted at MetaArXiv Preprints] “According to common understanding, replication is repeating a study’s procedure and observing whether the prior finding recurs…This definition of replication is intuitive, easy to…

Read More

The Crowdsourced Replication Initiative: Excerpts from the Executive Report

[Excerpts taken from the report “The Crowdsourced Replication Initiative: Investigating Immigration and Social Policy Preferences using Meta-Science” by Nate Breznau, Eike Mark Rinke, and Alexander Wuttke, posted at SocArXiv Papers] “A burning question is what impact immigration and immigration-related events…

Read More

Replication Crisis? What Replication Crisis?

[Excerpts taken from the article “No Crisis but No Time for Complacency” by Wendy Wood and Timothy Wilson, published in Observer Magazine] “The National Academies of Sciences, Engineering, and Medicine recently published a report titled Reproducibility and Replicability in Science….

Read More

FIDLER & MODY: The repliCATS Bus – Where It’s Been, Where It’s Going

For several years now scientists—in at least some disciplines—have been concerned about low rates of replicability. As scientists in those fields, we worry about the development of cumulative knowledge, and about wasted research effort. An additional challenge is to consider…

Read More

Is It Persistence Over Time? Or Over Space?

[From the article “The standard errors of persistence” by Morgan Kelly, published at Vox – CEPR Policy Portal] “Does the slave trade continue to affect trust between people in Africa? Does a country’s prosperity depend on the genetic diversity of…

Read More