Archives


A Must-Read on the Statistical Analysis of Replications

[Excerpts taken from the article, “The Statistics of Replication” by Larry Hedges, pubished in the journal Methodology] Background “Some treatments of replication have defined replication in terms of the conclusions obtained by studies (e.g., did both studies conclude that the…

Read More

Journal-Based Replication

[Excerpts taken from the article “A Journal-Based Replication of ‘Being Chosen to Lead’” by Allen Drazen, Anna Dreber, Erkut Ozbay, and Erik Snowberg, posted at Snowberg’s website at the California Institute of Technology] “More replication seems needed, and there is…

Read More

Predicting Reproducibility. No PhD Required.

[Excerpts taken from the article “Laypeople Can Predict Which Social Science Studies Replicate” by Suzanne Hoogeveen, Alexandra Sarafoglou, and Eric-Jan Wagenmakers, posted at PsyArXiv Preprints] “…we assess the extent to which a finding’s replication success relates to its intuitive plausibility….

Read More

It May Be Intelligent, But Is It Reproducible?

[Excerpts taken from the article, “Artificial Intelligence Confronts a ‘Reproducibility’ Crisis’” by Gregory Barber, published at Wired.com] “A few years ago, Joelle Pineau, a computer science professor at McGill, was helping her students design a new algorithm when they fell…

Read More

PFEIFFER: Taking Replication Markets To a Whole New Level

Replication markets are prediction markets run in conjunction with systematic replication projects. We conducted such markets for the Replication Project: Psychology (RPP), Experimental Economics Replication Project (EERP), Social Science Replication Project (SSRP) and the Many Labs 2 Project (ML2). The…

Read More

Is It Pointless to Try and Predict Reproducibility?

[Excerpts taken from the blog “Responding to the replication crisis: reflections on Metascience2019” by Dorothy Bishop, published at her blogsite, BishopBlog] “I’m just back from MetaScience 2019…It is a sign of a successful meeting, I think, if it gets people…raising…

Read More

Your Definition of Replication is (Probably) Wrong

[From the preprint, “What is Replication?” by Brian Nosek and Tim Errington, posted at MetaArXiv Preprints] “According to common understanding, replication is repeating a study’s procedure and observing whether the prior finding recurs…This definition of replication is intuitive, easy to…

Read More

The Crowdsourced Replication Initiative: Excerpts from the Executive Report

[Excerpts taken from the report “The Crowdsourced Replication Initiative: Investigating Immigration and Social Policy Preferences using Meta-Science” by Nate Breznau, Eike Mark Rinke, and Alexander Wuttke, posted at SocArXiv Papers] “A burning question is what impact immigration and immigration-related events…

Read More

Replication Crisis? What Replication Crisis?

[Excerpts taken from the article “No Crisis but No Time for Complacency” by Wendy Wood and Timothy Wilson, published in Observer Magazine] “The National Academies of Sciences, Engineering, and Medicine recently published a report titled Reproducibility and Replicability in Science….

Read More