Archives


Is It Pointless to Try and Predict Reproducibility?

[Excerpts taken from the blog “Responding to the replication crisis: reflections on Metascience2019” by Dorothy Bishop, published at her blogsite, BishopBlog] “I’m just back from MetaScience 2019…It is a sign of a successful meeting, I think, if it gets people…raising…

Read More

Your Definition of Replication is (Probably) Wrong

[From the preprint, “What is Replication?” by Brian Nosek and Tim Errington, posted at MetaArXiv Preprints] “According to common understanding, replication is repeating a study’s procedure and observing whether the prior finding recurs…This definition of replication is intuitive, easy to…

Read More

The Crowdsourced Replication Initiative: Excerpts from the Executive Report

[Excerpts taken from the report “The Crowdsourced Replication Initiative: Investigating Immigration and Social Policy Preferences using Meta-Science” by Nate Breznau, Eike Mark Rinke, and Alexander Wuttke, posted at SocArXiv Papers] “A burning question is what impact immigration and immigration-related events…

Read More

Replication Crisis? What Replication Crisis?

[Excerpts taken from the article “No Crisis but No Time for Complacency” by Wendy Wood and Timothy Wilson, published in Observer Magazine] “The National Academies of Sciences, Engineering, and Medicine recently published a report titled Reproducibility and Replicability in Science….

Read More

FIDLER & MODY: The repliCATS Bus – Where It’s Been, Where It’s Going

For several years now scientists—in at least some disciplines—have been concerned about low rates of replicability. As scientists in those fields, we worry about the development of cumulative knowledge, and about wasted research effort. An additional challenge is to consider…

Read More

Is It Persistence Over Time? Or Over Space?

[From the article “The standard errors of persistence” by Morgan Kelly, published at Vox – CEPR Policy Portal] “Does the slave trade continue to affect trust between people in Africa? Does a country’s prosperity depend on the genetic diversity of…

Read More

Update from the AEA Data Editor on Replication and Reproducibility

[From the presentation slides on “Replication and Reproducibility in Social Sciences and Statistics: Context, Concerns, and Concrete Measures” by Lars Vilhuber, AEA Data Editor, presented at the 2019 Western Economics Association International meetings] NOTE: Just so there is no misunderstanding,…

Read More

Experts Are Not Know-It-Alls (Experimentally Speaking)

[From the paper “Stability of experimental results: Forecasts and evidence” by Stefano DellaVigna and Devin Pope, an NBER Working Paper] “How robust are experimental results to changes in design? And can researchers anticipate which changes matter most? We consider a…

Read More

When Once Is Not Enough

[From the blog “Be careful what you wish for: cautionary tales on using single studies to inform policymaking” by Emmanuel Jimenez, posted at http://www.3ieimpact.org.%5D “For a development evaluator, the holy grail is to have evidence from one’s study be taken…

Read More