Archives


When Trying to Explain p-Values, Maybe Try This?

[From the blog “P-values 101: An attempt at an intuitive but mathematically correct explanation” by Xenia Schmalz, posted at Xenia Schmalz’s blog] “…what exactly are p-values, what is p-hacking, and what does all of that have to do with the replication crisis?…

Read More

The Problem Isn’t Bad Incentives, It’s the Ritual Behind Them

[From the article, “Statistical Rituals: The Replication Delusion and How We Got There” by Gerd Gigerenzer, published in Advances in Methods and Practices in Psychological Science] “The “replication crisis” has been attributed to misguided external incentives gamed by researchers (the…

Read More

MILLER: The Statistical Fundamentals of (Non-)Replicability

“Replicability of findings is at the heart of any empirical science” (Asendorpf, Conner, De Fruyt, et al., 2013, p. 108) The idea that scientific results should be reliably demonstrable under controlled circumstances has a special status in science.  In contrast…

Read More

The Key to Solving the Replication Crisis Is … Intellectual Humility?

[From the article “Intellectual humility: the importance of knowing you might be wrong” by Brian Resnick, published at Vox] “Julia Rohrer wants to create a radical new culture for social scientists. A personality psychologist at the Max Planck Institute for Human…

Read More

IN THE NEWS: Medium (December 17, 2018)

[From the article “It’s not a replication crisis. It’s an innovation opportunity” by Jon Brock, published in Medium] “It takes me a few moments to recognise the name. I’ve arrived early at the National Health and Medical Research Council’s Research Translation…

Read More

ROODMAN: Hookworms and Malaria and Replications, Oh My!

About 10 years ago, the economist Hoyt Bleakley published two important papers on the impact of health on wealth—more precisely, on the long-term economic impacts of large-scale disease eradication campaigns. In the Quarterly Journal of Economics, “Disease and Development: Evidence…

Read More

How Should One Statistically Analyse a Replication? It Depends.

[From the preprint, “Statistical Analyses for Studying Replication: Meta-Analytic Perspectives” by Larry Hedges and Jacob Schauer, forthcoming in Psychological Methods] “Formal empirical assessments of replication have recently become more prominent in several areas of science, including psychology. These assessments have…

Read More

IN THE NEWS: New York Times (November 19, 2018)

[From the article, “Essay: The Experiments Are Fascinating. But Nobody Can Repeat Them” by Andrew Gelman, published in The New York Times] “At this point, it is hardly a surprise to learn that even top scientific journals publish a lot…

Read More

IN THE NEWS: The Atlantic (November 19, 2018)

[From the article, “Psychology’s Replication Crisis Is Running Out of Excuses” By Ed Yong, published in The Atlantic] “The Many Labs 2 project was specifically designed to address these criticisms. With 15,305 participants in total, the new experiments had, on…

Read More

The AEA Interviews Ted Miguel About the Replication Crisis

[From the article “Making economics transparent and reproducible” by Tyler Smith, published on the American Economic Association’s website] “The AEA spoke with Miguel about the replication problem in economics and how the next generation of researchers is embracing new tools…

Read More