Category: NEWS & EVENTS


Causal Inference Should Focus More on Mechanism Than Method

[From a post by Andrew Gelman at his blog, Statistical Modeling, Causal Inference, and Social Science] “If researchers and policy makers continue to view results of impact evaluations as a black box and fail to focus on mechanisms, the movement…

Read More

Battle of the p-Hackers: The HARKer Versus The Accumulator

[From the blog, “Gazing into the Abyss of P-Hacking: HARKing vs. Optional Stopping” by Angelika Stefan and Felix Schönbrodt, posted at Felix Schönbrodt’s website at http://www.nicebread.de%5D “Now, what does a researcher do when confronted with messy, non-significant results? According to several…

Read More

Tired of Candy Crush? Try the New and Improved p-Hacker App!

[From Felix Schönbrodt’s Twitter account, @nicebread303] “The p-hacker app just UNLOCKED the most requested PRO FEATURE: Subgroup analyses!!!” “Check if you can find the effect for, say, young males. This is soo theoretically interesting. Now you can get the p-hacking…

Read More

IN THE NEWS: The Atlantic (November 19, 2018)

[From the article, “Psychology’s Replication Crisis Is Running Out of Excuses” By Ed Yong, published in The Atlantic] “The Many Labs 2 project was specifically designed to address these criticisms. With 15,305 participants in total, the new experiments had, on…

Read More

The AEA Interviews Ted Miguel About the Replication Crisis

[From the article “Making economics transparent and reproducible” by Tyler Smith, published on the American Economic Association’s website] “The AEA spoke with Miguel about the replication problem in economics and how the next generation of researchers is embracing new tools…

Read More

BBC Radio Program on the Replication Crisis

BBC Radio just produced an interesting and balanced program about the replication crisis, with a focus on psychology. Interviewees include John Bargh, Susan Fiske, John Ioannidis, Brian Nosek, Stephen Reicher, Diederik Stapel and Simine Vazire. One of the highlights is…

Read More

Modelling Reproducibility

[From the preprint “A Model-Centric Analysis of Openness, Replication, and Reproducibility”, by Bert Baumgaertner, Berna Devezer, Erkan Buzbas, and Luis Nardin, posted at arXiv.org] “In order to clearly specify the conditions under which we may or may not obtain reproducible results,…

Read More

What Can Meta-Analyses Tell Us About Reproducibility?

[From the abstract of the article “What Meta-Analyses Reveal About the Replicability of Psychological Research” by T.D. Stanley, Evan Carter, and Hristos Doucouliagos, published in Psychological Bulletin] “Can recent failures to replicate psychological research be explained by typical magnitudes of statistical power,bias…

Read More

Original Study Finds A Result. Follow-up Studies Fail to Replicate It. The Record is Corrected. Right?

[From the post “A study fails to replicate, but it continues to get referenced as if it had no problems. Communication channels are blocked.” by Andrew Gelman at Statistical Modeling, Causal Inference, and Social Science] “In 2005, Michael Kosfeld, Markus Heinrichs,…

Read More

A Primer on Pre-Registration

[From the article “The preregistration revolution” by Brian Nosek, Charles Ebersole, Alexander DeHaven, and David Mellor, published in PNAS] “Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. This distinction between postdiction and prediction…

Read More