Category: NEWS & EVENTS


Has Replication’s Time Finally Arrived?

[From the article “Replications on the Rise” by Stuart Buck, posted at Arnold Ventures] “Once a poorly rewarded scientific value, replication has seen a boom with studies in everything from psychology to dogs.” “A significant tipping point was the Reproducibility Project…

Read More

Somebody Asks, How Can A Theory Be Falsified? Twitter Responds

[From the Twitter thread started by @JessieSunPsych] Jessie Sun (@JessieSunPsych) relayed the following question that was raised at a recent Psychology conference: “At what point can a theory be falsified (e.g., if the effect size is d = .02)? We often…

Read More

Resources for Incorporating Pre-registration and Replication in the Classroom

Nicole Janz (University of Nottingham, @PolSciReplicate) has a set of great resources for those looking for an example of a pre-registration assignment for undergraduates (this for a political science course). The slides to accompany the assignment are here. The template…

Read More

How Many Ways Can You Misinterpret p-Values, Confidence Intervals, Statistical Tests, and Power? 25

[From the blog “Misinterpreting Tests, P-Values, Confidence Intervals & Power” by Dave Giles, posted at his blogsite, Econometrics Beat] “Today I was reading a great paper by Greenland et al. (2016) that deals with some common misconceptions and misinterpretations that arise not…

Read More

What Can Stop Bad Science? Open Science and Modified Funding Lotteries

[From the working paper, “Open science and modified funding lotteries can impede the natural selection of bad science” By Paul Smaldino, Matthew Turner, and Pablo Contreras Kallens, posted at OSF Preprints] “…we investigate the influence of three key factors on the…

Read More

Huge Replication Project in Social and Behavioral Sciences Looking for Collaborators

[From the press release “Can machines determine the credibility of research claims? The Center for Open Science joins a new DARPA program to find out” from the Center for Open Science] “The Center for Open Science (COS) has been selected…

Read More

Power is not the point. It’s the curve.

[From the blog “Why you shouldn’t say ‘this study is underpowered’” by Richard Morey, posted at Towards Data Science, at Medium. com] “The first thing to clear up, as I’ve stated above, is that study or an experiment is not…

Read More

Predicting Reproducibility

[From the working paper “Predicting the Replicability of Social Science Lab Experiments” by Altmejd et al., posted at BITSS Preprints] “We have 131 direct replications in our dataset. Each can be judged categorically by whether it succeeded or failed, by a…

Read More

The Problem Isn’t Bad Incentives, It’s the Ritual Behind Them

[From the article, “Statistical Rituals: The Replication Delusion and How We Got There” by Gerd Gigerenzer, published in Advances in Methods and Practices in Psychological Science] “The “replication crisis” has been attributed to misguided external incentives gamed by researchers (the…

Read More

What If There Isn’t a Single Effect Size? Implications for Power Calculations, Hypothesis Testing, Confidence Intervals and Replications

[From the working paper “The Unappreciated Heterogeneity of Effect Sizes:Implications for Power, Precision, Planning of Research, and Replication” by David Kenny and Charles Judd, posted at Open Science Framework (OSF)] “The goal of this article is to examine the implications…

Read More