Archives


What Can Stop Bad Science? Open Science and Modified Funding Lotteries

[From the working paper, “Open science and modified funding lotteries can impede the natural selection of bad science” By Paul Smaldino, Matthew Turner, and Pablo Contreras Kallens, posted at OSF Preprints] “…we investigate the influence of three key factors on the…

Read More

Choosing the Right α: What You Need to Know

[From the article “The quest for an optimal alpha” by Jeff Miller and Rolf Ulrich, published in PLOS One] “The purpose of the present article is to show exactly what is necessary to provide a principled justification for a particular α…

Read More

MILLER: The Statistical Fundamentals of (Non-)Replicability

“Replicability of findings is at the heart of any empirical science” (Asendorpf, Conner, De Fruyt, et al., 2013, p. 108) The idea that scientific results should be reliably demonstrable under controlled circumstances has a special status in science.  In contrast…

Read More

Battle of the p-Hackers: The HARKer Versus The Accumulator

[From the blog, “Gazing into the Abyss of P-Hacking: HARKing vs. Optional Stopping” by Angelika Stefan and Felix Schönbrodt, posted at Felix Schönbrodt’s website at http://www.nicebread.de%5D “Now, what does a researcher do when confronted with messy, non-significant results? According to several…

Read More

COVILLE & VIVALT: Should We Trust Evidence On Development Programs?

[From the working paper, “How Often Should We Believe Positive Results? Assessing the Credibility of Research Findings in Development Economics” by Aidan Coville and Eva Vivalt] Over $140 billion is spent on donor assistance to developing countries annually to promote…

Read More

REED: The Replication Crisis – A Single Replication Can Make a Big Difference

[This post is based on the paper, “A Primer on the ‘Reproducibility Crisis’ and Ways to Fix It” by the author] In a previous post, I argued that lowering α from 0.05 to 0.005, as advocated by Benjamin et al….

Read More

REED: Why Lowering Alpha to 0.005 is Unlikely to Help

[This blog is based on the paper, “A Primer on the ‘Reproducibility Crisis’ and Ways to Fix It” by the author] A standard research scenario is the following: A researcher is interested in knowing whether there is a relationship between…

Read More