Archives


How Should One Statistically Analyse a Replication? It Depends.

[From the preprint, “Statistical Analyses for Studying Replication: Meta-Analytic Perspectives” by Larry Hedges and Jacob Schauer, forthcoming in Psychological Methods] “Formal empirical assessments of replication have recently become more prominent in several areas of science, including psychology. These assessments have…

Read More

Your One Stop Shop for the Pre-registration Debate

Recently the 59th annual meeting of the Psychonomic Society in New Orleans played host to an interesting series of talks on how statistical methods should interact with the practice of science. Some speakers discussed exploratory model building, suggesting that this activity may not…

Read More

IN THE NEWS: The Atlantic (November 19, 2018)

[From the article, “Psychology’s Replication Crisis Is Running Out of Excuses” By Ed Yong, published in The Atlantic] “The Many Labs 2 project was specifically designed to address these criticisms. With 15,305 participants in total, the new experiments had, on…

Read More

BBC Radio Program on the Replication Crisis

BBC Radio just produced an interesting and balanced program about the replication crisis, with a focus on psychology. Interviewees include John Bargh, Susan Fiske, John Ioannidis, Brian Nosek, Stephen Reicher, Diederik Stapel and Simine Vazire. One of the highlights is…

Read More

What Can Meta-Analyses Tell Us About Reproducibility?

[From the abstract of the article “What Meta-Analyses Reveal About the Replicability of Psychological Research” by T.D. Stanley, Evan Carter, and Hristos Doucouliagos, published in Psychological Bulletin] “Can recent failures to replicate psychological research be explained by typical magnitudes of statistical power,bias…

Read More

Getting Pre-Registration Right Is Not So Easy

[From the paper, “Ensuring the quality and specificity of preregistrations” by C.L.S. Veldkamp et al., posted at PsyArXiv Preprints] “…we evaluated two preregistration formats that are available on the OSF: a lightweight format that maximizes flexibility for the researcher to…

Read More

IN THE NEWS: The Chronicle of Higher Education (September 11, 2018)

[From the article “’I Want to Burn Things to the Ground’: Are the foot soldiers behind psychology’s replication crisis saving science — or destroying it?” by Tom Bartlett] “As you’ve no doubt heard by now, social psychology has had a…

Read More

How do Psychologists Interpret Nonsignificant Results? Evidence from the Journals

[From the abstract to the article, “Quantifying Support for the Null Hypothesis in Psychology: An Empirical Investigation” by Aczel et al., recently published in Advances in Methods and Practices in Psychological Science] “In the traditional statistical framework, nonsignificant results leave researchers…

Read More

Don’t Think of Them as Students. Think of Them As Potential Pre-Registration Replicators.

[From the Research page of Gilad Feldman’s website.] “In 2016, following recent developments in psychological science (the so called “replication crisis”) and gaining my academic independence, I decided to make serious changes to my research agenda to prioritize pre-registered replications…

Read More

Reproducibility. You Can Do This.

[From the paper, “Practical Tools and Strategies for Researchers to Increase Replicability” by Michele Nuijten, forthcoming in Developmental Medicine & Child Neurology] “Several large-scale problems are affecting the validity and reproducibility of scientific research. … Many of the suggested solutions are…

Read More