Archives


Making Meta-Analyses “Open”: A How-To

[Excerpts taken from the article “Conducting a Meta-Analysis in the Age of Open Science: Tools, Tips, and Practical Recommendations” by David Moreau and Beau Gamble, posted at PsyArXiv Preprints] “In this tutorial, we describe why open science is important in the…

Read More

An Assessment of Open Science Research Practices in Psychology: Lots of Talk But…

[Excerpts taken from the article, “Estimating the prevalence of transparency and reproducibility-related research practices in psychology (2014-2017)”, by Hardwicke, et al., posted at MetaArXiv Preprints] “…we manually examined a random sample of 250 articles to estimate the prevalence of several…

Read More

Open Science Practices in the Social Sciences: A Progress Report

[Excerpts taken from the article “Open Science Practices are on the Rise: The State of Social Science (3S) Survey” by Christensen et al., posted at MetaArXiv Preprints] “…how many social scientists are adopting open science practices, and what are the…

Read More

Free Webinar on Pre-Registation by the Center for Open Science

[From an email sent by Claire Riss, Communications and Outreach Coordinator for the Center for Open Science] “The Center for Open Science is conducting a webinar entitled The What, Why, and How of Preregistration on January 21 at 10 am Eastern…

Read More

The Main Reason to Pre-Register Your Research Is…

[Excerpts taken from the article, “The Value of Preregistration for Psychological Science: A Conceptual Analysis”, by Daniël Lakens, posted at PsyArXiv Preprints] “With the rise of the internet it has become feasible to create online registries that ask researchers to…

Read More

Pre-Analysis Plans in Economics and Political Science: Are They Working?

[Excerpts taken from the article, “Pre-analysis Plans: A Stocktaking” by George Ofosu and Daniel Posner, posted at George Ofosu’s website at the London School of Economics] “We draw a representative sample of PAPs and analyze their content to determine whether…

Read More

Pre-registration: The Naysayers Strike Back!

[Excerpts taken from the preprint, “Preregistration is redundant, at best” by Aba Szollosi et al., posted at PsyArXiv Preprints] “The key implication argued by proponents of preregistration is that it improves the diagnosticity of statistical tests…In the strong version of…

Read More

Pre-Registration: It’s a Journey

[Excerpts taken from the preprint “Preregistration Is Hard, And Worthwhile” by Brian Nosek and others, posted at PsyArXiv Preprints] “Preregistration of studies serves at least three aims for improving the credibility and reproducibility of research findings.” “First, preregistration of analysis…

Read More

Meta-Research: The Big Picture

[From the paper “Calibrating the scientific ecosystem through meta-research” by Tom Hardwicke, Stylianos Serghiou, Perrine Janiaud, Valentin Danchev, Sophia Crüwell, Steven Goodman, and John Ioannidis, forthcoming in Annual Review of Statistics and Its Application] “Meta-research has been defined as ‘the…

Read More

GOODMAN & REED: A Friendly Debate about Pre-Registration

Background: Nat Goodman is generally pessimistic about the benefits of pre-registration. Bob Reed is generally optimistic about pre-registration. What follows is a back-and-forth dialogue about what each likes and dislikes about pre-registration. [GOODMAN, Opening Statement] We need to remember that…

Read More