Archives


Reproducibility in Registered Reports: Lots of Room for Improvement

[From the paper, “Analysis of Open Data and Computational Reproducibility in Registered Reports in Psychology” by Pepijn Obels, Daniel Lakens, Nicholas Coles, & Jaroslav Gottfried, posted at PsyArXiv Preprints] “Recently, scholars have started to empirically examine the extent to which data…

Read More

Not Only That, Effect Sizes from Registered Reports Are Also Much Lower

[In a recent post at TRN, we highlighted that positive results were drastically lower in registered reports. In this post, we report findings about effect sizes. Excerpts are taken from “The Meaningfulness of Effect Sizes in Psychological Research: Differences Between…

Read More

Positive Findings are Drastically Lower in Registered Reports

[From slides prepared for the talk “Positive result rates in psychology: Registered Reports compared to the conventional literature” by Mitchell Schijen, Anne Scheel, and Daniël Lakens, presented at Open Science 2019 @ZPID, Trier , and posted at OSF] Conclusion: “Positive result rate in…

Read More

How Pre-Registration Can Lead to Higher-Powered Studies and Increase Reproducibility

[From the paper “Preregistration and reproducibility” by Eirik Strømland, forthcoming in the Journal of Economic Psychology] “I present a simple model in which the research community is populated by agents who may report their results unconditionally or conditionally on statistical…

Read More

Update on the Journal of Development Economics’ Pilot on Pre-Results Review

[From the blog by David McKenzie, “A few catch-up links”, posted at Development Impact] “At the BITSS conference, Andrew Foster … gave an update of the JDE’s pilot of registered reports/pre-results review. Some points he noted:” – “They see this process…

Read More

IN THE NEWS: FiveThirtyEight (December 6, 2018)

[From the article “Psychology’s Replication Crisis Has Made The Field Better” by Christie Aschwanden, published at FiveThirtyEight] “The replication crisis arose from a series of events that began around 2011, the year that social scientists Uri Simonsohn, Leif Nelson and…

Read More

Registered Reports Are Not Optimal?

[From the working paper, “Which findings should be published?” by Alexander Frankel and Maximilian Kasy] “There have been calls for reforms in the direction of non-selective publication. One proposal is to promote statistical practices that de-emphasize statistical significance … Another…

Read More

Intro to Open Science in 8 Easy Steps

[From the working paper, “8 Easy Steps to Open Science: An Annotated Reading List” by Sophia Crüwell et al., posted at PsyArXiv Preprints] “In this paper, we provide a comprehensive and concise introduction to open science practices and resources that can help…

Read More

Pre-registration. From clinical trials. To psychology. Next, the world?

[From the article “More and more scientists are preregistering their studies. Should you?” by Kai Kupferschmidt, published in Science] “…Preregistration, in its simplest form, is a one-page document answering basic questions such as: What question will be studied? What is the hypothesis?…

Read More

BITSS: Journal of Development Economics Pilots Pre-Results Review

The Journal of Development Economics (JDE) is piloting a new approach in which authors have the opportunity to submit empirical research designs for review and approval before the results of the study are known. While the JDE is the first…

Read More