Archives


And Now an “Inference Crisis”?

[Excerpts are taken from the article “Assessing Theoretical Conclusions With Blinded Inference to Investigate a Potential Inference Crisis” by Starns et al., published in Advances in Methods and Practices in Psychological Science] “The replication crisis in science has led to…

Read More

Reproducibility and Meta-Analyses: Two Great Concepts That Apparently Don’t Mix

[Excerpts taken from the report “Examining the Reproducibility of Meta-Analyses in Psychology: A Preliminary Report” by Daniel Lakens et al., posted at MetaArXiv Preprints ] “…given the broad array of problems that make it difficult to evaluate the evidential value…

Read More

Predicting Reproducibility. No PhD Required.

[Excerpts taken from the article “Laypeople Can Predict Which Social Science Studies Replicate” by Suzanne Hoogeveen, Alexandra Sarafoglou, and Eric-Jan Wagenmakers, posted at PsyArXiv Preprints] “…we assess the extent to which a finding’s replication success relates to its intuitive plausibility….

Read More

Replication Failures: The Plot Thickens

[Excerpts taken from the working paper “Replicator Degrees of Freedom Allow Publication of Misleading “Failures to Replicate” by Christopher Bryan, David Yeager, and Joseph O’Brien, posted at SSRN] “…using data from an ongoing debate, we show that commonly-exercised flexibility at…

Read More

IN THE NEWS: Psychology Today (June 28, 2019)

[From the article “Second-Guessing Predictions: When to trust scientific predictions—and when to ignore them” by Alexander Danvers] “One of the key reforms of the Credibility Revolution in psychology research is the use of preregistration: Scientists write down what they predict will happen…

Read More

IN THE NEWS: Slate (June 20, 2019)

[From the article “We Tried to Publish a Replication of a Science Paper in Science. The Journal Refused.” by Kevin Arceneaux, Bert Bakker, Claire Gothreau, and Gijs Schumacher, published in Slate]  “Our story starts in 2008, when a group of researchers…

Read More

Reproducibility in Registered Reports: Lots of Room for Improvement

[From the paper, “Analysis of Open Data and Computational Reproducibility in Registered Reports in Psychology” by Pepijn Obels, Daniel Lakens, Nicholas Coles, & Jaroslav Gottfried, posted at PsyArXiv Preprints] “Recently, scholars have started to empirically examine the extent to which data…

Read More

Not Only That, Effect Sizes from Registered Reports Are Also Much Lower

[In a recent post at TRN, we highlighted that positive results were drastically lower in registered reports. In this post, we report findings about effect sizes. Excerpts are taken from “The Meaningfulness of Effect Sizes in Psychological Research: Differences Between…

Read More

Positive Findings are Drastically Lower in Registered Reports

[From slides prepared for the talk “Positive result rates in psychology: Registered Reports compared to the conventional literature” by Mitchell Schijen, Anne Scheel, and Daniël Lakens, presented at Open Science 2019 @ZPID, Trier , and posted at OSF] Conclusion: “Positive result rate in…

Read More