Category: NEWS & EVENTS


Twenty Years and Over a Thousand Citations, But It Couldn’t Be Reproduced

[From the commentary “Novelty in science should not come at the cost of reproducibility” by Andrew Holding, published in The FEBS Journal] “Oestrogen receptor (ER) cycling is a dogma of the Oestrogen receptor-positive (ER+) breast cancer field.” “For nearly 20…

Read More

To Your List of Biases in Meta-Analyses, Add This One: Accumulation Bias

[From the preprint “Accumulation bias in meta-analysis: the need to consider time in error control” by Judith ter Schure and Peter Grünwald, posted at arXiv.org] “Studies accumulate over time and meta-analyses are mainly retrospective. These two characteristics introduce dependencies between…

Read More

Meta-Research: The Big Picture

[From the paper “Calibrating the scientific ecosystem through meta-research” by Tom Hardwicke, Stylianos Serghiou, Perrine Janiaud, Valentin Danchev, Sophia Crüwell, Steven Goodman, and John Ioannidis, forthcoming in Annual Review of Statistics and Its Application] “Meta-research has been defined as ‘the…

Read More

Update from the AEA Data Editor on Replication and Reproducibility

[From the presentation slides on “Replication and Reproducibility in Social Sciences and Statistics: Context, Concerns, and Concrete Measures” by Lars Vilhuber, AEA Data Editor, presented at the 2019 Western Economics Association International meetings] NOTE: Just so there is no misunderstanding,…

Read More

IN THE NEWS: Psychology Today (June 28, 2019)

[From the article “Second-Guessing Predictions: When to trust scientific predictions—and when to ignore them” by Alexander Danvers] “One of the key reforms of the Credibility Revolution in psychology research is the use of preregistration: Scientists write down what they predict will happen…

Read More

IN THE NEWS: Slate (June 20, 2019)

[From the article “We Tried to Publish a Replication of a Science Paper in Science. The Journal Refused.” by Kevin Arceneaux, Bert Bakker, Claire Gothreau, and Gijs Schumacher, published in Slate]  “Our story starts in 2008, when a group of researchers…

Read More

Reproducibility in Registered Reports: Lots of Room for Improvement

[From the paper, “Analysis of Open Data and Computational Reproducibility in Registered Reports in Psychology” by Pepijn Obels, Daniel Lakens, Nicholas Coles, & Jaroslav Gottfried, posted at PsyArXiv Preprints] “Recently, scholars have started to empirically examine the extent to which data…

Read More

Not Only That, Effect Sizes from Registered Reports Are Also Much Lower

[In a recent post at TRN, we highlighted that positive results were drastically lower in registered reports. In this post, we report findings about effect sizes. Excerpts are taken from “The Meaningfulness of Effect Sizes in Psychological Research: Differences Between…

Read More

Positive Findings are Drastically Lower in Registered Reports

[From slides prepared for the talk “Positive result rates in psychology: Registered Reports compared to the conventional literature” by Mitchell Schijen, Anne Scheel, and Daniël Lakens, presented at Open Science 2019 @ZPID, Trier , and posted at OSF] Conclusion: “Positive result rate in…

Read More

Why So Many Insignificant Results in a Meta-analysis?

[From the blog “Where Do Non-Significant Results in Meta-Analysis Come From?” by Ulrich Schimmack, posted at Replicability-Index] “It is well known that focal hypothesis tests in psychology journals nearly always reject the null-hypothesis … However, meta-analyses often contain a fairly…

Read More