Category: NEWS & EVENTS


Not Only That, Effect Sizes from Registered Reports Are Also Much Lower

[In a recent post at TRN, we highlighted that positive results were drastically lower in registered reports. In this post, we report findings about effect sizes. Excerpts are taken from “The Meaningfulness of Effect Sizes in Psychological Research: Differences Between…

Read More

Positive Findings are Drastically Lower in Registered Reports

[From slides prepared for the talk “Positive result rates in psychology: Registered Reports compared to the conventional literature” by Mitchell Schijen, Anne Scheel, and Daniël Lakens, presented at Open Science 2019 @ZPID, Trier , and posted at OSF] Conclusion: “Positive result rate in…

Read More

Why So Many Insignificant Results in a Meta-analysis?

[From the blog “Where Do Non-Significant Results in Meta-Analysis Come From?” by Ulrich Schimmack, posted at Replicability-Index] “It is well known that focal hypothesis tests in psychology journals nearly always reject the null-hypothesis … However, meta-analyses often contain a fairly…

Read More

Don’t Like the Author’s Conclusion? Read the Other One.

[From the article “Reproducibility trial publishes two conclusions for one paper” by David Adam, published in Nature] “How deeply an anaesthetist should sedate an elderly person when they have surgery is a controversial issue, because some studies link stronger doses…

Read More

Another Economics Journal Pilots Pre-Results Review

[From the article “Pre-results review reaches the (economic) lab: Experimental Economics follows the Journal of Development Economics in piloting pre-results review”, an interview with Irenaeus Wolff, published at http://www.bitss.org. The following are excerpts from that interview.] “In its April 2019…

Read More

Experts Are Not Know-It-Alls (Experimentally Speaking)

[From the paper “Stability of experimental results: Forecasts and evidence” by Stefano DellaVigna and Devin Pope, an NBER Working Paper] “How robust are experimental results to changes in design? And can researchers anticipate which changes matter most? We consider a…

Read More

Pre-Registration As a Self-Control Mechanism

[From the blog “Registering studies when all you want is a little more credibility” by Berk Ozler, posted at World Bank Blogs] “Some time ago, colleagues from World Bank (WB) operations contacted me with a request to evaluate an upcoming…

Read More

Pre-Registration: The Doctor is Still Out

[From the article “A solution to psychology’s reproducibility problem just failed its first test” by David Adam, published at http://www.sciencemag.org] “Efforts to improve the robustness of research by asking psychologists to state their methods and goals ahead of time, a process…

Read More

When Once Is Not Enough

[From the blog “Be careful what you wish for: cautionary tales on using single studies to inform policymaking” by Emmanuel Jimenez, posted at http://www.3ieimpact.org.%5D “For a development evaluator, the holy grail is to have evidence from one’s study be taken…

Read More

How Could This Happen?

[From the article “A Waste of 1,000 Research Papers” by Ed Yong, published in The Atlantic] “In 1996, a group of European researchers found that a certain gene, called SLC6A4, might influence a person’s risk of depression. It was a blockbuster discovery at…

Read More