Category: NEWS & EVENTS


Not One, Not Two, Not Three, But Eight Replications?

In a recent blog at Open Philanthropy Project summarizing some of his research on the effect of incarceration on crime, David Roodman conducted, count them, 8 replications. Here is what he said: “Among three dozen studies I reviewed, I obtained or reconstructed…

Read More

RCTs To Fix Science?

[From a letter published in the September 22 issue of Science entitled “Addressing scientific integrity scientifically”] “To introduce greater rigor into the study of research integrity and the factors that foster or discourage responsible behavior, the participants at the Fifth…

Read More

Results-Free Peer Review: The Video

Previous posts at TRN have highlighted “results-free peer review” (RFPR) efforts at a variety of journals: see here, here, and here. The journal BMC Psychology recently put together a short (approximately 2 minutes) video discussing their new policy of “results-free…

Read More

Incentives to Replicate: Show Me the Money!

[From the article “Go Forth and Replicate: On Creating Incentives for Repeat Studies” by Michael Schulson at the web magazine Undark] “Suggested reasons for the [replication] crisis are many. Some researchers have blamed the scientific publishing culture itself …. But some…

Read More

All Researchers Want Open Data, Right?

[From the blog by Justin Gallagher entitled “Public Data that Isn’t (or Wasn’t) Public” posted at BITSS] “I recently completed a coauthored working paper, together with Paul J. Fisher, that examines whether electronic monitoring via red light traffic cameras leads to…

Read More

What?! You Don’t Believe in Badges?!!

[The following is taken from a blog by Hilda Bastian at the blogsite “Absolutely Maybe” at PLOS Blogs] “As I’ve spent time with the badges “magic bullet” – simple! cheap! no side effects! dramatic benefits! – supported by a single…

Read More

Hmmm. Maybe the R-Factor is NOT the answer.

In a recent post, TRN highlighted a recent working paper touting the benefits of something called an “R-Factor.” The R-Factor is a metric that would report — for each published empirical study — the reproducibility rate of that study in…

Read More

Pre-register. Make a $1000. Really?

[From the Center for Open Science webpage.] “If you have a project that is entering the planning or data collection phase, we’d like you to try out a preregistration. Through our $1 Million Preregistration Challenge, we’re giving away $1,000 to 1,000…

Read More

FYI: ScienceOpen Has a Collection of Papers on How to Fix the Replicability Crisis

ScienceOpen has a collection entitled: “Remedies to the Reproducibility Crisis”.  The collection is introduced thusly: “Psychology, Medicine, Neuroscience and many other research fields, are facing a serious reproducibility crisis, that is, most of the findings published in peer-review journals, independently…

Read More

A Pop Quiz on Significant Effects with Small Sample Sizes

QUICK: Does finding a significant effect when the sample size is small make it more likely that the effects are real and important?  Or less? James Heckman, Nobel Prize winning economist, says more: “Also holding back progress are those who…

Read More