Category: GUEST BLOGS


BOB REED: Replications and Peer Review

“Weekend Reads”, the weekly summary by IVAN ORANSKY of Retraction Watch, recently listed two articles on Peer Review.  One, a blog by George Borjas, concerns the recent imbroglio at the American Economic Review involving an editor who oversaw the review of…

Read More

BOB REED: The Problem With Open Data: Would Requiring Co-Authorship Help?

There has been a huge amount of attention focused on “open data.”  A casual reading of the blogosphere is that Open Data is good, Secret Data is bad.   Remarkably, there has been very little discussion given to the property right…

Read More

BOB REED: On Andrew Gelman, Retractions, and the Supply and Demand for Data Transparency

In a recent interview on Retraction Watch, Andrew Gelman reveals that what keeps him up at night isn’t scientific fraud, it’s “the sheer number of unreliable studies — uncorrected, unretracted — that have littered the literature.”  He then goes on…

Read More

STEPHANIE WYKSTRA: On Data Re-use

[THIS BLOG ORIGINALLY APPEARED ON THE BITSS WEBSITE]  As advocates for open data, my colleagues and I often point to re-use of data for further research as a major benefit of data-sharing. In fact there are many cases in which…

Read More

ROBERT GELFOND and RYAN MURPHY: Out-of-Sample Tests and Macroeconomics

The replication crisis has elicited a number of recommendations, from betting on beliefs, to open data, to improved norms in academic journals regarding replication studies. In our recent working paper, “A Call for Out-of-Sample Testing in Macroeconomics” (available at SSRN),…

Read More

BOB REED: Replications Can Make Things Worse? Really?

In a recent article in Slate entitled “The Unintended Consequences of Trying to Replicate Research,” IVAN ORANSKY and ADAM MARCUS from Retraction Watch argue that replications can exacerbate research unreliability.  The argument assumes that publication bias is more likely to favour confirming replication studies…

Read More

CLAIRE BOEING-REICHER: Crowdsourcing a Journal’s Replication Policy

As reported in a previous blog post, the Economics E-Journal has launched a new replication section. As part of this initiative, we have developed a set of guidelines for replication submissions. These guidelines seek to strike a reasonable balance among…

Read More

CLAIRE BOEING-REICHER: Economics E-Journal Opens a Replication Section

The Economics E-Journal announces the launch of a dedicated replication section. This initiative is a joint effort of the Kiel Institute for the World Economy (IfW) and the German National Library for Economics (ZBW).  It provides authors across all fields…

Read More

RICHARD BALL: Introducing Project TIER

Project TIER (Teaching Integrity in Empirical Research) is one of the many initiatives launched within the last several years—a number of which have been featured in previous TRN guest blogs—that seek to strengthen standards of research transparency in the social…

Read More

MICHELE NUIJTEN: The Replication Paradox

Lately, there has been a lot of attention for the excess of false positive and exaggerated findings in the published scientific literature. In many different fields there are reports of an impossibly high rate of statistically significant findings, and studies…

Read More