Archives


IN THE NEWS: FiveThirtyEight (December 6, 2018)

[From the article “Psychology’s Replication Crisis Has Made The Field Better” by Christie Aschwanden, published at FiveThirtyEight] “The replication crisis arose from a series of events that began around 2011, the year that social scientists Uri Simonsohn, Leif Nelson and…

Read More

Registered Reports Are Not Optimal?

[From the working paper, “Which findings should be published?” by Alexander Frankel and Maximilian Kasy] “There have been calls for reforms in the direction of non-selective publication. One proposal is to promote statistical practices that de-emphasize statistical significance … Another…

Read More

REED: An Update on the Progress of Replications in Economics

[This post is based on a presentation by Bob Reed at the Workshop on Reproducibility and Integrity in Scientific Research, held at the University of Canterbury, New Zealand, on October 26, 2018] In 2015, Duvendack, Palmer-Jones, and Reed (DPJ&R) published…

Read More

VLAEMINCK & PODKRAJAC: Do Economics Journals Enforce Their Data Policies?

In the past, the findings of numerous replication studies in economics have raised serious concerns regarding the credibility and reliability of published applied economic research. Literature suggests several explanations for these findings: Beyond missing incentives and rewards for the disclosure…

Read More

MUELLER-LANGER et al.: Replication in Economics

[This blog is based on the article “ Replication studies in economics—How many and which papers are chosen for replication, and why?” by Frank Mueller-Langer, Benedikt Fecher, Dietmar Harhoff, and Gert Wagner, published in the journal Research Policy] Academia is…

Read More

Journal Says, If We Publish the Article, We’ll Publish the Replication

[From the blog “Accountable replications at Royal Society Open Science: A model for scientific publishing” by Sanjay Srivastava, published at the blogsite, The Hardest Science] “I was excited to read this morning that the journal Royal Society Open Science has announced a new replication policy…

Read More

Should Null Results Require Greater Justification?

In a recent editorial in Management Review Quarterly, the journal invited replications, and put forth the following “Seven Principles of Effective Replication Studies”:  #1. “Understand that replication is not reproduction” #2. “Aim to replicate published studies that are relevant”  #3….

Read More

Replication in Economics: How Much? And What Matters?

[From the abstract of the forthcoming paper, “Replication studies in economics—How many and which papers are chosen for replication, and why?” by Frank Mueller-Langer, Benedikt Fecher, Dietmar Harhoff, and Gert G. Wagner, forthcoming in the journal, Research Policy] “We investigate how often replication…

Read More

Top Political Science Journal Introduces Results-Free Peer Review

The Journal of Experimental Political Science (JEPS) just announced that is opening up a new kind of manuscript submission based on preregistered reports. Here is how they describe it: “A preregistered report is like any other research paper in many…

Read More

At the Journal Nature, Peer Reviewers Have the Right To…

[From an editorial published in Nature entitled, “Referees should exercise their rights”] “At Nature, we recognize that our peer reviewers have certain ‘rights’. One of the most well known is the right to anonymity. Less widely known is that referees have the…

Read More