Archives


REED: The State of Replications in Economics – A 2020 Review (Part 2)

This instalment follows on yesterday’s post where I addressed two questions: Are there more replications in economics than there used to be? And, Which journals publish replications? These questions deal with the descriptive aspect of replications. We saw that replications…

Read More

REED: The State of Replications in Economics – A 2020 Review (Part 1)

This post is based on a keynote presentation I gave at the Editor’s Meeting of the International Journal for Re-Views of Empirical Economics in June 2020. It loosely follows up two previous attempts to summarize the state of replications in…

Read More

GRUNOW: Update on IREE – the First and Only Journal Dedicated to Replications in Economics

IREE (the International Journal for Re-Views in Empirical Economics) was launched in September 2017, supported by our prestigious board of academic advisors: Sir Angus Deaton, Richard Easterlin, and Jeffrey Wooldridge. It is the first, and, to date, only journal solely…

Read More

“Replicate Early and Often”

[From the working paper “The Dozen Things Experimental Economists Should Do (More Of)” by Eszter Czibor, David Jimenez-Gomez, and John List, Working Paper 25451 in the NBER Working Paper Series] “…We believe that the best approach to increasing the reliability of…

Read More

IN THE NEWS: Nature (February 21, 2018)

[From the article, “How to make replication the norm” published by Paul Gertler, Sebastian Galiani and Mauricio Romero in Nature] “To see how often the posted data and code could readily replicate original results, we attempted to recreate the tables…

Read More

GRUNOW: Say Hello to IREE – A New Economics Journal Dedicated to the Publishing of Replication Studies

Replications are pivotal for the credibility of empirical economics. Evidence-based policy requires findings that are robust and reproducible. Despite this, there has been a notable absence of serious effort to establish the reliability of empirical research in economics. As Edward…

Read More

Energy Economics Announces a Special Replications Issue

The journal Energy Economics announced it was putting on a special issue dedicated to replications.  While all types of replications are invited, two types are of particular interest.  First, replications of older research that has been widely cited or influential…

Read More

Tales from the (Economics) Crypt

Recently, ANDREW GELMAN blogged about a communication he received from Per Pettersson-Lidbom, an economist at Stockholm University. Petterson shared three stories of “scientific fraud” in papers published in top economics journals.  Gelman writes, “… I’m sharing Pettersson’s stories, neither endorsing nor disputing their particulars but…

Read More

SVEN VLAEMINCK: Data Policies at Economics Journals: Theory and Practice

In economic sciences, empirically-based studies have become increasingly important: According to Hamermesh (2012), the number of contributions to journals in which authors utilized self-collected or externally produced datasets for statistical analyses have massively increased in the course of the last…

Read More

Is Economic Research Replicable? Study Concludes: “Usually Not”

In a recent working paper, authors ANDREW CHANG and PHILLIP LI examined 60 published, empirical papers in 13 economics journals to determine whether the research could be replicated.  Less than half of the papers could be replicated, even with help from…

Read More