Category: GUEST BLOGS


Economics E-Journal is Looking for a Few Good Replicators

The journal Economics: The Open Access, Open Assessment E-Journal is publishing a special issue on “The Practice of Replication.” This is how the journal describes it:  “The last several years have seen increased interest in replications in economics.  This was…

Read More

HUBBARD: A Common-Sense Typology of Replications

[NOTE: This entry is based on the book “Corrupt Research: The Case for Reconceptualizing Empirical Management and Social Science” by Raymond Hubbard] Psychology’s “reproducibility crisis” (Open Science Collaboration, 2015) has drawn attention to the need for replication research. However, focusing…

Read More

MENCLOVA: Is it Time for a Journal of Insignificant Results?

It is well known that there is a bias towards publication of statistically significant results. In fact, we have known this for at least 25 years since the publication of De Long and Lang (JPE 1992): “Economics articles are sprinkled…

Read More

GELMAN: Some Natural Solutions to the p-Value Communication Problem—And Why They Won’t Work

[NOTE: This is a repost of a blog that Andrew Gelman wrote for the blogsite Statistical Modeling, Causal Inference, and Social Science]. Blake McShane and David Gal recently wrote two articles (“Blinding us to the obvious? The effect of statistical…

Read More

CAMPBELL: On Perverse Incentives and Replication in Science

[NOTE: This is a repost of a blog that Doug Campbell wrote for his blogsite at douglaslcampbell.blogspot.co.nz] Stephen Hsu has a nice blog post on this topic. He writes about this common pattern: (1) Study reports results which reinforce the dominant,…

Read More

ANDERSON & MAXWELL: There’s More than One Way to Conduct a Replication Study – Six, in Fact

NOTE: This entry is based on the article, “There’s More Than One Way to Conduct a Replication Study: Beyond Statistical Significance” (Psychological Methods, 2016, Vol, 21, No. 1, 1-12) Following a large-scale replication project in economics (Chang & Li, 2015)…

Read More

MUELLER-LANGER, FECHER, HARHOFF & WAGNER: What Matters for Replication

NOTE: This entry is based on the paper, “The Economics of Replication” Replication studies are considered a hallmark of good scientific practice (1). Yet they are treated among researchers as an ideal to be professed but not practised (2, 3)….

Read More

FECHER, WAGNER & FRÄSSDORF: Social Scientists and Replications: Tell Me What You Really Think!

NOTE: This entry is based on the article, “Perceptions and Practices of Replication by Social and Behavioral Scientists: Making Replications a Mandatory Element of Curricula Would Be Useful”  In times of increasing publication rates and specialization of disciplines, it is…

Read More

HAMERMESH: Replications – Enough Already

NOTE: This entry is based on, “Replication in Labor Economics: Evidence from Data, and What It Suggests,” American Economic Review, 107 (May 2017) In Hamermesh (2007) I bemoaned the paucity of “hard-science” style replication in applied economics. I shouldn’t have,…

Read More

CAMPBELL: Is the AER Replicable? And is it Robust? Evidence from a Class Project

As part of a major replication and robustness project of articles in the American Economic Review, this fall I assigned students in my Masters Macro course at the New Economic School (Moscow) to replicate and test robustness for Macro papers…

Read More