Category: GUEST BLOGS


REED: The Replication Crisis – A Single Replication Can Make a Big Difference

[This post is based on the paper, “A Primer on the ‘Reproducibility Crisis’ and Ways to Fix It” by the author] In a previous post, I argued that lowering α from 0.05 to 0.005, as advocated by Benjamin et al….

Read More

MURPHY: Quantifying the Role of Research Misconduct in the Failure to Replicate

[NOTE: This blog is based on the article “HARKing: How Badly Can Cherry-Picking and Question Trolling Produce Bias in Published Results?” by Kevin Murphy and Herman Aguinis, recently published in the Journal of Business and Psychology.] The track record for…

Read More

LEBEL: Curate Science – 2017 Year in Review and Upcoming Plans for 2018

Curate Science (CurateScience.org) is an online platform to track, organize, and interpret replications of published findings in the social sciences, with a current focus on the psychology literature. We had a very productive year in 2017. Here are some highlights…

Read More

REED: Why Lowering Alpha to 0.005 is Unlikely to Help

[This blog is based on the paper, “A Primer on the ‘Reproducibility Crisis’ and Ways to Fix It” by the author] A standard research scenario is the following: A researcher is interested in knowing whether there is a relationship between…

Read More

REED: An Open Invitation to Give Your Perspective on “The Practice of Replication”

In September of this year, the journal Economics: The Open Access, Open Assessment E-Journal published a series of Discussion Papers for a special issue on “The Practice of Replication”. The motivation behind the special issue came from the following two…

Read More

PARASURAMA: Why Overlapping Confidence Intervals Mean Nothing About Statistical Significance

[NOTE: This is a repost of a blog that Prasanna Parasurama published at the blogsite Towards Data Science]. “The confidence intervals of the two groups overlap, hence the difference is not statistically significant”  The statement above is wrong. Overlapping confidence…

Read More

MCSHANE & GAL: Statistical Significance and Dichotomous Thinking Among Economists

[Note: This blog is based on our articles “Blinding Us to the Obvious? The Effect of Statistical Training on the Evaluation of Evidence” (Management Science, 2016) and “Statistical Significance and the Dichotomization of Evidence” (Journal of the American Statistical Association,…

Read More

SUTCH: Lesson Learned from Replicating Piketty — How Not To Do Economic History

[NOTE: This post refers to the article “The One Percent across Two Centuries: A Replication of Thomas Piketty’s Data on the Concentration of Wealth in the United States” by Richard Sutch. It appears in the current issue of the journal Social…

Read More

GRUNOW: Say Hello to IREE – A New Economics Journal Dedicated to the Publishing of Replication Studies

Replications are pivotal for the credibility of empirical economics. Evidence-based policy requires findings that are robust and reproducible. Despite this, there has been a notable absence of serious effort to establish the reliability of empirical research in economics. As Edward…

Read More

GRUNOW: Notes from a Workshop: “Replications in Empirical Economics – Ways Out of the Crisis”

“Next year, this topic should not be discussed in a pre-conference workshop but in the opening plenum of the conference!” This statement by a young researcher not only concluded the workshop but also gave bright prospects to replications in Economics….

Read More