Archives


GRUNOW: Update on IREE – the First and Only Journal Dedicated to Replications in Economics

IREE (the International Journal for Re-Views in Empirical Economics) was launched in September 2017, supported by our prestigious board of academic advisors: Sir Angus Deaton, Richard Easterlin, and Jeffrey Wooldridge. It is the first, and, to date, only journal solely…

Read More

Replications Can Lessen the Pressure To Get It Right the First Time — And That Can Be a Good Thing

[From the blog “(back to basics:) How is statistics relevant to scientific discovery?” by Andrew Gelman, posted at Statistical Modeling, Causal Inference, and Social Science] “If we are discouraged from criticizing published work—or if our criticism elicits pushback and attacks…

Read More

REED: Replications in Economics are Different from Replications in Psychology, and Other Thoughts

In July 2017, Economics: The Open Access, Open Assessment E-Journal issued a call for papers for a special issue on the practice of replication. The call stated, “This special issue is designed to highlight alternative approaches to doing replications, while…

Read More

Has Replication’s Time Finally Arrived?

[From the article “Replications on the Rise” by Stuart Buck, posted at Arnold Ventures] “Once a poorly rewarded scientific value, replication has seen a boom with studies in everything from psychology to dogs.” “A significant tipping point was the Reproducibility Project…

Read More

What If There Isn’t a Single Effect Size? Implications for Power Calculations, Hypothesis Testing, Confidence Intervals and Replications

[From the working paper “The Unappreciated Heterogeneity of Effect Sizes:Implications for Power, Precision, Planning of Research, and Replication” by David Kenny and Charles Judd, posted at Open Science Framework (OSF)] “The goal of this article is to examine the implications…

Read More

“Replicate Early and Often”

[From the working paper “The Dozen Things Experimental Economists Should Do (More Of)” by Eszter Czibor, David Jimenez-Gomez, and John List, Working Paper 25451 in the NBER Working Paper Series] “…We believe that the best approach to increasing the reliability of…

Read More

COUPÉ: So You Want To Do a Replication – Here Are Some Things To Think About Before Starting on a Replication Project!

On October 26th, 2018, 3 colleagues and myself organized a workshop on reproducibility and integrity in scientific research at the University of Canterbury, New Zealand. Here are some things you might want to be aware of when thinking about doing…

Read More

Original Study Finds A Result. Follow-up Studies Fail to Replicate It. The Record is Corrected. Right?

[From the post “A study fails to replicate, but it continues to get referenced as if it had no problems. Communication channels are blocked.” by Andrew Gelman at Statistical Modeling, Causal Inference, and Social Science] “In 2005, Michael Kosfeld, Markus Heinrichs,…

Read More

MUELLER-LANGER et al.: Replication in Economics

[This blog is based on the article “ Replication studies in economics—How many and which papers are chosen for replication, and why?” by Frank Mueller-Langer, Benedikt Fecher, Dietmar Harhoff, and Gert Wagner, published in the journal Research Policy] Academia is…

Read More

HIRSCHAUER et al.: Why replication is a nonsense exercise if we stick to dichotomous significance thinking and neglect the p-value’s sample-to-sample variability

[This blog is based on the paper “Pitfalls of significance testing and p-value variability: An econometrics perspective” by Norbert Hirschauer, Sven Grüner, Oliver Mußhoff, and Claudia Becker, Statistics Surveys 12(2018): 136-172.] Replication studies are often regarded as the means to…

Read More