Archives


IN THE NEWS: Slate (June 20, 2019)

[From the article “We Tried to Publish a Replication of a Science Paper in Science. The Journal Refused.” by Kevin Arceneaux, Bert Bakker, Claire Gothreau, and Gijs Schumacher, published in Slate]  “Our story starts in 2008, when a group of researchers…

Read More

REED: EiR* – Heterogeneity in Two-Way Fixed Effects Models

[* EiR = Econometrics in Replications, a feature of TRN that highlights useful econometrics procedures for re-analysing existing research. The material for this blog is drawn from the recent working paper “Two-way fixed effects estimators with heterogeneous treatment effects” by…

Read More

GRUNOW: Update on IREE – the First and Only Journal Dedicated to Replications in Economics

IREE (the International Journal for Re-Views in Empirical Economics) was launched in September 2017, supported by our prestigious board of academic advisors: Sir Angus Deaton, Richard Easterlin, and Jeffrey Wooldridge. It is the first, and, to date, only journal solely…

Read More

Replications Can Lessen the Pressure To Get It Right the First Time — And That Can Be a Good Thing

[From the blog “(back to basics:) How is statistics relevant to scientific discovery?” by Andrew Gelman, posted at Statistical Modeling, Causal Inference, and Social Science] “If we are discouraged from criticizing published work—or if our criticism elicits pushback and attacks…

Read More

REED: Replications in Economics are Different from Replications in Psychology, and Other Thoughts

In July 2017, Economics: The Open Access, Open Assessment E-Journal issued a call for papers for a special issue on the practice of replication. The call stated, “This special issue is designed to highlight alternative approaches to doing replications, while…

Read More

Has Replication’s Time Finally Arrived?

[From the article “Replications on the Rise” by Stuart Buck, posted at Arnold Ventures] “Once a poorly rewarded scientific value, replication has seen a boom with studies in everything from psychology to dogs.” “A significant tipping point was the Reproducibility Project…

Read More

What If There Isn’t a Single Effect Size? Implications for Power Calculations, Hypothesis Testing, Confidence Intervals and Replications

[From the working paper “The Unappreciated Heterogeneity of Effect Sizes:Implications for Power, Precision, Planning of Research, and Replication” by David Kenny and Charles Judd, posted at Open Science Framework (OSF)] “The goal of this article is to examine the implications…

Read More

“Replicate Early and Often”

[From the working paper “The Dozen Things Experimental Economists Should Do (More Of)” by Eszter Czibor, David Jimenez-Gomez, and John List, Working Paper 25451 in the NBER Working Paper Series] “…We believe that the best approach to increasing the reliability of…

Read More

COUPÉ: So You Want To Do a Replication – Here Are Some Things To Think About Before Starting on a Replication Project!

On October 26th, 2018, 3 colleagues and myself organized a workshop on reproducibility and integrity in scientific research at the University of Canterbury, New Zealand. Here are some things you might want to be aware of when thinking about doing…

Read More

Original Study Finds A Result. Follow-up Studies Fail to Replicate It. The Record is Corrected. Right?

[From the post “A study fails to replicate, but it continues to get referenced as if it had no problems. Communication channels are blocked.” by Andrew Gelman at Statistical Modeling, Causal Inference, and Social Science] “In 2005, Michael Kosfeld, Markus Heinrichs,…

Read More