Archives


A Must-Read on the Statistical Analysis of Replications

[Excerpts taken from the article, “The Statistics of Replication” by Larry Hedges, pubished in the journal Methodology] Background “Some treatments of replication have defined replication in terms of the conclusions obtained by studies (e.g., did both studies conclude that the…

Read More

REED: EiR* – More on Heterogeneity in Two-Way Fixed Effects Models

[* EiR = Econometrics in Replications, a feature of TRN that highlights useful econometrics procedures for re-analysing existing research. The material for this blog is primarily drawn from the recent working paper “Difference-in-differences with variation in treatment timing” by Andrew…

Read More

Bad News and Good News for Meta-Analyses in Economics

[Excerpts taken from the working paper “Practical Significance, Meta-Analysis and the Credibility of Economics” by Tom Stanley and Chris Doucouliagos, posted at SSRN] “…we find that large biases and high rates of false positives will often be found by conventional meta-analysis methods….

Read More

What If There Isn’t a Single Effect Size? Implications for Power Calculations, Hypothesis Testing, Confidence Intervals and Replications

[From the working paper “The Unappreciated Heterogeneity of Effect Sizes:Implications for Power, Precision, Planning of Research, and Replication” by David Kenny and Charles Judd, posted at Open Science Framework (OSF)] “The goal of this article is to examine the implications…

Read More

How Should One Statistically Analyse a Replication? It Depends.

[From the preprint, “Statistical Analyses for Studying Replication: Meta-Analytic Perspectives” by Larry Hedges and Jacob Schauer, forthcoming in Psychological Methods] “Formal empirical assessments of replication have recently become more prominent in several areas of science, including psychology. These assessments have…

Read More

What Can Meta-Analyses Tell Us About Reproducibility?

[From the abstract of the article “What Meta-Analyses Reveal About the Replicability of Psychological Research” by T.D. Stanley, Evan Carter, and Hristos Doucouliagos, published in Psychological Bulletin] “Can recent failures to replicate psychological research be explained by typical magnitudes of statistical power,bias…

Read More