The Replication Network
Furthering the Practice of Replication in Economics
Archives
REED: Another Reason to Prefer Random Effects Over Fixed Effects/UWLS Meta-Analysis
Posted on by replicationnetwork
NOTE: This blog is a repost of a blog that was previously published at the MAER-Net blogsite (see here) Introduction Random Effects (RE) versus Fixed Effects (FE) has a long and active debate history. More recently, a “Knapp–Hartung–like” version of…
Read MoreCategory: GUEST BLOGS Tags: "Few studies" problem, Fixed Effects/UWLS, Heterogeneity, Meta-analysis, Random Effects, Shiny app, Stanley
AoI*: “Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology” by Gould et al. (2025)
Posted on by replicationnetwork
[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “We [implemented] a large-scale empirical exploration of the variation in effect sizes and…
Read MoreAoI*: “Conventional Wisdom, Meta-Analysis, and Research Revision in Economics” by Gechert et al. (2023)
Posted on by replicationnetwork
[*AoI = “Articles of Interest” is a feature of TRN where we report excerpts of recent research related to replication and research integrity.] EXCERPT (taken from the article) “The purpose of this study is to compare the findings of influential…
Read MoreCategory: GUEST BLOGS Tags: Conventional wisdom, maer-net, Meta-analysis, publication bias
REED: Doing Meta-Analyses with PCCs? Here’s Something You Might Not Know
Posted on by replicationnetwork
[This blog first appeared at the MAER-Net Blog under the title “Something I Recently Learned About PCCs That Maybe You Also Didn’t Know”, see here] While TRN is primarily dedicated to replications in economics, I also do research on meta-analysis. As…
Read MoreREED: Meta-Analysis and Univariate Regression Tests for Publication Bias – Seriously?
Posted on by replicationnetwork
[This blog first appeared at the MAER-Net Blog under the title “Univariate Regression Tests for Publication Bias: Why Do We Do Them?”, see here] The FAT-PET Framework: A standard meta-analysis article goes something like this (see, for example, Knaisch and…
Read MoreDUAN & REED: How Are Meta-Analyses Different Across Disciplines?
Posted on by replicationnetwork
INTRODUCTION Recently, one of us gave a workshop on how to conduct meta-analyses. The workshop was attended by participants from a number of different disciplines, including economics, finance, psychology, management, and health sciences. During the course of the workshop, it…
Read MoreCategory: GUEST BLOGS Tags: Disciplines, Effect size, Estimation, Fixed Effects, Journals, Meta-analysis, Random Effects
TER SCHURE: Accumulation Bias – How to handle it ALL-IN
Posted on by replicationnetwork
An estimated 85% of global health research investment is wasted (Chalmers and Glasziou, 2009); a total of one hundred billion US dollars in the year 2009 when it was estimated. The movement to reduce this research waste recommends that previous…
Read MoreCategory: GUEST BLOGS, Uncategorised Tags: Accumulation bias, Meta-analysis
Making Meta-Analyses “Open”: A How-To
Posted on by replicationnetwork
[Excerpts taken from the article “Conducting a Meta-Analysis in the Age of Open Science: Tools, Tips, and Practical Recommendations” by David Moreau and Beau Gamble, posted at PsyArXiv Preprints] “In this tutorial, we describe why open science is important in the…
Read MoreCategory: NEWS & EVENTS Tags: Meta-analysis, Open Science, Pre-registration, Psychology, R script, Templates, Transparency
One Question + Many Researchers = Many Different Answers
Posted on by replicationnetwork
[Excerpts taken from the article “Crowdsourcing hypothesis tests: Making transparent how design choices shape research results” by Justin Landy and many others, posted at the preprint repository at the University of Essex] “…we introduce a crowdsourced approach to hypothesis testing….
Read MoreCategory: NEWS & EVENTS Tags: crowdsourcing, Meta-analysis, Multiple research teams, Psychology, Random Effects, Reproducibility, Research design
A Must-Read on the Statistical Analysis of Replications
Posted on by replicationnetwork
[Excerpts taken from the article, “The Statistics of Replication” by Larry Hedges, pubished in the journal Methodology] Background “Some treatments of replication have defined replication in terms of the conclusions obtained by studies (e.g., did both studies conclude that the…
Read More
Tags
Andrew Gelman BITSS Brian Nosek Data sharing economics Journal policies Meta-analysis null hypothesis significance testing Open Science p-hacking p-values Pre-registration Psychology publication bias Registered Reports replication replication crisis replications Reproducibility TransparencyBlogroll
Recent Posts
- REED: Another Reason to Prefer Random Effects Over Fixed Effects/UWLS Meta-Analysis
- REED: You Can Calculate Power Retrospectively — Just Don’t Use Observed Power
- ROODMAN: Appeal to Me – First Trial of a “Replication Opinion”
- AoI*: “Introducing Synchronous Robustness Reports” by Bartos et al. (2025)
- AoI*: “The Sources of Researcher Variation in Economics” by Huntington-Klein et al. (2025)
The Replication Network 
You must be logged in to post a comment.