The Replication Network
Furthering the Practice of Replication in Economics
Archives
AoI*: “Conventional Wisdom, Meta-Analysis, and Research Revision in Economics” by Gechert et al. (2023)
Posted on by replicationnetwork
[*AoI = “Articles of Interest” is a feature of TRN where we report excerpts of recent research related to replication and research integrity.] EXCERPT (taken from the article) “The purpose of this study is to compare the findings of influential…
Read MoreCategory: GUEST BLOGS Tags: Conventional wisdom, maer-net, Meta-analysis, publication bias
REED: Doing Meta-Analyses with PCCs? Here’s Something You Might Not Know
Posted on by replicationnetwork
[This blog first appeared at the MAER-Net Blog under the title “Something I Recently Learned About PCCs That Maybe You Also Didn’t Know”, see here] While TRN is primarily dedicated to replications in economics, I also do research on meta-analysis. As…
Read MoreREED: Meta-Analysis and Univariate Regression Tests for Publication Bias – Seriously?
Posted on by replicationnetwork
[This blog first appeared at the MAER-Net Blog under the title “Univariate Regression Tests for Publication Bias: Why Do We Do Them?”, see here] The FAT-PET Framework: A standard meta-analysis article goes something like this (see, for example, Knaisch and…
Read MoreDUAN & REED: How Are Meta-Analyses Different Across Disciplines?
Posted on by replicationnetwork
INTRODUCTION Recently, one of us gave a workshop on how to conduct meta-analyses. The workshop was attended by participants from a number of different disciplines, including economics, finance, psychology, management, and health sciences. During the course of the workshop, it…
Read MoreCategory: GUEST BLOGS Tags: Disciplines, Effect size, Estimation, Fixed Effects, Journals, Meta-analysis, Random Effects
TER SCHURE: Accumulation Bias – How to handle it ALL-IN
Posted on by replicationnetwork
An estimated 85% of global health research investment is wasted (Chalmers and Glasziou, 2009); a total of one hundred billion US dollars in the year 2009 when it was estimated. The movement to reduce this research waste recommends that previous…
Read MoreCategory: GUEST BLOGS, Uncategorised Tags: Accumulation bias, Meta-analysis
Making Meta-Analyses “Open”: A How-To
Posted on by replicationnetwork
[Excerpts taken from the article “Conducting a Meta-Analysis in the Age of Open Science: Tools, Tips, and Practical Recommendations” by David Moreau and Beau Gamble, posted at PsyArXiv Preprints] “In this tutorial, we describe why open science is important in the…
Read MoreCategory: NEWS & EVENTS Tags: Meta-analysis, Open Science, Pre-registration, Psychology, R script, Templates, Transparency
One Question + Many Researchers = Many Different Answers
Posted on by replicationnetwork
[Excerpts taken from the article “Crowdsourcing hypothesis tests: Making transparent how design choices shape research results” by Justin Landy and many others, posted at the preprint repository at the University of Essex] “…we introduce a crowdsourced approach to hypothesis testing….
Read MoreCategory: NEWS & EVENTS Tags: crowdsourcing, Meta-analysis, Multiple research teams, Psychology, Random Effects, Reproducibility, Research design
A Must-Read on the Statistical Analysis of Replications
Posted on by replicationnetwork
[Excerpts taken from the article, “The Statistics of Replication” by Larry Hedges, pubished in the journal Methodology] Background “Some treatments of replication have defined replication in terms of the conclusions obtained by studies (e.g., did both studies conclude that the…
Read MoreReproducibility and Meta-Analyses: Two Great Concepts That Apparently Don’t Mix
Posted on by replicationnetwork
[Excerpts taken from the report “Examining the Reproducibility of Meta-Analyses in Psychology: A Preliminary Report” by Daniel Lakens et al., posted at MetaArXiv Preprints ] “…given the broad array of problems that make it difficult to evaluate the evidential value…
Read MoreCategory: NEWS & EVENTS Tags: BITSS, Daniel Lakens, Meta-analysis, Open Science Framework, Psychology, Reproducibility
To Your List of Biases in Meta-Analyses, Add This One: Accumulation Bias
Posted on by replicationnetwork
[From the preprint “Accumulation bias in meta-analysis: the need to consider time in error control” by Judith ter Schure and Peter Grünwald, posted at arXiv.org] “Studies accumulate over time and meta-analyses are mainly retrospective. These two characteristics introduce dependencies between…
Read More
Tags
Andrew Gelman BITSS Brian Nosek Data sharing economics Journal policies Meta-analysis null hypothesis significance testing Open Science p-hacking p-values Pre-registration Psychology publication bias Registered Reports replication replication crisis replications Reproducibility TransparencyBlogroll
Recent Posts
- COUPÉ: Why You Should Add a Specification Curve Analysis to Your Replications – and All Your Papers!
- AoI*: “Mass Reproducibility and Replicability: A New Hope” by Brodeur et al. (2024)
- COUPÉ: I Tried to Replicate a Paper with ChatGPT 4. Here is What I Learned.
- AoI*: “What Is the False Discovery Rate in Empirical Research?” by Engsted (2024)
- AoI*: “Estimating the Extent of Selective Reporting: An Application to Economics” by Bruns et al. (2024)
The Replication Network 
You must be logged in to post a comment.