The Replication Network
Furthering the Practice of Replication in Economics
Archives
REED & LOGCHIES: Calculating Power After Estimation – No Programming Necessary!
Introduction. Your analysis produces a statistically insignificant estimate. Is it because the effect is negligibly different from zero? Or because your research design does not have sufficient power to achieve statistical significance? Alternatively, you read that “The median statistical power…
Read MoreWESSELBAUM: JCRE – An Outlet for Your Replications
Replication studies play a crucial role in economics by ensuring the reliability, validity, and robustness of research findings. In an era where policy decisions and societal interventions heavily rely on economic research, the ability to replicate and validate research findings…
Read MoreAoI*: “The Robustness Reproducibility of the American Economic Review” by Campbell et al. (2024)
[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “We estimate the robustness reproducibility of key results from 17 non-experimental AER…
Read MoreAoI*: “Mass Reproducibility and Replicability: A New Hope” by Brodeur et al. (2024)
[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “This study pushes our understanding of research reliability by producing and replicating claims…
Read MoreAoI*: “What Is the False Discovery Rate in Empirical Research?” by Engsted (2024)
[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “A scientific discovery in empirical research, e.g., establishing a causal relationship between two…
Read MoreAoI*: “Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement” by Brodeur et al. (2023)
[*AoI = “Articles of Interest” is a feature of TRN where we report excerpts of recent research related to replication and research integrity.] EXCERPTS (taken from the article) “Pre-registration is regarded as an important contributor to research credibility. We investigate this…
Read MoreAoI*: “The Significance of Data-Sharing Policy” by Azkarov et al. (2023)
[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “We assess the impact of mandating data-sharing in economics journals on two…
Read MoreREED: More on Self-Correcting Science and Replications: A Critical Review
NOTE: This is a another long blog. Sorry about that! TL;DR: I provide a common framework for evaluating 5 recent papers and critically compare them. All of the papers have shortcomings. I argue that the view that the psychology papers represent…
Read MoreREED: Is Science Self-Correcting? Evidence from 5 Recent Papers on the Effect of Replications on Citations
NOTE: This is a long blog. TL;DR: I discuss 5 papers and the identification strategies each use in their effort to identify a causal effect of replications on citations. One of the defining features of science is its ability to…
Read More
The Replication Network 
ROODMAN: Appeal to Me – First Trial of a “Replication Opinion”
Posted on by replicationnetwork
Leave a Comment
[This blog is a repost of a blog that first appeared at davidroodman.com. It is republished here with permission from the author.] My employer, Open Philanthropy, strives to make grants in light of evidence. Of course, many uncertainties in our…
Read MoreCategory: GUEST BLOGS Tags: Academic incentives, Comments, economics, Evidence-based policy, Journal policy, Meta-Science, Open Philanthropy, peer review, replications, Truth-seeking