Category: GUEST BLOGS


REED: You Can Calculate Power Retrospectively — Just Don’t Use Observed Power

In this blog, I highlight a valid approach for calculating power after estimation—often called retrospective power. I provide a Shiny App that lets readers explore how the method works and how it avoids the pitfalls of “observed power” — try…

Read More

ROODMAN: Appeal to Me – First Trial of a “Replication Opinion”

[This blog is a repost of a blog that first appeared at davidroodman.com. It is republished here with permission from the author.] My employer, Open Philanthropy, strives to make grants in light of evidence. Of course, many uncertainties in our…

Read More

AoI*: “Introducing Synchronous Robustness Reports” by Bartos et al. (2025)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] NOTE: The article is behind a firewall. ABSTRACT (taken from the article) “Most empirical research articles feature a…

Read More

AoI*: “The Sources of Researcher Variation in Economics” by Huntington-Klein et al. (2025)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “We use a rigorous three-stage many-analysts design to assess how different researcher decisions—specifically…

Read More

AoI*: “Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology” by Gould et al. (2025)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “We [implemented] a large-scale empirical exploration of the variation in effect sizes and…

Read More

AoI*: “Decisions, Decisions, Decisions: An Ethnographic Study of Researcher Discretion in Practice” by van Drimmelen et al. (2024)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “This paper is a study of the decisions that researchers take during the…

Read More

AoI*: “Open minds, tied hands: Awareness, behavior, and reasoning on open science and irresponsible research behavior” by Wiradhany et al. (2025)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “Knowledge on Open Science Practices (OSP) has been promoted through responsible conduct of…

Read More

RÖSELER: Replication Research Symposium and Journal

Efforts to teach, collect, curate, and guide replication research are culminating in the new diamond open access journal Replication Research, which will launch in late 2025. The Framework for Open and Reproducible Research Training (FORRT; forrt.org) and the Münster Center…

Read More

AoI*: “: Comparing Human-Only, AI-Assisted, and AI-Led Teams on Assessing Research Reproducibility in Quantitative Social Science” by Brodeur et al. (2025)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “This study evaluates the effectiveness of varying levels of human and artificial intelligence…

Read More

AoI*: “Do experimental asset market results replicate? High powered preregistered replications of 17 claims” by Huber et al. (2024)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “Experimental asset markets provide a controlled approach to studying financial markets. We attempt…

Read More