Archives


Be a Part of the Next Big Thing! Join the Multi100 Project

The Multi100 project is a crowdsourced empirical project aiming to estimate how robust published results and conclusions in social and behavioral sciences are to analysts’ analytical choices. The project will involve more than 200 researchers. The Center for Open Science…

Read More

REED & WU: EiR* – Missing Data

[* EiR = Econometrics in Replications, a feature of TRN that highlights useful econometrics procedures for re-analysing existing research.] NOTE: This blog uses Stata for its estimation. All the data and code necessary to reproduce the results in the tables…

Read More

BRODEUR: Launching the Institute for Replication (I4R)

Replication is key to the credibility and confidence in research findings. As falsification checks of past evidence, replication efforts contribute in essential ways to the production of scientific knowledge. They allow us to assess which findings are robust, making science…

Read More

IREE Scores a Top Score in TOP Factor

The International Journal for Re-Views in Empirical Economics (IREE) is the only journal in economics solely dedicated to publishing replications. Recently, IREE was evaluated by TOP Factor. TOP Factor is an initiative launched by the Center for Open Science to…

Read More

On the Past and Present of Reproducibility and Replicability in Economics

[Excerpts are taken from the article “Reproducibility and Replicability in Economics” by Lars Vilhuber, published in Harvard Data Science Review] “In this overview, I provide a summary description of the history and state of reproducibility and replicability in the academic field…

Read More

REED: The State of Replications in Economics – A 2020 Review (Part 3)

This final instalment on the state of replications in economics, 2020 version, continues the discussion of how to define “replication success” (see here and here for earlier instalments). It then delves further into interpreting the results of a replication. I…

Read More

REED: The State of Replications in Economics – A 2020 Review (Part 2)

This instalment follows on yesterday’s post where I addressed two questions: Are there more replications in economics than there used to be? And, Which journals publish replications? These questions deal with the descriptive aspect of replications. We saw that replications…

Read More

REED: The State of Replications in Economics – A 2020 Review (Part 1)

This post is based on a keynote presentation I gave at the Editor’s Meeting of the International Journal for Re-Views of Empirical Economics in June 2020. It loosely follows up two previous attempts to summarize the state of replications in…

Read More

Pre-Analysis Plans in Economics: A Help or a Hindrance for Publication Success and Impact?

[Excerpts taken from the article “Do Pre-analysis Plans Hamper Publication?” by George Ofosu and Daniel Posner, published in the AER: Papers and Proceedings] “Pre-analysis plans (PAPs) have been criticized… that PAPs generate dull, lab-report-style papers that are disfavored by reviewers…

Read More

Assess Business and Economics Claims. Help Science! Make Money!

The repliCATS project is part of a research program called SCORE, funded by DARPA, that eventually aims to build automated tools that can rapidly and reliably assign confidence scores to social science research claims. Our method – the IDEA protocol – harnesses the power…

Read More