Archives


AoI*: “The Robustness Reproducibility of the American Economic Review” by Campbell et al. (2024)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “We estimate the robustness reproducibility of key results from 17 non-experimental AER…

Read More

AoI*: “Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement” by Brodeur  et al. (2023)

[*AoI = “Articles of Interest” is a feature of TRN where we report excerpts of recent research related to replication and research integrity.] EXCERPTS (taken from the article) “Pre-registration is regarded as an important contributor to research credibility. We investigate this…

Read More

Et tu, Finance?

[Excerpts are taken from the article “The hidden ‘replication crisis’ of finance”, by Robin Wigglesworth, published at Financial Times online.] “It may sound like a low-budget Blade Runner rip-off, but over the past decade the scientific world has been gripped…

Read More

IN THE NEWS: Wired (November 26, 2019)

[Excerpts taken from the article, “We’re All ‘P-Hacking’ Now” by Christie Aschwanden, publised in Wired] “It’s got an entry in the Urban Dictionary, been discussed on Last Week Tonight with John Oliver, scored a wink from Cards Against Humanity, and now it’s been featured…

Read More

GOODMAN & REED: A Friendly Debate about Pre-Registration

Background: Nat Goodman is generally pessimistic about the benefits of pre-registration. Bob Reed is generally optimistic about pre-registration. What follows is a back-and-forth dialogue about what each likes and dislikes about pre-registration. [GOODMAN, Opening Statement] We need to remember that…

Read More

In Two Decades, Will We Look Back And Wonder At All the Flawed Research?

[From the article, “Rein in the four horsemen of irreproducibility”, by Dorothy Bishop, published in Nature] “More than four decades into my scientific career, I find myself an outlier among academics of similar age and seniority: I strongly identify with…

Read More

Disagreeing With Disagreeing About Abandoning Statistical Significance

[From the preprint “Abandoning statistical significance is both sensible and practical” by Valentin Amrhein, Andrew Gelman, Sander Greenland, and Blakely McShane, available at PeerJ Preprints] “Dr Ioannidis writes against our proposals to abandon statistical significance…” “…we disagree that a statistical…

Read More

IN THE NEWS: Undark (March 21, 2019)

[From the article “Stats Experts Plead: Just Say No to P-Hacking” by Dalmeet Singh Chawla, published in Undark] “For decades, researchers have used a statistical measure called the p-value — a widely-debated statistic that even scientists find difficult to define — that is…

Read More

When Trying to Explain p-Values, Maybe Try This?

[From the blog “P-values 101: An attempt at an intuitive but mathematically correct explanation” by Xenia Schmalz, posted at Xenia Schmalz’s blog] “…what exactly are p-values, what is p-hacking, and what does all of that have to do with the replication crisis?…

Read More

How Pre-Registration Can Lead to Higher-Powered Studies and Increase Reproducibility

[From the paper “Preregistration and reproducibility” by Eirik Strømland, forthcoming in the Journal of Economic Psychology] “I present a simple model in which the research community is populated by agents who may report their results unconditionally or conditionally on statistical…

Read More