Archives


Calling All PhD Students: Do a Replication. Get Paid.

J-PAL has been awarded a three-year grant to promote Research Transparency and Reproducibility. One primary component of this grant is to facilitate the reproducibility of 36 studies through pre-publication reanalyses, a new attempt to conduct code replications of research before…

Read More

HOU, XUE, & ZHANG: Replication Controversies in Finance & Accounting

[NOTE: This entry is based on the article “Replicating Anomalies” (SSRN, updated in June 2017, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2961979%5D Finance academics have started to take replication studies seriously. As hundreds of factors have been documented in recent decades, the concern over p-hacking has become…

Read More

IN THE NEWS: NY Times (MAY 29, 2017)

[From the article “Science Needs a Solution for the Temptation of Positive Results” by Aaron E. Carroll at The New York Times/The Upshot website]   “Science has a reproducibility problem. … As long as the academic environment has incentives for…

Read More

Concurrent Replication

[From Rolf Zwaan’s blog “Zeitgeist”.] “A form of replication that has received not much attention yet is what I will call concurrent replication. The basic idea is this. A research group formulates a hypothesis that they want to test. At…

Read More

Elsevier and the 5 Diseases of Academic Research

[From the article “5 diseases ailing research — and how to cure them” at Elsevier Connect, the daily news site for Elsevier Publishing.] This article summarizes the “diseases” ailing scientific research as identified in the article “On doing better science: From thrill…

Read More

LAKENS: Examining the Lack of a Meaningful Effect Using Equivalence Tests

When we perform a study, we would like to conclude there is an effect, when there is an effect. But it is just as important to be able to conclude there is no effect, when there is no effect. So…

Read More

Economics E-Journal is Looking for a Few Good Replicators

The journal Economics: The Open Access, Open Assessment E-Journal is publishing a special issue on “The Practice of Replication.” This is how the journal describes it:  “The last several years have seen increased interest in replications in economics.  This was…

Read More

How to Fix the “Reproducibility Crisis”? Three Solutions

[From the article “The science ‘reproducibility crisis’ — and what can be done about it” from the website theconversation.com.] “Reproducibility is the idea that an experiment can be repeated by another scientist and they will get the same result. It is…

Read More

How Many Ways Are There to Replicate? The Journal Scientific Data Presents a Collection of Examples

[From the abstract of the article, “Replication data collection highlights value in diversity of replication attempts”, by DeSoto and Schweinsberg in the journal Scientific Data.]   “Researchers agree that replicability and reproducibility are key aspects of science. A collection of Data…

Read More

CAMPBELL: On Perverse Incentives and Replication in Science

[NOTE: This is a repost of a blog that Doug Campbell wrote for his blogsite at douglaslcampbell.blogspot.co.nz] Stephen Hsu has a nice blog post on this topic. He writes about this common pattern: (1) Study reports results which reinforce the dominant,…

Read More