Archives


How to Certify Reproducibility for Confidential Data. In France.

[From the article “Certify reproducibility with confidential data” by Christophe Pérignon, Kamel Gadouche, Christophe Hurlin, Roxane Silberman, and Eric Debonnel, published in Science] “Many government data, such as sensitive information on individuals’ taxes, income, employment, or health, are available only…

Read More

Pre-registration. From clinical trials. To psychology. Next, the world?

[From the article “More and more scientists are preregistering their studies. Should you?” by Kai Kupferschmidt, published in Science] “…Preregistration, in its simplest form, is a one-page document answering basic questions such as: What question will be studied? What is the hypothesis?…

Read More

CSI: Tilburg

[From the article “The truth squad” by Erik Stokstad, published in Science] “In August 2011, Diederik Stapel, a prominent psychologist and a dean at Tilburg University here, confessed to faking data for dozens of papers over 15 years. As part of an internal…

Read More

Are Meta-Analyses Overrated?

[From the article, “Meta-analyses were supposed to end scientific debates. Often, they only cause more controversy” by Jop de Vrieze, published at http://www.sciencemag.org%5D “Meta-analyses were thought to be debate enders, but now we know they rarely are,” Ferguson says. “They should…

Read More

Big New Replication Study in Nature! Read All About It!

[From the abstract of the article “Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015″, published in Nature Human Behaviour by Colin Camerer et al.] “Being able to replicate scientific findings is crucial for scientific progress. We replicate 21 systematically…

Read More

IN THE NEWS: Science (July 31, 2018)

[From the article, “Plan to replicate 50 high-impact cancer papers shrinks to just 18” by Jocelyn Kaiser, published in Science magazine] “An ambitious project that set out nearly 5 years ago to replicate experiments from 50 high-impact cancer biology papers, but gradually shrank…

Read More

Reproducibility Making Progress at Science

[From the article, “Progress in Reproducibility” by Jeremy Berg, Editor-in-Chief  Science Journals, published in the 5 January 2018 issue of Science] “Over the past year, we have retracted three papers previously published in Science. The circumstances of these retractions highlight some…

Read More

Replicability of Laboratory Experiments in Economics: The Glass is 61% Full

[From the article “Evaluating replicability of laboratory experiments in economics” published in Science] Researchers today reported the results of a collaborative project in which 18 experimental economics studies originally published in the American Economic Review and the Quarterly Journal of Economics were replicated.  The researchers…

Read More

A Brief History of Replication Efforts

FROM THE ARTICLE: “Worries about irreproducibility – when researchers find it impossible to reproduce the results of an experiment when it is rerun under the same conditions – came to the fore again last week when a landmark effort to…

Read More

But Not as Good as Psychologists?

The website FiveThirtyEight has a thoughtful post reflecting on the recent study in psychology in which 100 experimental studies were replicated . At least two points are worth highlighting.  First, despite the concern about p-hacking, it turns out that one…

Read More