Archives


Gelman Post on “Failure of Failure to Replicate” a Great Read

Andrew Gelman had a great post yesterday that highlights a major issue — a really major issue — with replication. The problem is, there is no commonly accepted definition of what a “replication” is. Even when a definition is provided,…

Read More

Journal of Economic Psychology Calls for Papers for Special Replication Issue

[From the website of the Journal of Economic Psychology announcing a special issue on “Replications in Economic Psychology and Behavioral Economics”] “In this special issue, we aim to contribute to ongoing efforts in both disciplines to test the replicability of…

Read More

ROYNE: Building and Enhancing the Advertising Discipline Through Replication

[This blog is taken from a recent editorial that appeared in the Journal of Advertising Research entitled “Why We Need More Replication Studies to Keep Empirical Knowledge in Check” by Marla B. Royne. The full-length editorial can be found here]…

Read More

National Science Foundation Now Funding Replication Studies. In Neuroscience.

[From the post “Dear Colleague Letter: Achieving New Insights through Replicability and Reproducibility” published at nsf.gov] “The National Science Foundation’s (NSF) Directorate for Social, Behavioral and Economic Sciences (SBE) encourages submission of proposals that target reproducibility and replicability efforts in…

Read More

IN THE NEWS: Nature (February 21, 2018)

[From the article, “How to make replication the norm” published by Paul Gertler, Sebastian Galiani and Mauricio Romero in Nature] “To see how often the posted data and code could readily replicate original results, we attempted to recreate the tables…

Read More

VALLOIS & JULLIEN: Is Experimental Economics Really Doing Better? The Case of Public Goods Experiments

[From the working paper, “Replication in experimental economics: A historical and quantitative approach focused on public good game experiments” by Nicolas Vallois and Dorian Jullien] The current “replication crisis” concerns the inability of scientists to “replicate”, i.e. to reproduce a great…

Read More

IN THE NEWS: Nature (January 23, 2018)

[From the article “Robust research needs many lines of evidence” by Marcus Munafò and George Davey Smith, published in Nature]  “…replication alone will get us only so far. In some cases, routine replication might actually make matters worse. Consistent findings could take…

Read More

Replication Meets a Study About Attitudes Towards Gays: How Could There Not Be Controversy?

[From the article “Study that said hate cuts 12 years off gay lives fails to replicate”, posted at Retraction Watch] “A highly cited paper has received a major correction as a result of the ongoing battle over attitudes towards gay…

Read More

DON’T: Aim for significance. DO: Aim for precision

[From the recent working paper, “The statistical significance filter leads to overoptimistic expectations of replicability” by Vasishth, Mertzen, Jäger, and Gelman posted at PsyArXiv Preprints] “…when power is low, using significance to decide whether to publish a result leads to a proliferation of exaggerated…

Read More

National Academies of Science-Funded Committee on Research Reproducibility Holds First Meeting

[From the article “National Academies Launches Study of Research Reproducibility and Replicability” by Will Thomas, posted at FYI: Science Policy News from AIP (American Institute of Physics)] “On Dec. 12 and 13, the National Academies convened the first meeting of…

Read More