The Replication Network
Furthering the Practice of Replication in Economics
Archives
Update from the AEA Data Editor on Replication and Reproducibility
[From the presentation slides on “Replication and Reproducibility in Social Sciences and Statistics: Context, Concerns, and Concrete Measures” by Lars Vilhuber, AEA Data Editor, presented at the 2019 Western Economics Association International meetings] NOTE: Just so there is no misunderstanding,…
Read MoreReproducibility in Registered Reports: Lots of Room for Improvement
[From the paper, “Analysis of Open Data and Computational Reproducibility in Registered Reports in Psychology” by Pepijn Obels, Daniel Lakens, Nicholas Coles, & Jaroslav Gottfried, posted at PsyArXiv Preprints] “Recently, scholars have started to empirically examine the extent to which data…
Read MoreEditor-in-Chief of Nature Wants Researchers to Make Their Data and Code Available
[From the article “Nature editor: researchers should be forced to make data public” by David Matthews, published at Times Higher Education] “The editor-in-chief of Nature has said that she would like to force researchers to make the data and code behind their…
Read MoreData Sharing in Political Science: Glass Half Empty? Or Full?
[From the article “Data Access, Transparency, and Replication: New Insights from the Political Behavior Literature” by Daniel Stockemer, Sebastian Koehler, and Tobias Lentz, in the October issue of PS: Political Science & Politics] “How many authors of articles published in journal with no mandatory data-access…
Read MoreAt the Journal Nature, Peer Reviewers Have the Right To…
[From an editorial published in Nature entitled, “Referees should exercise their rights”] “At Nature, we recognize that our peer reviewers have certain ‘rights’. One of the most well known is the right to anonymity. Less widely known is that referees have the…
Read MoreREED: How “Open Science” Can Discourage Good Science, And What Journals Can Do About It
In a recent tweet (or series of tweets) Kaitlyn Werner shares her experience of having a paper rejected after she posted all her data and code and submitted her paper to a journal. The journal rejected the paper because a…
Read MoreNot Everybody Thinks the Emphasis on Reproducibility is a Good Thing
[From the article “Reproducible research: a minority opinion” by Chris Drummond, published in the Journal of Experimental & Theoretical Artificial Intelligence.] “Reproducible research, a growing movement within many scientific fields, including machine learning, would require the code, used to generate…
Read MoreThe American Statistical Association Announces A New Reproducibility Policy
[From Dave Giles’ blog Econometrics Beat] The American Statistical Association announced several new initiatives to enhance reproducibility at its flagship journal, the Journal of the American Statistical Association (JASA). In addition to requiring submitters to provide data and code, JASA…
Read MoreBOB REED: On Andrew Gelman, Retractions, and the Supply and Demand for Data Transparency
In a recent interview on Retraction Watch, Andrew Gelman reveals that what keeps him up at night isn’t scientific fraud, it’s “the sheer number of unreliable studies — uncorrected, unretracted — that have littered the literature.” He then goes on…
Read MoreShould Journals Require Authors To Provide Data and Code? Arguments Against
In a blog for Retraction Watch, LIZ WAGNER argues that it is good when authors provide data and code. But it’s not necessarily the most important thing. Registering a research protocol would do more to prevent data mining and p-hacking….
Read More
The Replication Network 
You must be logged in to post a comment.