Archives


Data Sharing in Political Science: Glass Half Empty? Or Full?

[From the article “Data Access, Transparency, and Replication: New Insights from the Political Behavior Literature” by Daniel Stockemer, Sebastian Koehler, and Tobias Lentz, in the October issue of PS: Political Science & Politics] “How many authors of articles published in journal with no mandatory data-access…

Read More

At the Journal Nature, Peer Reviewers Have the Right To…

[From an editorial published in Nature entitled, “Referees should exercise their rights”] “At Nature, we recognize that our peer reviewers have certain ‘rights’. One of the most well known is the right to anonymity. Less widely known is that referees have the…

Read More

REED: How “Open Science” Can Discourage Good Science, And What Journals Can Do About It

In a recent tweet (or series of tweets) Kaitlyn Werner shares her experience of having a paper rejected after she posted all her data and code and submitted her paper to a journal. The journal rejected the paper because a…

Read More

Not Everybody Thinks the Emphasis on Reproducibility is a Good Thing

[From the article “Reproducible research: a minority opinion” by Chris Drummond, published in the Journal of Experimental & Theoretical Artificial Intelligence.] “Reproducible research, a growing movement within many scientific fields, including machine learning, would require the code, used to generate…

Read More

The American Statistical Association Announces A New Reproducibility Policy

[From Dave Giles’ blog Econometrics Beat]  The American Statistical Association announced several new initiatives to enhance reproducibility at its flagship journal, the Journal of the American Statistical Association (JASA).  In addition to requiring submitters to provide data and code, JASA…

Read More

BOB REED: On Andrew Gelman, Retractions, and the Supply and Demand for Data Transparency

In a recent interview on Retraction Watch, Andrew Gelman reveals that what keeps him up at night isn’t scientific fraud, it’s “the sheer number of unreliable studies — uncorrected, unretracted — that have littered the literature.”  He then goes on…

Read More

Should Journals Require Authors To Provide Data and Code? Arguments Against

In a blog for Retraction Watch, LIZ WAGNER argues that it is good when authors provide data and code.  But it’s not necessarily the most important thing.  Registering a research protocol would do more to prevent data mining and p-hacking….

Read More

At Least We’re Better Than Sociologists?

In a recent blog on orgtheory.net, Cristobal Young reports: “We conducted a small field experiment as part of a graduate course in statistical analysis. Students selected sociological articles that they admired and wanted to learn from, and asked the authors…

Read More

B.D.MCCULLOUGH: The Reason so Few Replications Get Published Is….

When preparing to give a talk at a conference recently, I decided to update some information I had published a few years ago.  In McCullough (2009), I estimated that 16 economics journals had a mandatory data/code archive (archives that require…

Read More

RICHARD ANDERSON: Replication and the Zen of Home Repair

This summer is the first since my retirement from government that I find myself without academic obligations here or abroad.  Instead, I am focused on starting to rehab a tattered house that I recently purchased jointly with one of my…

Read More