The Replication Network
Furthering the Practice of Replication in Economics
Archives
2 Humps = P-Hacking + Publication Bias?
In a recent blogpost at Simply Statistics, Jeff Leek announced a new R package called tidypvals: “The tidypvals package is an effort to find previous collections of published p-values, synthesize them, and tidy them into one analyzable data set.” In a preview…
Read MoreIf At First You Don’t Succeed, Change Alpha
In a recent working paper, posted on PsyArXiv Preprints, Daniel Benjamin, James Berger, Magnus Johanneson, Brian Nosek, Eric-Jan Wagenmakers, and 67 other authors(!) argue for a stricter standard of statistical significance for studies claiming new discoveries. In their words: “…we…
Read MoreIN THE NEWS: NY Times (MAY 29, 2017)
[From the article “Science Needs a Solution for the Temptation of Positive Results” by Aaron E. Carroll at The New York Times/The Upshot website] “Science has a reproducibility problem. … As long as the academic environment has incentives for…
Read MoreSCHÖNBRODT: Learn to p-Hack Like the Pros!
(NOTE: This ironic blog post was originally published on http://www.nicebread.de/introducing-p-hacker/) My Dear Fellow Scientists! “If you torture the data long enough, it will confess.” This aphorism, attributed to Ronald Coase, sometimes has been used in a dis-respective manner, as if…
Read MoreDon’t Have Time To Do a Replication? Have You Considered p-Curves?
So another study finds that X affects Y, and you are a sufficiently cynical TRN reader that you wonder if the authors have p-hacked their way to get their result. Don’t have time (or the incentive) to do a replication? You…
Read MoreJohn Oliver and Last Week Tonight on Replications and Scientific Reliability
How does one know when replication has hit the big time? When JOHN OLIVER and LAST WEEK TONIGHT do an entire episode on it. For readers of TRN, much of what he talks about will be familiar. Just a lot funnier. Check…
Read MoreIN THE NEWS: The Economist (21 January 2016)
(FROM THE ARTICLE “Are Results in Top Journals To Be Trusted?”) A paper recently published in the American Economic Journal, entitled “Star Wars: The Empirics Strike Back”, “analyses 50,000 tests published between 2005 and 2011 in three top American journals. It finds that the…
Read MoreREBLOG: The Reformation: Can Social Scientists Save Themselves?
We recently came across this article in the May/June 2014 issue of Pacific Standard magazine. Okay. It’s not “new”, but it provides an excellent historical overview of some of the issues associated with reproducibility of social science research. WARNING: It…
Read MoreOn p-Hacking, Retractions, and the Difficult Enterprise of Science
This article in FiveThirtyEighty.com is a great read for lots of reasons. The leitmotiv is that while science has its share of fraudsters and academic scammers, the underlying problem is that the scientific enterprise is inherently very, very difficult. To…
Read More
