The Replication Network
Furthering the Practice of Replication in Economics
Archives
Resources for Incorporating Pre-registration and Replication in the Classroom
Nicole Janz (University of Nottingham, @PolSciReplicate) has a set of great resources for those looking for an example of a pre-registration assignment for undergraduates (this for a political science course). The slides to accompany the assignment are here. The template…
Read MoreHow to Win Friends (or at Least Not Maximize Enemies) and Influence People When Doing Replications
[From the paper “Good and Bad Replications in Political Science: How Replicators and Original Authors (Should) Talk to Each Other” by Nicole Janz and Jeremy Freese, prepared for presentation at the MZES Open Social Science Conference 2019] “We propose two main…
Read MoreAn Interesting Thread on Pre-registration
The Psychonomic Society has been hosting an interesting blog series on pre-registration. Below are the five blogs with ridiculously brief, and probably misleading, summaries: Stephen Lindsay (“Arguments for Preregistering Psychology Research”) SUMMARY: Proper interpretation of the results from hypothesis testing…
Read MoreGOODMAN: Hold the Bus!
A recent news piece in Nature reported in glowing terms on the “first analysis of ‘pre-registered’ studies”, stating that “[pre-registration] seems to work as intended: to reduce publication bias for positive results.” There are reasons to be somewhat dubious about…
Read MoreIN THE NEWS: New York Times (November 19, 2018)
[From the article, “Essay: The Experiments Are Fascinating. But Nobody Can Repeat Them” by Andrew Gelman, published in The New York Times] “At this point, it is hardly a surprise to learn that even top scientific journals publish a lot…
Read MoreYour One Stop Shop for the Pre-registration Debate
Recently the 59th annual meeting of the Psychonomic Society in New Orleans played host to an interesting series of talks on how statistical methods should interact with the practice of science. Some speakers discussed exploratory model building, suggesting that this activity may not…
Read MoreWhen Pre-Registration Isn’t Practical
[From the working paper, “Sound Inference in Complicated Research: A Multi-Strategy Approach” by Sanjay Srivastava, posted at PsyArXiv Preprints] “Preregistration is effective because it creates decision independence: analytic decisions are the same regardless of the specific and potentially spurious features of…
Read MoreA Primer on Pre-Registration
[From the article “The preregistration revolution” by Brian Nosek, Charles Ebersole, Alexander DeHaven, and David Mellor, published in PNAS] “Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. This distinction between postdiction and prediction…
Read MoreMore Pre-Registration, More Null Results
[From the article, “First analysis of ‘pre-registered’ studies shows sharp rise in null findings” by Matthew Warren, published at Nature.com] “Studies that fail to find a positive result are often filed away, never to see the light of day, which…
Read More
The Replication Network 
You must be logged in to post a comment.