In a recent paper, Schweinsberg et al. (2015) propose the idea of a “pre-publication independent replication” (PPIR).  The idea is that an author(s) with a one or more studies that have identified interesting results but that have not yet been published, coordinate with a number of other researchers to have their initial results replicated.  

Designed for experimental results in social psychology, but not necessarily limited to those, the original authors solicit other laboratories after obtaining their results.  They collaboratively work out the replication protocols and criteria.  Ideally, multiple replicating labs are involved so as to increase sample sizes.  

PPIR is unlike other replication efforts such as the Reproducibility Project and Many Labs Projects because (i) findings are replicated before they are published, and (ii) the author of the original studies selects labs to replicate the results so as to ensure replicator expertise.  PPIR is a way to ensure that new results are vetted before they work their way into the literature and become accepted as “fact.”  

The authors demonstrate their approach by replicating ten experimental findings on “moral judgement effects” produced by social psychologist Eric Uhlmann at INSEAD and coauthors, employing 25 laboratories as replicators.  They obtained a replication rate of 60-80%.  The paper also discusses various issues associated with PPIR and other replication approaches.  To read more, click here.