The Replication Network
Furthering the Practice of Replication in Economics
Archives
Suppose Researchers Were Offered Money for Replications and Null Results. Suppose Few Took Up the Offer.
[Excerpts taken from the article “In praise of replication studies and null results”, an editorial published in Nature] “The Berlin Institute of Health last year launched an initiative with the words, ‘Publish your NULL results — Fight the negative publication…
Read MorePositive Findings are Drastically Lower in Registered Reports
[From slides prepared for the talk “Positive result rates in psychology: Registered Reports compared to the conventional literature” by Mitchell Schijen, Anne Scheel, and Daniël Lakens, presented at Open Science 2019 @ZPID, Trier , and posted at OSF] Conclusion: “Positive result rate in…
Read MoreTo p-Value or Not to p-Value? An Answer From Signal Detection Theory
[From the article “Insights into Criteria for Statistical Significance from Signal Detection Analysis” by Jessica Witt, published in Meta-Psychology] “… the best criteria for statistical significance are ones that maximize discriminability between real and null effects, not just those that…
Read MoreGOODMAN: Hold the Bus!
A recent news piece in Nature reported in glowing terms on the “first analysis of ‘pre-registered’ studies”, stating that “[pre-registration] seems to work as intended: to reduce publication bias for positive results.” There are reasons to be somewhat dubious about…
Read MoreMore Pre-Registration, More Null Results
[From the article, “First analysis of ‘pre-registered’ studies shows sharp rise in null findings” by Matthew Warren, published at Nature.com] “Studies that fail to find a positive result are often filed away, never to see the light of day, which…
Read MoreShould Null Results Require Greater Justification?
In a recent editorial in Management Review Quarterly, the journal invited replications, and put forth the following “Seven Principles of Effective Replication Studies”: #1. “Understand that replication is not reproduction” #2. “Aim to replicate published studies that are relevant” #3….
Read MoreBROWN, LAMBERT, & WOJAN: At the Intersection of Null Findings and Replication
Replication is an important topic in economic research or any social science for that matter. This issue is most important when an analysis is undertaken to inform decisions by policymakers. Drawing inferences from null or insignificant finding is particularly problematic…
Read MoreHow to Get Something from Nothing. Or, “Yes, Virginia, You Can Do Ex-post Power Analyses”.
[From the article, “The effect of the conservation reserve program on rural economies: Deriving a statistical verdict from a null finding” by Jason Brown, Dayton Lambert, and Timothy Wojan, recently published in the American Journal of Agricultural Economics] “This article suggests…
Read MoreSCHEEL: When Null Results Beat Significant Results OR Why Nothing May Be Truer Than Something
[The following is an adaption of (and in large parts identical to) a recent blog post by Anne Scheel that appeared on The 100% CI .] Many, probably most empirical scientists use frequentist statistics to decide if a hypothesis should be rejected…
Read MoreReasons for Loving Null Results
In a great blog (“Why we should love null results”) posted at The 100% CI, Anne Scheel gives some reasons why we should love statistically insignificant findings. Her reasons include: — “We should love null results to counter our tendency…
Read More
The Replication Network 
You must be logged in to post a comment.