The Replication Network
Furthering the Practice of Replication in Economics
Archives
P-Values Between 0.01 and 0.10 Are a Problem?
[From the blog, “The uncanny mountain: p-values between .01 and .10 are still a problem” by Julia Rohrer, posted at The 100% CI] “Study 1: In line with our hypothesis, …, p = 0.03.” “Study 2: As expected, … p =…
Read MoreA Summary of Proposals to Improve Statistical Inference
In a recent comment published in the Journal of the American Medical Association, John Ioannidis provided the following summary of proposals (see table below). The summary, and his brief commentary, may be of interest to readers of TRN. Source: Ioannidis…
Read More2 Humps = P-Hacking + Publication Bias?
In a recent blogpost at Simply Statistics, Jeff Leek announced a new R package called tidypvals: “The tidypvals package is an effort to find previous collections of published p-values, synthesize them, and tidy them into one analyzable data set.” In a preview…
Read MoreIf the American Statistical Association Warns About p-Values, and Nobody Hears It, Does It Make a Sound?
[From the article, “The ASA’s p-value statement, one year on”, which appeared in the online journal Significance, a publication of the American Statistical Association] “A little over a year ago now, in March 2016, the American Statistical Association (ASA) took…
Read MoreBayes Factors Versus p-Values
In a recent article in PLOS One, Don van Ravenzwaaij and John Ioannidis argue that Bayes factors should be preferred to significance testing (p-values) when assessing the effectiveness of new drugs. At his blogsite The 20% Statistician, Daniel Lakens argues…
Read MoreIN THE NEWS: The Economist (21 January 2016)
(FROM THE ARTICLE “Are Results in Top Journals To Be Trusted?”) A paper recently published in the American Economic Journal, entitled “Star Wars: The Empirics Strike Back”, “analyses 50,000 tests published between 2005 and 2011 in three top American journals. It finds that the…
Read MoreREBLOG: Evidence of Publication Bias and Misreported p-Values
FROM THE BLOG POLITICAL SCIENCE REPLICATION: “A new article by researchers at the University of Amsterdam shows that publication bias towards statistically significant results may cause p-value misreporting. The team examined hundreds of published articles and found that authors had…
Read MoreFiveThirtyEight.com asks scientists to explain the meaning of a p-value. Hilarity ensues.
FROM THE ARTICLE: The following is from an interview with Steven Goodman, co-director of METRICS. “Even after spending his ‘entire career’ thinking about p-values, he said he could tell me the definition, ‘but I cannot tell you what it means,…
Read MoreCan Bayes Save p-values?
FROM THE ARTICLE: “Currently used thresholds in classical test of statistical significance are responsible for much of the non-reproducibility of scientific studies……Bayesian testing methods that calculate the posterior probability in favor of the null hypothesis alleviate the unreliability of p-values,…
Read More
The Replication Network 
You must be logged in to post a comment.