[From the article, “The statistical significance filter leads to overoptimistic expectations of replicability” by Shravan Vasishth, Daniela Mertzen, Lena Jäger, and Andrew Gelman, published in the Journal of Memory and Language]

Highlights:

“When low-powered studies show significant effects, these will be overestimates.”

“Significant effects from low-powered studies will not be replicable.”

“Seven experiments show that effects reported in Levy and Keller (2013) are not replicable.”

“Relying only on statistical significance leads to overconfident expectations of replicability.”

“We make several suggestions for improving current practices.”

To read the JML article, click here. (NOTE: Preprint can be found here.]