Significant Effects From Low-Powered Studies Will Be Overestimates

[From the article, “The statistical significance filter leads to overoptimistic expectations of replicability” by Shravan Vasishth, Daniela Mertzen, Lena Jäger, and Andrew Gelman, published in the Journal of Memory and Language]
Highlights:
“When low-powered studies show significant effects, these will be overestimates.”
“Significant effects from low-powered studies will not be replicable.”
“Seven experiments show that effects reported in Levy and Keller (2013) are not replicable.”
“Relying only on statistical significance leads to overconfident expectations of replicability.”
“We make several suggestions for improving current practices.”
To read the JML article, click here. (NOTE: Preprint can be found here.]

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: