Archives


How Much Power Does the Average Social Science Study Have? Less Than You Think

[Excerpts taken from the blog, “No, average statistical power is not as high as you think: Tracing a statistical error as it spreads through the literature”, by Andrew Gelman, posted at Statistical Modelling] “I was reading this recently published article by Sakaluk…

Read More

Deborah Mayo on Banning Significance Tests

[Excerpts taken from the article “P-value Thresholds: Forfeit at Your Peril’ by Deborah Mayo, forthcoming in the European Journal of Clinical Investigation] “A key recognition among those who write on the statistical crisis in science is that the pressure to…

Read More

A Random Sampling of the State of Transparency and Reproducibility in Social Science Journals

[From the preprint “An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017)” by Tom Hardwicke, Joshua Wallach, Mallory Kidwell, & John Ioannidis posted at MetaArXiv Preprints] “In this study, we evaluated a broad range of…

Read More

Do Not Abandon Statistical Significance

[From the article “The Importance of Predefined Rules and Prespecified Statistical Analyses: Do Not Abandon Significance” by John Ioannidis, published in JAMA] “A recent proposal to ban statistical significance gained campaign-level momentum in a commentary with 854 recruited signatories. The…

Read More

BBC Radio Program on the Replication Crisis

BBC Radio just produced an interesting and balanced program about the replication crisis, with a focus on psychology. Interviewees include John Bargh, Susan Fiske, John Ioannidis, Brian Nosek, Stephen Reicher, Diederik Stapel and Simine Vazire. One of the highlights is…

Read More

A Summary of Proposals to Improve Statistical Inference

In a recent comment published in the Journal of the American Medical Association, John Ioannidis provided the following summary of proposals (see table below). The summary, and his brief commentary, may be of interest to readers of TRN.  Source: Ioannidis…

Read More

Replication Meets a Study About Attitudes Towards Gays: How Could There Not Be Controversy?

[From the article “Study that said hate cuts 12 years off gay lives fails to replicate”, posted at Retraction Watch] “A highly cited paper has received a major correction as a result of the ongoing battle over attitudes towards gay…

Read More

IN THE NEWS: Wired (November 14, 2017)

[From the article “The Dismal Science Remains Dismal, Say Scientists” by Adam Rogers at wired.com] “WHEN HRISTOS DOUCOULIAGOS was a young economist in the mid-1990s, he got interested in all the ways economics was wrong about itself—bias, underpowered research, statistical shenanigans. Nobody wanted…

Read More

IN THE NEWS: Vox (July 31, 2017)

[From the article “What a nerdy debate about p-values shows about science — and how to fix it” by Brian Resnick at Vox.com]  “There’s a huge debate going on in social science right now. The question is simple, and strikes…

Read More

SCHEEL: When Null Results Beat Significant Results OR Why Nothing May Be Truer Than Something

[The following is an adaption of (and in large parts identical to) a recent blog post by Anne Scheel that appeared on The 100% CI .] Many, probably most empirical scientists use frequentist statistics to decide if a hypothesis should be rejected…

Read More