[The post below comes from a review by Richard Morey of the article “Meeting the challenge of the Psychonomic Society’s 2012 Guidelines on Statistical Issues: Some success and some room for improvement“, published in the journal Psychonomic Bulletin & Review by Peter Morris and Catherine Fritz.]

in 1999 the APA’s Taskforce on Statistical Inference released Statistical Methods in Psychology Journals: Guidelines and Explanations, which has served as an overview of good practice for nearly two decades. In 2012, the Psychonomic Society released their statistical guidelines, which covers much of the same ground but with content devoted to more recent developments, such as Bayesian statistics. In 2016, the American Statistical Association released their statement on the use of p values for statistical inference, along with an invaluable set of commentaries to put the statement in perspective. One question that naturally arises from such guidelines is: do they have any effect on what is published in the Society’s journals?

… Overall, Morris and Fritz argue that the guidelines appear to have had an effect on the reporting in PS journals, but that effect is admittedly small at best. Guidelines likely have only a small, temporary effect compared to reviewers and editors exerting direct pressure on authors.

To read more, click here.