Archives


IN THE NEWS: New York Times (November 19, 2018)

[From the article, “Essay: The Experiments Are Fascinating. But Nobody Can Repeat Them” by Andrew Gelman, published in The New York Times] “At this point, it is hardly a surprise to learn that even top scientific journals publish a lot…

Read More

Your One Stop Shop for the Pre-registration Debate

Recently the 59th annual meeting of the Psychonomic Society in New Orleans played host to an interesting series of talks on how statistical methods should interact with the practice of science. Some speakers discussed exploratory model building, suggesting that this activity may not…

Read More

When Pre-Registration Isn’t Practical

[From the working paper, “Sound Inference in Complicated Research: A Multi-Strategy Approach” by Sanjay Srivastava, posted at PsyArXiv Preprints] “Preregistration is effective because it creates decision independence: analytic decisions are the same regardless of the specific and potentially spurious features of…

Read More

A Primer on Pre-Registration

[From the article “The preregistration revolution” by Brian Nosek, Charles Ebersole, Alexander DeHaven, and David Mellor, published in PNAS] “Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. This distinction between postdiction and prediction…

Read More

More Pre-Registration, More Null Results

[From the article, “First analysis of ‘pre-registered’ studies shows sharp rise in null findings” by Matthew Warren, published at Nature.com] “Studies that fail to find a positive result are often filed away, never to see the light of day, which…

Read More

Getting Pre-Registration Right Is Not So Easy

[From the paper, “Ensuring the quality and specificity of preregistrations” by C.L.S. Veldkamp et al., posted at PsyArXiv Preprints] “…we evaluated two preregistration formats that are available on the OSF: a lightweight format that maximizes flexibility for the researcher to…

Read More

Pre-registration. From clinical trials. To psychology. Next, the world?

[From the article “More and more scientists are preregistering their studies. Should you?” by Kai Kupferschmidt, published in Science] “…Preregistration, in its simplest form, is a one-page document answering basic questions such as: What question will be studied? What is the hypothesis?…

Read More

Don’t Think of Them as Students. Think of Them As Potential Pre-Registration Replicators.

[From the Research page of Gilad Feldman’s website.] “In 2016, following recent developments in psychological science (the so called “replication crisis”) and gaining my academic independence, I decided to make serious changes to my research agenda to prioritize pre-registered replications…

Read More

Reproducibility. You Can Do This.

[From the paper, “Practical Tools and Strategies for Researchers to Increase Replicability” by Michele Nuijten, forthcoming in Developmental Medicine & Child Neurology] “Several large-scale problems are affecting the validity and reproducibility of scientific research. … Many of the suggested solutions are…

Read More

Pre-Registration? Meet Publication Bias

[From the blog post, “What Is Preregistration For?” by Neuroskeptic, published at Discover Magazine] “The paper reports on five studies which all address the same general question. Of these, Study #3 was preregistered and the authors write that it was performed after…

Read More