Archives


Predicting Reproducibility. No PhD Required.

[Excerpts taken from the article “Laypeople Can Predict Which Social Science Studies Replicate” by Suzanne Hoogeveen, Alexandra Sarafoglou, and Eric-Jan Wagenmakers, posted at PsyArXiv Preprints] “…we assess the extent to which a finding’s replication success relates to its intuitive plausibility….

Read More

REED: Replications in Economics are Different from Replications in Psychology, and Other Thoughts

In July 2017, Economics: The Open Access, Open Assessment E-Journal issued a call for papers for a special issue on the practice of replication. The call stated, “This special issue is designed to highlight alternative approaches to doing replications, while…

Read More

Predicting Reproducibility

[From the working paper “Predicting the Replicability of Social Science Lab Experiments” by Altmejd et al., posted at BITSS Preprints] “We have 131 direct replications in our dataset. Each can be judged categorically by whether it succeeded or failed, by a…

Read More

MILLER: The Statistical Fundamentals of (Non-)Replicability

“Replicability of findings is at the heart of any empirical science” (Asendorpf, Conner, De Fruyt, et al., 2013, p. 108) The idea that scientific results should be reliably demonstrable under controlled circumstances has a special status in science.  In contrast…

Read More

How Should One Statistically Analyse a Replication? It Depends.

[From the preprint, “Statistical Analyses for Studying Replication: Meta-Analytic Perspectives” by Larry Hedges and Jacob Schauer, forthcoming in Psychological Methods] “Formal empirical assessments of replication have recently become more prominent in several areas of science, including psychology. These assessments have…

Read More

REED: The Devil, the Deep Blue Sea, and Replication

In a recent article (“Between the Devil and the Deep Blue Sea: Tensions Between Scientific Judgement and Statistical Model Selection” published in Computational Brain & Behavior), Danielle Navarro identifies blurry edges around the subject of model selection. The article is a tour…

Read More