The Replication Network
Furthering the Practice of Replication in Economics
Archives
QRP: The Board Game
[Excerpts taken from the “QRP Game Rules”, by Roger Giner-Sorolla, posted at OSF] “A game of scientific discovery, careers, and reform for 2-6 players or teams.” Overview “You, the players, are researchers using sampling statistics to find out more about…
Read MorePre-Registration: It’s a Journey
[Excerpts taken from the preprint “Preregistration Is Hard, And Worthwhile” by Brian Nosek and others, posted at PsyArXiv Preprints] “Preregistration of studies serves at least three aims for improving the credibility and reproducibility of research findings.” “First, preregistration of analysis…
Read MoreIn Two Decades, Will We Look Back And Wonder At All the Flawed Research?
[From the article, “Rein in the four horsemen of irreproducibility”, by Dorothy Bishop, published in Nature] “More than four decades into my scientific career, I find myself an outlier among academics of similar age and seniority: I strongly identify with…
Read MoreDoes Psychology Have a Publication Bias Problem? Yes and No
[From the article, “The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases” by Thomas Schäfer and Marcus Schwarz, published April 11, 2019 in Frontiers in Psychology] “From past publications without preregistration, 900…
Read MoreWhat Can Stop Bad Science? Open Science and Modified Funding Lotteries
[From the working paper, “Open science and modified funding lotteries can impede the natural selection of bad science” By Paul Smaldino, Matthew Turner, and Pablo Contreras Kallens, posted at OSF Preprints] “…we investigate the influence of three key factors on the…
Read MoreP-Values Between 0.01 and 0.10 Are a Problem?
[From the blog, “The uncanny mountain: p-values between .01 and .10 are still a problem” by Julia Rohrer, posted at The 100% CI] “Study 1: In line with our hypothesis, …, p = 0.03.” “Study 2: As expected, … p =…
Read MoreThings Aren’t Looking That Great in Ecology and Evolution Either
[From a recent working paper entitled “Questionable Research Practices in Ecology and Evolution” by Hannah Fraser, Tim Parker, Shinichi Nakagawa, Ashley Barnett, and Fiona Fidler] “We surveyed 807 researchers (494 ecologists and 313 evolutionary biologists) about their use of Questionable…
Read More
The Replication Network 