Archives


No Respect for Replication Even on the Big Bang Theory

[Excerpts taken from the transcript to Series 2, Episode 15 of the Big Bang Theory – “The Maternal Capacitance”] LEONARD’S MOTHER: Leonard, it’s one o’clock, weren’t you going to show me your laboratory at one o’clock? LEONARD: There’s no hurry,…

Read More

Is It a Replication? A Reproduction? A Robustness Check? You’re Asking the Wrong Question

[Excerpts taken from the article, “What is replication?” by Brian Nosek and Tim Errington, published in PloS Biology] “Credibility of scientific claims is established with evidence for their replicability using new data. This is distinct from retesting a claim using…

Read More

Which Journals in Your Discipline Score Best on the TOP Criteria? There’s an App for That

[Excerpts taken from the article “New Measure Rates Quality of Research Journals’ Policies to Promote Transparency and Reproducibility”, published by the Center for Open Science at their website.] “Today, the Center for Open Science launches TOP Factor, an alternative to journal…

Read More

Replication of Cancer Studies a Failure to Launch

[Excerpts taken from the article “Trouble replicating cancer studies a ‘wake-up call’ for science” by Jack Groves, published at timeshighereducation.com] “Later this year, the Virginia-based Center for Open Science will publish the final two papers of an initiative launched in…

Read More

When Replication Met Climate Change

[Excerpts taken from a not so recent article, “Those 3% of scientific papers that deny climate change? A review found them all flawed”, by Katherine Foley, published in Quartz (qz.com), in September 2017] “It’s often said that of all the…

Read More

An Assessment of Open Science Research Practices in Psychology: Lots of Talk But…

[Excerpts taken from the article, “Estimating the prevalence of transparency and reproducibility-related research practices in psychology (2014-2017)”, by Hardwicke, et al., posted at MetaArXiv Preprints] “…we manually examined a random sample of 250 articles to estimate the prevalence of several…

Read More

What Do Replications Tell Us About the Reliability of Meta-Analyses? Evidence from Psychology

[Excerpts taken from the article “Comparing meta-analyses and preregistered multiple-laboratory replication projects” by Amanda Kvarven, Eirik Strømland, and Magnus Johannesson, published in Nature Human Behaviour] “In the past 30 years, the number of meta-analyses published across scientific fields has been…

Read More

TOL: Special Issue on Replication at Energy Economics

Replication is important. Many journals in economics, including Energy Economics, now insist on papers being published together with a replication package, and a few journals check that package prior to publication. This is a world apart from the common practice…

Read More

A Must-Read on the Statistical Analysis of Replications

[Excerpts taken from the article, “The Statistics of Replication” by Larry Hedges, pubished in the journal Methodology] Background “Some treatments of replication have defined replication in terms of the conclusions obtained by studies (e.g., did both studies conclude that the…

Read More

Journal-Based Replication

[Excerpts taken from the article “A Journal-Based Replication of ‘Being Chosen to Lead’” by Allen Drazen, Anna Dreber, Erkut Ozbay, and Erik Snowberg, posted at Snowberg’s website at the California Institute of Technology] “More replication seems needed, and there is…

Read More