Archives


Original Study Finds A Result. Follow-up Studies Fail to Replicate It. The Record is Corrected. Right?

[From the post “A study fails to replicate, but it continues to get referenced as if it had no problems. Communication channels are blocked.” by Andrew Gelman at Statistical Modeling, Causal Inference, and Social Science] “In 2005, Michael Kosfeld, Markus Heinrichs,…

Read More

MUELLER-LANGER et al.: Replication in Economics

[This blog is based on the article “ Replication studies in economics—How many and which papers are chosen for replication, and why?” by Frank Mueller-Langer, Benedikt Fecher, Dietmar Harhoff, and Gert Wagner, published in the journal Research Policy] Academia is…

Read More

HIRSCHAUER et al.: Why replication is a nonsense exercise if we stick to dichotomous significance thinking and neglect the p-value’s sample-to-sample variability

[This blog is based on the paper “Pitfalls of significance testing and p-value variability: An econometrics perspective” by Norbert Hirschauer, Sven Grüner, Oliver Mußhoff, and Claudia Becker, Statistics Surveys 12(2018): 136-172.] Replication studies are often regarded as the means to…

Read More

Don’t Think of Them as Students. Think of Them As Potential Pre-Registration Replicators.

[From the Research page of Gilad Feldman’s website.] “In 2016, following recent developments in psychological science (the so called “replication crisis”) and gaining my academic independence, I decided to make serious changes to my research agenda to prioritize pre-registered replications…

Read More

The Truth is Out There. It’s Just Not Very Likely.

[From the paper, “Perceived Crisis and Reforms: Issues, Explanations, and Remedies”, authored by Paul De Boeck and Minjeong Jeon, published in the July issue of Psychological Bulletin] “…we believe that the OSC [Open Science Collaboration] study allows us to obtain…

Read More

HARPing: Hedging After a Replication is Proposed

[From the blog post, “HARPing: Hedging After a Replication is Proposed” by Rich Lucas at The Desk Reject] “Now, we are all sensitized to the fact that you’re not supposed to “HARK”—it is problematic to hypothesize after results are known…

Read More

Review of Development Finance Calling for Replication Studies

[From the website of the journal, Review of Development Finance] “In addition to its primary scope of publishing original research articles, Review of Development Finance would like to make it worth your time to submit replication studies. First, we’re issuing…

Read More

Royal Netherlands Academy of Arts and Sciences Calls for Replications To Be a “Normal Part of Science”

[From the article “Make replication studies a normal part of science,” posted at the website of the Royal Netherlands Academy of Arts and Sciences] “The systematic replication of other researchers’ work should be a normal part of science. That is the…

Read More

Should Science Do More Replications? It Depends

[From the recent working paper, “The Costs and Benefits of Replication Studies” by Coles, Tiokhin, Scheel, Isager, and Lakens, posted at psyarxiv.com/c8akj] “The debate about whether replication studies should become mainstream is essentially driven by disagreements about their costs and benefits,…

Read More

LEBEL: Curate Science – 2017 Year in Review and Upcoming Plans for 2018

Curate Science (CurateScience.org) is an online platform to track, organize, and interpret replications of published findings in the social sciences, with a current focus on the psychology literature. We had a very productive year in 2017. Here are some highlights…

Read More