Archives


IN THE NEWS: Vox (May 17, 2019)

[From the article “This economics journal only publishes results that are no big deal: Here’s how that might save science” by Kelsey Piper, published in Vox] “Most new publications, upon their launch, seek to promote their content as novel, surprising,…

Read More

In Two Decades, Will We Look Back And Wonder At All the Flawed Research?

[From the article, “Rein in the four horsemen of irreproducibility”, by Dorothy Bishop, published in Nature] “More than four decades into my scientific career, I find myself an outlier among academics of similar age and seniority: I strongly identify with…

Read More

Does Psychology Have a Publication Bias Problem? Yes and No

[From the article, “The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases” by Thomas Schäfer and Marcus Schwarz, published April 11, 2019 in Frontiers in Psychology] “From past publications without preregistration, 900…

Read More

It’s Not A Problem, It’s an Opportunity

[From the blog “The replication crisis is good for science” by Eric Loken, published at The Conversation] “Science is in the midst of a crisis: A surprising fraction of published studies fail to replicate when the procedures are repeated.” “Is…

Read More

GOODMAN: When You’re Selecting Significant Findings, You’re Selecting Inflated Estimates

Replication researchers cite inflated effect sizes as a major cause of replication failure. It turns out this is an inevitable consequence of significance testing. The reason is simple. The p-value you get from a study depends on the observed effect…

Read More

Registered Reports Are Not Optimal?

[From the working paper, “Which findings should be published?” by Alexander Frankel and Maximilian Kasy] “There have been calls for reforms in the direction of non-selective publication. One proposal is to promote statistical practices that de-emphasize statistical significance … Another…

Read More

The AEA Interviews Ted Miguel About the Replication Crisis

[From the article “Making economics transparent and reproducible” by Tyler Smith, published on the American Economic Association’s website] “The AEA spoke with Miguel about the replication problem in economics and how the next generation of researchers is embracing new tools…

Read More

More Pre-Registration, More Null Results

[From the article, “First analysis of ‘pre-registered’ studies shows sharp rise in null findings” by Matthew Warren, published at Nature.com] “Studies that fail to find a positive result are often filed away, never to see the light of day, which…

Read More

How Many Biases? Let Us Count the Ways

[From the article “Congratulations. Your Study Went Nowhere” by Aaron Carroll, published at http://www.nytimes.com%5D “When we think of biases in research, the one that most often makes the news is a researcher’s financial conflict of interest. But another bias, one possibly even more…

Read More

An Economist’s Journey Into the Replication Crisis

[From the blog “Why We Cannot Trust the Published Empirical Record in Economics and How to Make Things Better” by Sylvain Chabé-Ferret, posted at the blogsite An Economist’s Journey] “A strain of recent results is casting doubt on the soundness of the published empirical results in economics. Economics is…

Read More