Archives


REED: The State of Replications in Economics – A 2020 Review (Part 3)

This final instalment on the state of replications in economics, 2020 version, continues the discussion of how to define “replication success” (see here and here for earlier instalments). It then delves further into interpreting the results of a replication. I…

Read More

REED: The State of Replications in Economics – A 2020 Review (Part 2)

This instalment follows on yesterday’s post where I addressed two questions: Are there more replications in economics than there used to be? And, Which journals publish replications? These questions deal with the descriptive aspect of replications. We saw that replications…

Read More

How Much Power Does the Average Social Science Study Have? Less Than You Think

[Excerpts taken from the blog, “No, average statistical power is not as high as you think: Tracing a statistical error as it spreads through the literature”, by Andrew Gelman, posted at Statistical Modelling] “I was reading this recently published article by Sakaluk…

Read More

Have Registered Reports Uncovered Massive Publication Bias? Evidence from Psychology

[Excerpts taken from the preprint, “An excess of positive results: Comparing the standard Psychology literature with Registered Reports” by Anne Scheel, Mitchell Schijen, and Daniël Lakens, posted at PsyArXiv] “Registered Reports (RRs) are a new publication format…Before collecting data, authors…

Read More

FIALA: Is the Evidence for the Lack of Impact of Microfinance Just a Design Problem?

Microfinance is one of the most hotly debated interventions in developing countries over the last 20 years. These are generally small loans, often given to women with short repayment periods and high interest rates (though often much lower than local…

Read More

Using Z-Curve to Estimate Mean Power for Studies Published in Psychology Journals

[From the blog “Estimating the Replicability of Psychological Science” by Ulrich Schimmack, posted at Replicability-Index] “Over the past years, I have been working on an … approach to estimate the replicability of psychological science. This approach starts with the simple…

Read More

Power and Progress in Science

[From the blog “The Persistence of False Paradigms in Low-Power Sciences” by Pascal Michaillat, posted on the BITSS website] “It is commonly believed that the lack of experimental evidence typical in the social sciences slows but does not prevent the…

Read More

Power is not the point. It’s the curve.

[From the blog “Why you shouldn’t say ‘this study is underpowered’” by Richard Morey, posted at Towards Data Science, at Medium. com] “The first thing to clear up, as I’ve stated above, is that study or an experiment is not…

Read More

What If There Isn’t a Single Effect Size? Implications for Power Calculations, Hypothesis Testing, Confidence Intervals and Replications

[From the working paper “The Unappreciated Heterogeneity of Effect Sizes:Implications for Power, Precision, Planning of Research, and Replication” by David Kenny and Charles Judd, posted at Open Science Framework (OSF)] “The goal of this article is to examine the implications…

Read More

MILLER: The Statistical Fundamentals of (Non-)Replicability

“Replicability of findings is at the heart of any empirical science” (Asendorpf, Conner, De Fruyt, et al., 2013, p. 108) The idea that scientific results should be reliably demonstrable under controlled circumstances has a special status in science.  In contrast…

Read More