Category: NEWS & EVENTS


What If There Isn’t a Single Effect Size? Implications for Power Calculations, Hypothesis Testing, Confidence Intervals and Replications

[From the working paper “The Unappreciated Heterogeneity of Effect Sizes:Implications for Power, Precision, Planning of Research, and Replication” by David Kenny and Charles Judd, posted at Open Science Framework (OSF)] “The goal of this article is to examine the implications…

Read More

Searching for Specification Searching in Development Impact Evaluations

[From the paper “Specification Searching and Significance Inflation AcrossTime, Methods and Disciplines” by Eva Vivalt, published in the Oxford Bulletin of Economics and Statistics] “…This paper leverages a database of impact evaluation results collected by AidGrade, a US non-profit organization that…

Read More

A Course Syllabus in Social Science Replication

[From the syllabus for “POLI 229: Social Science Replication”, taught by Gareth Nellis at the University of California San Diego] “The purpose of this class is to learn how to do cutting-edge empirical research in the social sciences by replicating…

Read More

How to Win Friends (or at Least Not Maximize Enemies) and Influence People When Doing Replications

[From the paper “Good and Bad Replications in Political Science: How Replicators and Original Authors (Should) Talk to Each Other” by Nicole Janz and Jeremy Freese, prepared for presentation at the MZES Open Social Science Conference 2019] “We propose two main…

Read More

Choosing the Right α: What You Need to Know

[From the article “The quest for an optimal alpha” by Jeff Miller and Rolf Ulrich, published in PLOS One] “The purpose of the present article is to show exactly what is necessary to provide a principled justification for a particular α…

Read More

“Replicate Early and Often”

[From the working paper “The Dozen Things Experimental Economists Should Do (More Of)” by Eszter Czibor, David Jimenez-Gomez, and John List, Working Paper 25451 in the NBER Working Paper Series] “…We believe that the best approach to increasing the reliability of…

Read More

An Interesting Thread on Pre-registration

The Psychonomic Society has been hosting an interesting blog series on pre-registration. Below are the five blogs with ridiculously brief, and probably misleading, summaries: Stephen Lindsay (“Arguments for Preregistering Psychology Research”) SUMMARY: Proper interpretation of the results from hypothesis testing…

Read More

This is Literally a Big Deal

[From the article “Groundbreaking deal makes large number of German studies free to public” by Kai Kupferschmidt, published in Science] “Three years ago, a group of German libraries, universities, and research institutes teamed up to force the three largest scientific…

Read More

Are Researchers More Likely to Share Their Data When Their Funders Tell Them To?

[From the article, “A funder-imposed data publication requirement seldom inspired data sharing” by Jessica Couture, Rachael Blake, Gavin McDonald, and Colette Ward, published in PLOS One] “…In this study, we tested the ability to recover data collected under a particular…

Read More

The Key to Solving the Replication Crisis Is … Intellectual Humility?

[From the article “Intellectual humility: the importance of knowing you might be wrong” by Brian Resnick, published at Vox] “Julia Rohrer wants to create a radical new culture for social scientists. A personality psychologist at the Max Planck Institute for Human…

Read More