Archives


IN THE NEWS: Undark (March 21, 2019)

[From the article “Stats Experts Plead: Just Say No to P-Hacking” by Dalmeet Singh Chawla, published in Undark] “For decades, researchers have used a statistical measure called the p-value — a widely-debated statistic that even scientists find difficult to define — that is…

Read More

When Trying to Explain p-Values, Maybe Try This?

[From the blog “P-values 101: An attempt at an intuitive but mathematically correct explanation” by Xenia Schmalz, posted at Xenia Schmalz’s blog] “…what exactly are p-values, what is p-hacking, and what does all of that have to do with the replication crisis?…

Read More

How Pre-Registration Can Lead to Higher-Powered Studies and Increase Reproducibility

[From the paper “Preregistration and reproducibility” by Eirik Strømland, forthcoming in the Journal of Economic Psychology] “I present a simple model in which the research community is populated by agents who may report their results unconditionally or conditionally on statistical…

Read More

Searching for Specification Searching in Development Impact Evaluations

[From the paper “Specification Searching and Significance Inflation AcrossTime, Methods and Disciplines” by Eva Vivalt, published in the Oxford Bulletin of Economics and Statistics] “…This paper leverages a database of impact evaluation results collected by AidGrade, a US non-profit organization that…

Read More

IN THE NEWS: FiveThirtyEight (December 6, 2018)

[From the article “Psychology’s Replication Crisis Has Made The Field Better” by Christie Aschwanden, published at FiveThirtyEight] “The replication crisis arose from a series of events that began around 2011, the year that social scientists Uri Simonsohn, Leif Nelson and…

Read More

Battle of the p-Hackers: The HARKer Versus The Accumulator

[From the blog, “Gazing into the Abyss of P-Hacking: HARKing vs. Optional Stopping” by Angelika Stefan and Felix Schönbrodt, posted at Felix Schönbrodt’s website at http://www.nicebread.de%5D “Now, what does a researcher do when confronted with messy, non-significant results? According to several…

Read More

Tired of Candy Crush? Try the New and Improved p-Hacker App!

[From Felix Schönbrodt’s Twitter account, @nicebread303] “The p-hacker app just UNLOCKED the most requested PRO FEATURE: Subgroup analyses!!!” “Check if you can find the effect for, say, young males. This is soo theoretically interesting. Now you can get the p-hacking…

Read More

IN THE NEWS: Mother Jones (September 25, 2018)

[From the article, “This Cornell Food Researcher Has Had 13 Papers Retracted. How Were They Published in the First Place?” by Kiera Butler, published in Mother Jones] “In 2015, I wrote a profile of Brian Wansink, a Cornell University behavioral science researcher who…

Read More

M Is For Pizza

[From the blog ““Tweeking”: The big problem is not where you think it is” by Andrew Gelman, posted at Statistical Modeling, Causal Inference, and Social Science] “In her recent article about pizzagate, Stephanie Lee included this hilarious email from Brian Wansink, the…

Read More

An Economist’s Journey Into the Replication Crisis

[From the blog “Why We Cannot Trust the Published Empirical Record in Economics and How to Make Things Better” by Sylvain Chabé-Ferret, posted at the blogsite An Economist’s Journey] “A strain of recent results is casting doubt on the soundness of the published empirical results in economics. Economics is…

Read More