Category: NEWS & EVENTS


FiveThirtyEight.com asks scientists to explain the meaning of a p-value. Hilarity ensues.

FROM THE ARTICLE:   The following is from an interview with Steven Goodman, co-director of METRICS. “Even after spending his ‘entire career’ thinking about p-values, he said he could tell me the definition, ‘but I cannot tell you what it means,…

Read More

REBLOG: The Reformation: Can Social Scientists Save Themselves?

We recently came across this article in the May/June 2014 issue of Pacific Standard magazine.  Okay.  It’s not “new”, but it provides an excellent historical overview of some of the issues associated with reproducibility of social science research.  WARNING: It…

Read More

WANTED: Replications of the Most Influential Empirical Papers in Financial Economics

FROM THE JOURNAL: “The Critical Finance Review is planning to publish issues dedicated to replicating the most influential empirical papers in financial economics. It is explicitly not the goal of these replication issues either to prove or to disprove the…

Read More

Can Bayes Save p-values?

FROM THE ARTICLE: “Currently used thresholds in classical test of statistical significance are responsible for much of the non-reproducibility of scientific studies……Bayesian testing methods that calculate the posterior probability in favor of the null hypothesis alleviate the unreliability of p-values,…

Read More

So You Want to Learn How to Do a Replication?

(FROM THE BITSS WEBSITE) The Berkeley Initiative for Transparency in the Social Sciences will be holding a workshop on replication and transparency following the AEA Annual Meeting in San Francisco, CA.  “Topics will include teaching integrity in empirical research, replication of…

Read More

REPLICATE THIS: Do Dark-Skinned Footballers Get Given Red Cards More Often Than Light-Skinned Ones?

FROM THE ARTICLE: “It sounds like an easy question for any half-competent scientist to answer. Do dark-skinned footballers get given red cards more often than light-skinned ones? But, as RAPHAEL SILBERZAHN …and ERIC UHLMANN … illustrate in this week’s Nature, it…

Read More

Could The Best Way to Find the Truth Be To Hide It?

In a recent opinion piece in the journal Nature, ROBERT MACCOUN and SAUL PERLMUTTER argue that “blind analysis” techniques, originally developed in particle physics, could be useful for the social sciences as well.  For example, in testing whether X affects…

Read More

Is Economic Research Replicable? Study Concludes: “Usually Not”

In a recent working paper, authors ANDREW CHANG and PHILLIP LI examined 60 published, empirical papers in 13 economics journals to determine whether the research could be replicated.  Less than half of the papers could be replicated, even with help from…

Read More

Science Journal Argues that Requiring Transparency Inhibits “Creativity and Novelty”. Really?

In a recent editorial, the journal Epidemiology argues that committing to a set of standards known at the Transparency and Openness Promotion (TOP) guidelines would, among other things, inhibit “creativity and novelty.”  Instead, the journal says, “We intend to soon ask…

Read More

AEA To Have a Session on “Replications in Economics” at the Annual Meeting in January 2016

The upcoming annual meeting of the American Economic Association will be held in San Francisco on January 3-5, 2016. The preliminary program was recently released and features a session on “Replications in Economics.”  To learn more, click here.

Read More