Archives


One Question + Many Researchers = Many Different Answers

[Excerpts taken from the article “Crowdsourcing hypothesis tests: Making transparent how design choices shape research results” by Justin Landy and many others, posted at the preprint repository at the University of Essex] “…we introduce a crowdsourced approach to hypothesis testing….

Read More

If All the Neuroimaging Researchers Were Laid End to End, Would They Reach a Conclusion?

[Excerpts taken from the article “Variability in the analysis of a single neuroimaging dataset by many teams” by Thomas Nichols, Russell Poldrack, Tom Schonberg and 194 others, posted at BioRXiv] “Data analysis workflows in many areas of science have become…

Read More

Data Sharing: Good Research Practice? Or an Impediment to Science?

[Excerpts taken from the article “E.P.A. to Limit Science Used to Write Public Health Rules” by Lisa Friedman, published in the New York Times] “The Trump administration is preparing to significantly limit the scientific and medical research that the government…

Read More

Reproducibility and Meta-Analyses: Two Great Concepts That Apparently Don’t Mix

[Excerpts taken from the report “Examining the Reproducibility of Meta-Analyses in Psychology: A Preliminary Report” by Daniel Lakens et al., posted at MetaArXiv Preprints ] “…given the broad array of problems that make it difficult to evaluate the evidential value…

Read More

ReproducibiliTeas: Bottoms Up.

[Excerpts taken from the article, “A journal club to fix science” by Amy Orben, published in Nature] “If science had generations, mine would not be defined by war or Woodstock, but by reproducibility and open science….Early-career researchers do not need…

Read More

Predicting Reproducibility. No PhD Required.

[Excerpts taken from the article “Laypeople Can Predict Which Social Science Studies Replicate” by Suzanne Hoogeveen, Alexandra Sarafoglou, and Eric-Jan Wagenmakers, posted at PsyArXiv Preprints] “…we assess the extent to which a finding’s replication success relates to its intuitive plausibility….

Read More

New Cambridge University Press Journal Seeks Non-Novel Research

[Excerpts taken from the article “New Journal Focused on Reproducibility” by Colleen Flaherty, published at insidehighered.com] “Cambridge University Press is launching a new open-access journal to help address science’s reproducibility issues and glacial peer-review timelines. Experimental Results, announced today, gives…

Read More

It May Be Intelligent, But Is It Reproducible?

[Excerpts taken from the article, “Artificial Intelligence Confronts a ‘Reproducibility’ Crisis’” by Gregory Barber, published at Wired.com] “A few years ago, Joelle Pineau, a computer science professor at McGill, was helping her students design a new algorithm when they fell…

Read More

What Went Down at the World Bank’s “Transparency, Reproducibility, and Credibility” Research Symposium

[Excerpts taken from the blog “What development economists talk about when they talk about reproducibility …” by Luiza Andrade, Guadalupe Bedoya, Benjamin Daniels, Maria Jones, and Florence Kondylis, published on the World Bank’s Development Impact blog] “Can another researcher reuse…

Read More

CALLING ALL ECONOMISTS! Come To Melbourne and Predict the Reproducibility of Social Science Research. Travel Grants Available.

The repliCATS Project is part of a monumental effort to estimate the replicability of 3,000 published social science research claims. Towards that end, it is sponsoring a one-day workshop in Melbourne, Australia on November 6th. Participants will work in small…

Read More