Archives


Data Sharing: Good Research Practice? Or an Impediment to Science?

[Excerpts taken from the article “E.P.A. to Limit Science Used to Write Public Health Rules” by Lisa Friedman, published in the New York Times] “The Trump administration is preparing to significantly limit the scientific and medical research that the government…

Read More

Data Sharing in Addiction Journals? Yeah, It’s Not Happening There

[Excerpts taken from the article “Data sharing practices in randomized trials of addiction interventions” by Matt Vassar, Sam Jellison, Hannah Wendelbo, and Cole Wayant, published in the journal Addictive Behaviors] “We conducted a 6 year cross-sectional investigation of the rates…

Read More

Pre-Registration: It’s a Journey

[Excerpts taken from the preprint “Preregistration Is Hard, And Worthwhile” by Brian Nosek and others, posted at PsyArXiv Preprints] “Preregistration of studies serves at least three aims for improving the credibility and reproducibility of research findings.” “First, preregistration of analysis…

Read More

Meta-Research: The Big Picture

[From the paper “Calibrating the scientific ecosystem through meta-research” by Tom Hardwicke, Stylianos Serghiou, Perrine Janiaud, Valentin Danchev, Sophia Crüwell, Steven Goodman, and John Ioannidis, forthcoming in Annual Review of Statistics and Its Application] “Meta-research has been defined as ‘the…

Read More

REED: How You, as a Reviewer, Can Encourage Journals to Become More Transparent

I am a member of the Peer Reviewers Openness (PRO) Initiative. The Pro Initiative is based on the idea that reviewers have the power to get journals to become more transparent. In particular, they encourage reviewers to request data and…

Read More

Pre-Registration: The Doctor is Still Out

[From the article “A solution to psychology’s reproducibility problem just failed its first test” by David Adam, published at http://www.sciencemag.org] “Efforts to improve the robustness of research by asking psychologists to state their methods and goals ahead of time, a process…

Read More

A Random Sampling of the State of Transparency and Reproducibility in Social Science Journals

[From the preprint “An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017)” by Tom Hardwicke, Joshua Wallach, Mallory Kidwell, & John Ioannidis posted at MetaArXiv Preprints] “In this study, we evaluated a broad range of…

Read More

Editor-in-Chief of Nature Wants Researchers to Make Their Data and Code Available

[From the article “Nature editor: researchers should be forced to make data public” by David Matthews, published at Times Higher Education] “The editor-in-chief of Nature has said that she would like to force researchers to make the data and code behind their…

Read More

An Interesting Thread on Pre-registration

The Psychonomic Society has been hosting an interesting blog series on pre-registration. Below are the five blogs with ridiculously brief, and probably misleading, summaries: Stephen Lindsay (“Arguments for Preregistering Psychology Research”) SUMMARY: Proper interpretation of the results from hypothesis testing…

Read More

MUELLER-LANGER et al.: Replication in Economics

[This blog is based on the article “ Replication studies in economics—How many and which papers are chosen for replication, and why?” by Frank Mueller-Langer, Benedikt Fecher, Dietmar Harhoff, and Gert Wagner, published in the journal Research Policy] Academia is…

Read More