Archives


Assessing the Peer Reviewers’ Openness (PRO) Initiative from the Perspective of PRO Signatories

[Excerpts taken from the preprint “’Because it is the Right Thing to Do’: Taking Stock of the Peer Reviewers’ Openness Initiative” by Maike Dahrendorf et al., posted at PsyArXiv Preprints] “Although the practice of publicly sharing data and code appears…

Read More

Lesson Learned from Registered Reports From Somebody Who Was There at the Beginning

[Excerpts taken from “The registered reports revolution: Lessons in cultural reform” by Chris Chambers, published in Significance, a publication of the Royal Statistical Society”] “On 12 November 2012, as my train sped towards London, I received one of the most…

Read More

Big Changes in Reproducibility Policies by the American Economic Association

[Excerpts taken from an email sent out by the American Economic Association to its members on July 16, 2019] “On July 10, 2019, the Association adopted an updated Data and Code Availability Policy, which can be found at https://www.aeaweb.org/journals/policies/data-code. The…

Read More

Lessons Learned from the Pre-Results Review Pilot at the Journal of Development Economics One Year On

[From the blog “Pre-results Review at the Journal of Development Economics: Lessons learned so far” by Andrew Foster, Dean Karlan, Edward Miguel and Aleksandar Bogdanoski, posted at Development Impact at World Bank Blogs] “In March 2018, the Journal of Development…

Read More

Meta-Research: The Big Picture

[From the paper “Calibrating the scientific ecosystem through meta-research” by Tom Hardwicke, Stylianos Serghiou, Perrine Janiaud, Valentin Danchev, Sophia Crüwell, Steven Goodman, and John Ioannidis, forthcoming in Annual Review of Statistics and Its Application] “Meta-research has been defined as ‘the…

Read More

Update from the AEA Data Editor on Replication and Reproducibility

[From the presentation slides on “Replication and Reproducibility in Social Sciences and Statistics: Context, Concerns, and Concrete Measures” by Lars Vilhuber, AEA Data Editor, presented at the 2019 Western Economics Association International meetings] NOTE: Just so there is no misunderstanding,…

Read More

IN THE NEWS: Slate (June 20, 2019)

[From the article “We Tried to Publish a Replication of a Science Paper in Science. The Journal Refused.” by Kevin Arceneaux, Bert Bakker, Claire Gothreau, and Gijs Schumacher, published in Slate]  “Our story starts in 2008, when a group of researchers…

Read More

Don’t Like the Author’s Conclusion? Read the Other One.

[From the article “Reproducibility trial publishes two conclusions for one paper” by David Adam, published in Nature] “How deeply an anaesthetist should sedate an elderly person when they have surgery is a controversial issue, because some studies link stronger doses…

Read More

Another Economics Journal Pilots Pre-Results Review

[From the article “Pre-results review reaches the (economic) lab: Experimental Economics follows the Journal of Development Economics in piloting pre-results review”, an interview with Irenaeus Wolff, published at http://www.bitss.org. The following are excerpts from that interview.] “In its April 2019…

Read More

REED: How You, as a Reviewer, Can Encourage Journals to Become More Transparent

I am a member of the Peer Reviewers Openness (PRO) Initiative. The Pro Initiative is based on the idea that reviewers have the power to get journals to become more transparent. In particular, they encourage reviewers to request data and…

Read More