The Replication Network
Furthering the Practice of Replication in Economics
Category: NEWS & EVENTS
Significant Effects From Low-Powered Studies Will Be Overestimates
[From the article, “The statistical significance filter leads to overoptimistic expectations of replicability” by Shravan Vasishth, Daniela Mertzen, Lena Jäger, and Andrew Gelman, published in the Journal of Memory and Language] Highlights: “When low-powered studies show significant effects, these will…
Read MorePre-Results Review at the Journal of Development Economics: An Early Review
[From the article “Pre-results review at the Journal of Development Economics: Taking transparency in the discipline to the next level” by Aleksandar Bogdanoski and Keesler Welch, published at the blogsite of the Abdul Latif Jameel Poverty Action Lab (J-PAL)] “Earlier this…
Read MoreHow Major Publishers Implement TOP’s Open Data Policies
[From the article, “The Landscape of Open Data Policies” by David Mellor, published at the Center for Open Science blogsite] “TOP [Transparency and Openness Promotion] includes eight policies for publishers or funders to use to increase transparency. They include data transparency,…
Read MoreWhat Can Universities Do?
[From the blog “A manifesto for reproducible science” by Marcus Munafò, published at wonke.com] “…several initiatives exist that can support universities keen to improve their research quality and culture. The Forum for Responsible Research Metrics promotes the better use of metrics,…
Read More80% Power? Really?
[From the blog “The “80% power” lie” posted by Andrew Gelman in December 2017 at Statistical Modeling, Causal Inference, and Social Science] “Suppose we really were running studies with 80% power. In that case, the expected z-score is 2.8, and…
Read MoreDID, IV, RCT, and RDD: Which Method Is Most Prone to Selective Publication and p-Hacking?
[From the working paper, “Methods Matter: P-Hacking and Causal Inference in Economics” by Abel Brodeur, Nikolai Cook, and Anthony Heyes] “…Applying multiple methods to 13,440 hypothesis tests reported in 25 top economics journals in 2015, we show that selective publication and p-hacking is…
Read MoreReproducibility. You Can Do This.
[From the paper, “Practical Tools and Strategies for Researchers to Increase Replicability” by Michele Nuijten, forthcoming in Developmental Medicine & Child Neurology] “Several large-scale problems are affecting the validity and reproducibility of scientific research. … Many of the suggested solutions are…
Read MoreAt the Journal Nature, Peer Reviewers Have the Right To…
[From an editorial published in Nature entitled, “Referees should exercise their rights”] “At Nature, we recognize that our peer reviewers have certain ‘rights’. One of the most well known is the right to anonymity. Less widely known is that referees have the…
Read MoreThe Garden of Forking Paths Strikes Again!
[From the abstract of the article, “Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results”, published by Silberzahn et al. in Advances in Methods and Practices in Psychological Science] “Twenty-nine teams involving 61 analysts used the same…
Read More
The Replication Network 
You must be logged in to post a comment.