The Replication Network
Furthering the Practice of Replication in Economics
Category: GUEST BLOGS
GOODMAN & REED: A Friendly Debate about Pre-Registration
Background: Nat Goodman is generally pessimistic about the benefits of pre-registration. Bob Reed is generally optimistic about pre-registration. What follows is a back-and-forth dialogue about what each likes and dislikes about pre-registration. [GOODMAN, Opening Statement] We need to remember that…
Read MoreKIM & ROBINSON: The problem isn’t just the p-value, it’s also the point-null hypothesis!
In Frequentist statistical inference, the p-value is used as a measure of how incompatible the data are with the null hypothesis. When the null hypothesis is fixed at a point, the test statistic reports a distance from the sample statistic…
Read MoreREED: EiR* – Heterogeneity in Two-Way Fixed Effects Models
[* EiR = Econometrics in Replications, a feature of TRN that highlights useful econometrics procedures for re-analysing existing research. The material for this blog is drawn from the recent working paper “Two-way fixed effects estimators with heterogeneous treatment effects” by…
Read MoreREED: How You, as a Reviewer, Can Encourage Journals to Become More Transparent
I am a member of the Peer Reviewers Openness (PRO) Initiative. The Pro Initiative is based on the idea that reviewers have the power to get journals to become more transparent. In particular, they encourage reviewers to request data and…
Read MoreREED: P-Values: Come, Let Us Reason Together
Like many others, I was aware that there was controversy over null-hypothesis statistical testing. Nevertheless, I was shocked to learn that leading figures in the American Statistical Association (ASA) recently called for abolishing the term “statistical significance”. In an editorial…
Read MoreGRUNOW: Update on IREE – the First and Only Journal Dedicated to Replications in Economics
IREE (the International Journal for Re-Views in Empirical Economics) was launched in September 2017, supported by our prestigious board of academic advisors: Sir Angus Deaton, Richard Easterlin, and Jeffrey Wooldridge. It is the first, and, to date, only journal solely…
Read MoreEBERHARDT: Revisiting the Causal Effect of Democracy on Long-run Development
[This Guest Blog is a repost of a blog by Markus Eberhardt, published at Vox – CEPR Policy Portal] Recent evidence suggests that a country switching to democracy achieves about 20% higher per capita GDP over subsequent decades. This column…
Read MoreGOODMAN: Your p-Values Are Too Small! And So Are Your Confidence Intervals!
An oft-overlooked detail in the significance debate is the challenge of calculating correct p-values and confidence intervals, the favored statistics of the two sides. Standard methods rely on assumptions about how the data were generated and can be way off…
Read MoreBÉDÉCARRATS et al.: Lessons from Replicating an RCT
In 2015, Crépon, Devoto, Duflo and Pariente (2015, henceforth CDDP), published the results of a randomized control trial (RCT) in a special issue of the AEJ: Applied Economics. CDDP evaluated the impact of a microcredit program conducted in Morocco with…
Read MoreHIRSCHAUER et al.: Twenty Steps Towards an Adequate Inferential Interpretation of p-Values in Econometrics
This blog is based on the homonymous paper by Norbert Hirschauer, Sven Grüner, Oliver Mußhoff, and Claudia Becker in the Journal of Economics and Statistics. It is motivated by prevalent inferential errors and the intensifying debate on p-values – as…
Read More
