Skip to main content

Comment on "Star Wars: The Empirics Strike Back"

Staff Report 629 | Published November 18, 2021

Download PDF


Adam Gorajek Reserve Bank of Australia
Benjamin A. Malin Vice President, Research
Comment on "Star Wars: The Empirics Strike Back"


Using a novel meta-analytical method, Brodeur et al. (2016) argue that hypothesis tests in top economic journals have exaggerated levels of statistical significance. Brodeur et al. (2020) apply the same method to another sample of hypothesis tests, obtaining similar results. We investigate the reliability of the method by highlighting questionable assumptions and compiling a dataset to examine their merits. Our findings support the original conclusions.

Related: [Staff Report 630: Online Appendix]( Related: [Dataset](