【Metrics Seminar】Accounting for Sample Overlap in Economics Meta-Analyses: The Generalized-Weights Method in Practice
2024/01/12
研討會日期 : 2024-01-12
時間 : 14:30
主講人 : Professor Heiko Rachinger
地點 : Conference Room B110
演講者簡介 : Professor Heiko Rachinger received his PhD from the Carlos III University of Madrid in 2012. He is currently an Assistant Professor at the University of the Balearic Islands. His research interests are Econometrics, Meta-Analysis, and Statistics.
演講摘要 : Meta-analyses in economics frequently exhibit considerable overlap among primary samples. If not addressed, sample overlap leads to efficiency losses and inflated rates of false positives at the meta-analytical level. Bom and Rachinger (2020) propose a generalized-weights approach to handle sample overlap. This approach effectively approximates the correlation structure between primary estimates using information on sample sizes and overlap degrees in the primary studies. This paper demonstrates the application of the generalized-weights method to economics meta-analyses, addressing practical challenges that are likely to be encountered. We account for variations in data aggregation levels, estimation methods, and effect size metrics, among other issues. We derive explicit covariance formulas for different scenarios, evaluate the accuracy of the approximations, and employ Monte Carlo simulations to demonstrate how the method enhances efficiency and restores the false positive rate to its nominal level.
