Primary study authors of significant studies are more likely to believe that a strong association exists in a heterogeneous meta-analysis compared with methodologists

ObjectiveTo assess the interpretation of a highly heterogeneous meta-analysis by authors of primary studies and by methodologists.Study Design and SettingWe surveyed the authors of studies on the association between insulin-like growth factor 1 (IGF-1) and prostate cancer, and 20 meta-analysis methodologists. Authors and methodologists presented with the respective meta-analysis results were queried about the effect size and potential causality of the association. We evaluated whether author responses correlated with the number of IGF-related articles they had published and their study results included in the meta-analysis. We also compared authors’ and methodologists’ responses.ResultsAuthors who had published more IGF-related papers offered more generous effect size estimates for the association (ρs = 0.61, P = 0.01) and higher likelihood that the odds ratio (OR) was greater than 1.20 (ρs = 0.63, P = 0.01). Authors who had published themselves studies with statistically significant effects for a positive association were more likely to believe that the true OR is greater than 1.20 compared with methodologists (median likelihood 50% versus 2.5%, P = 0.01).ConclusionResearchers are influenced by their own investment in the field, when interpreting a meta-analysis that includes their own study. Authors who published significant results are more likely to believe that a strong association exists compared with methodologists.