Correlation between Journal Impact Factor and Citation Performance: An experimental study

Since its introduction, the Journal Impact Factor has probably been the most extensively adopted bibliometric indicator. Notwithstanding its well-known strengths and limits, it is still widely misused as a tool for evaluation, well beyond the purposes it was intended for. In order to shed further light on its nature, the present work studies how the correlation between the Journal Impact Factor and the (time-weighed) article Mean Received Citations (intended as a measure of journal performance) has evolved through time. It focuses on a sample of hard sciences and social sciences journals from the 1999 to 2010 time period. Correlation coefficients (Pearson's Coefficients as well as Spearman's Coefficients and Kendall's τα) are calculated and then tested against several null hypotheses. The results show that in most cases Journal Impact Factors and their yearly variations do not display a strong correlation with citedness. Differences also exist among scientific areas.

► Journal Impact Factors are widely diffused, but also widely misused. ► Further insights into the nature of Journal Impact Factor are offered. ► Time evolution of correlation between Journal Impact Factor and Citedness is studied. ► Correlation coefficients are calculated and tested from a sample of Journal data. ► The studied correlation is a weaker one rather than a strong one.