کد مقاله | کد نشریه | سال انتشار | مقاله انگلیسی | نسخه تمام متن |
---|---|---|---|---|
417083 | 681449 | 2010 | 9 صفحه PDF | دانلود رایگان |
U-statistics have long been known as a class of nonparametric estimators with good theoretical properties such as unbiasedness and asymptotic normality. However, their applications in modern statistical analysis are limited due to the high computational complexity, especially when massive data sets are becoming more and more common nowadays. In this paper, using the “divide-and-conquer” technique, we developed two surrogates of the U-statistics, aggregated U-statistics and average aggregated U-statistics, both of which are shown asymptotically equivalent to U-statistics and computationally much more efficient. When dividing the raw data set into KK subsets, the two proposed estimators reduce the computational complexity from O(Nm)O(Nm) to O(K(N/K)m)O(K(N/K)m), which results in significant time reduction as long as K=o(N)K=o(N) and m≥2m≥2. The merit of the two proposed statistics is demonstrated by both simulation studies and real data examples.
Journal: Computational Statistics & Data Analysis - Volume 54, Issue 1, 1 January 2010, Pages 16–24