کد مقاله کد نشریه سال انتشار مقاله انگلیسی نسخه تمام متن
1147505 957766 2012 17 صفحه PDF دانلود رایگان
عنوان انگلیسی مقاله ISI
On the convergence of Shannon differential entropy, and its connections with density and entropy estimation
موضوعات مرتبط
مهندسی و علوم پایه ریاضیات ریاضیات کاربردی
پیش نمایش صفحه اول مقاله
On the convergence of Shannon differential entropy, and its connections with density and entropy estimation
چکیده انگلیسی

This work extends the study of convergence properties of the Shannon   differential entropy, and its connections with the convergence of probability measures in the sense of total variation and direct and reverse information divergence. The results relate the topics of distribution (density) estimation, and Shannon information measures estimation, with special focus on the case of differential entropy. On the application side, this work presents an explicit analysis of the density estimation, and differential entropy estimation, for distributions defined on a finite-dimension Euclidean space (Rd,B(Rd))(Rd,B(Rd)). New consistency results are derived for several histogram-based estimators: the classical product scheme, the Barron's estimator, one of the approaches proposed by Györfi and Van der Meulen, and the data-driven partition scheme of Lugosi and Nobel.

ناشر
Database: Elsevier - ScienceDirect (ساینس دایرکت)
Journal: Journal of Statistical Planning and Inference - Volume 142, Issue 7, July 2012, Pages 1716–1732
نویسندگان
, ,