کد مقاله کد نشریه سال انتشار مقاله انگلیسی نسخه تمام متن
394852 665913 2008 18 صفحه PDF دانلود رایگان
عنوان انگلیسی مقاله ISI
On some entropy functionals derived from Rényi information divergence
موضوعات مرتبط
مهندسی و علوم پایه مهندسی کامپیوتر هوش مصنوعی
پیش نمایش صفحه اول مقاله
On some entropy functionals derived from Rényi information divergence
چکیده انگلیسی

We consider the maximum entropy problems associated with Rényi Q-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the generalized expectation as encountered in nonextensive statistics. The optimum maximum entropy probability distributions, which can exhibit a power-law behaviour, are derived and characterized.The Rényi entropy of the optimum distributions can be viewed as a function of the constraint. This defines two families of entropy functionals in the space of possible expected values. General properties of these functionals, including nonnegativity, minimum, convexity, are documented. Their relationships as well as numerical aspects are also discussed. Finally, we work out some specific cases for the reference measure Q(x)Q(x) and recover in a limit case some well-known entropies.

ناشر
Database: Elsevier - ScienceDirect (ساینس دایرکت)
Journal: Information Sciences - Volume 178, Issue 12, 15 June 2008, Pages 2489–2506
نویسندگان
,