کد مقاله کد نشریه سال انتشار مقاله انگلیسی نسخه تمام متن
535026 870312 2016 8 صفحه PDF دانلود رایگان
عنوان انگلیسی مقاله ISI
PAC-bayesian analysis of distribution dependent priors: Tighter risk bounds and stability analysis
موضوعات مرتبط
مهندسی و علوم پایه مهندسی کامپیوتر چشم انداز کامپیوتر و تشخیص الگو
پیش نمایش صفحه اول مقاله
PAC-bayesian analysis of distribution dependent priors: Tighter risk bounds and stability analysis
چکیده انگلیسی


• We deal with the analysis of distribution dependent priors in the PAC-Bayes framework.
• We refine the analysis of the generalization ability of the Gibbs & Bayes classifiers.
• We review and refine the current state-of-the-art risk bounds.
• We apply the Algorithmic Stability framework to the PAC-Bayes one.
• We show that Catoni’s data dependent posterior distribution is stable.

In this paper we bound the risk of the Gibbs and Bayes classifiers (GC and BC), when the prior is defined in terms of the data generating distribution, and the posterior is defined in terms of the observed one, as proposed by Catoni (2007). We deal with this problem from two different perspectives. From one side we briefly review and further develop the classical PAC-Bayes analysis by refining the current state-of-the-art risk bounds. From the other side we propose a novel approach, based on the concept of Algorithmic Stability, which we call Distribution Stability (DS), and develop some new risk bounds over the GC and BC based on the DS. Finally, we show that the data dependent posterior distribution associated to the data generating prior has also attractive and previously unknown properties.

ناشر
Database: Elsevier - ScienceDirect (ساینس دایرکت)
Journal: Pattern Recognition Letters - Volume 80, 1 September 2016, Pages 200–207
نویسندگان
, , ,