Article ID Journal Published Year Pages File Type
708808 IFAC-PapersOnLine 2016 6 Pages PDF
Abstract

We consider Normal two-armed bandit problem with a priori known variances and unknown mathematical expectations of incomes in robust (minimax) setting. This setup naturally arises in group control of data processing. We show that one can solve the problem using the main theorem of the theory of games, i.e. determine minimax strategy and minimax risk as Bayesian corresponding to the worst-case prior distribution. We obtain recursive invariant Bellman-type equation for calculation appropriate Bayesian risk and Bayesian strategy. The requirement of a priori known variances of incomes may be omitted because they may be estimated at the initial stage of control.

Related Topics
Physical Sciences and Engineering Engineering Computational Mechanics
Authors
,