Optimal Bayesian strategies for the infinite-armed Bernoulli bandit

► The bandit problem with infinitely many Bernoulli arms is considered. ► The optimal Bayesian strategies are developed when priors are known/unknown. ► The proposed strategy is evaluated by a simulation study and shown effective.