Article ID Journal Published Year Pages File Type
711205 IFAC-PapersOnLine 2015 6 Pages PDF
Abstract

This paper proposes the use of risk-sensitive costs in a model predictive controller (MPC) with Gaussian process (GP) models, for more effective online learning and control. Being a probabilistic model, a GP incorporates the uncertainty information due to imperfect knowledge of the system. The MPC then utilises this uncertainty information in a risk-sensitive, especially risk-seeking fashion, to balance the exploration of the unknown characteristics and the exploitative control actions simultaneously. Comparison of MPCs with the risk-seeking cost and the risk-neutral cost, i.e. the standard quadratic cost, on the swing-up control of a cart-pendulum system demonstrates that the risk-seeking cost exhibits an effective exploratory behaviour which leads to a better learning of the unknown system and in turn gives improved control performance.

Related Topics
Physical Sciences and Engineering Engineering Computational Mechanics