Time-delayed stochastic optimal control of strongly non-linear systems with actuator saturation by using stochastic maximum principle

A time-delayed stochastic optimal bounded control strategy for strongly non-linear systems under wide-band random excitations with actuator saturation is proposed based on the stochastic averaging method and the stochastic maximum principle. First, the partially averaged Itô equation for the system amplitude is derived by using the stochastic averaging method for strongly non-linear systems. The time-delayed feedback control force is approximated by a control force without time delay based on the periodically random behavior of the displacement and velocity of the system. The partially averaged Itô equation for the system energy is derived from that for the system amplitude by using Itô formula and the relation between system amplitude and system energy. Then, the adjoint equation and maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The saturated optimal control force is determined from maximum condition and solving the forward-backward stochastic differential equations (FBSDEs). For infinite time-interval ergodic control, the adjoint variable is stationary process and the FBSDE is reduced to a ordinary differential equation. Finally, the stationary probability density of the Hamiltonian and other response statistics of optimally controlled system are obtained from solving the Fokker-Plank-Kolmogorov (FPK) equation associated with the fully averaged Itô equation of the controlled system. For comparison, the optimal control forces obtained from the time-delayed bang-bang control and the control without considering time delay are also presented. An example is worked out to illustrate the proposed procedure and its advantages.