Controlled diffusion processes with Markovian switchings for modeling dynamical engineering systems

In this paper the intrinsic complex nature of engineering systems under control is treated by introducing an approach based on Controlled Stochastic Differential Equations with Markovian Switchings (in short CSDEMS). Technical conditions for the existence and uniqueness of the solutions of the CSDEMS are provided. In this context it is not unusual to deal with non-linear CSDEMS that cannot be solved analytically. Therefore, we develop a new two-step, predictor–corrector method for finding numerical approximations to solutions of CSDEMS. This method utilizes the Euler–Maruyama method. An illustrative application to the biochemical engineering area is presented to highlight the usefulness of our approach as a simulation tool.

Hightlights► A modeling approach for controlled engineering systems based on Controlled Stochastic Differential Equations with Markovian Switchings is established. ► Conditions for existence and uniqueness of the CSDEMS solutions are provided. ► An original approach for generating approximating solutions of non-linear CSDEMS is provided. ► A simulation tool for exploring and analyzing control strategies in engineering systems is provided.