Algorithms for Solving Stochastic Discrete Control Problems with Finite Time Horizon

In this article we extend classical deterministic control problems towards stochastic networks. A certain class of such stochastic discrete control problems with finite time horizon is introduced. Algorithms for solving the considered class of problems via the theory of Markov processes and dynamic programming are proposed. We apply the time-expanded network method and present complexity results of the constructive algorithm.