Convergence of Markov chain approximation on generalized HJB equation and its applications

This work is concerned with numerical methods for a class of stochastic control optimizations and stochastic differential games. Numerical procedures based on Markov chain approximation techniques are developed in a framework of generalized Hamilton–Jacobi–Bellman equations. Convergence of the algorithms is derived by means of viscosity solution methods.