Online policy iteration algorithm for optimal control of linear hyperbolic PDE systems

► The optimal control problem of a class of linear hyperbolic PDE systems is addressed. ► A policy iteration (PI) algorithm is proposed to learn the optimal control policy online. ► The convergence of the PI algorithm is established. ► An online least-square method is developed for implementation purpose. ► The effectiveness of the proposed method is verified through a simulation study.