Shape restricted smoothing splines via constrained optimal control and nonsmooth Newton's methods

Shape restricted smoothing splines receive considerable attention, motivated by many important applications in science and engineering. In this paper, we consider smoothing splines subject to general linear dynamics and control constraints, and formulate them as finite-horizon constrained linear optimal control problems with unknown initial state and control. By exploring techniques from functional and variational analyses, optimality conditions are developed in terms of variational inequalities. Due to the control constraints, the optimality conditions give rise to a nonsmooth B-differentiable equation of an optimal initial condition, whose unique solution completely determines the shape restricted smoothing spline. A modified nonsmooth Newton's algorithm with line search is used to solve this equation; detailed convergence analysis of the proposed algorithm is presented. Using techniques from nonsmooth analysis and polyhedral theory, we show the global convergence of the algorithm for shape restricted smoothing splines subject to general polyhedral control constraints.