Article ID | Journal | Published Year | Pages | File Type |
---|---|---|---|---|
6865242 | Neurocomputing | 2018 | 7 Pages |
Abstract
The properties of a boundedness estimations are investigated during the training of online back-propagation method with L2 regularizer for Sigma-Pi-Sigma neural network. This brief presents a unified convergence analysis, exploiting theorems of White for the method of stochastic approximation. We apply the method of regularizer to derive estimation bounds for Sigma-Pi-Sigma network, and also give conditions for determinating convergence ensuring that the back-propagation estimator converges almost surely to a parameter value which locally minimizes the expected squared error loss. Besides, some weight boundedness estimations are derived through the squared regularizer, after that the boundedness is exploited to prove the convergence of the algorithm. A simulation is also given to verify the theoretical findings.
Keywords
Related Topics
Physical Sciences and Engineering
Computer Science
Artificial Intelligence
Authors
Yan Liu, Dakun Yang, Chao Zhang,