Modified Recursive Least Squares algorithm to train the Hybrid Multilayered Perceptron (HMLP) network

In this paper, a new learning algorithm, called the Modified Recursive Least Square (MRLS), is introduced for the Hybrid Multilayered Perceptron (HMLP) network. Adopting the Recursive Least Square (RLS) algorithm as its basis, the MRLS algorithm differs from RLS in the way that the weight of the linear connections for the HMLP network is estimated. The convergence rate of the MRLS algorithm is further improved by varying the forgetting factor, optimizing the way the momentum and learning rate are assigned. To investigate its applicability, the MRLS algorithm is demonstrated on the HMLP network using six benchmark data sets obtained from the UCI repository. The classification performance of the HMLP network trained with the MRLS algorithm is compared with those of the HMLP network trained with the Modified Recursive Prediction Error (MRPE) algorithm and the MLP trained with the standard RLS algorithm as well as with other commonly adopted machine learning classifiers. The comparison results indicated that the proposed MRLS trained HMLP network provides significant improvement over RLS trained MLP network, MRPE trained HMLP network, and other machine learning classifiers in terms of accuracy, convergence rate and mean square error (MSE).