Variable projections neural network training

The training of some types of neural networks leads to separable non-linear least squares problems. These problems may be ill-conditioned and require special techniques. A robust algorithm based on the Variable Projections method of Golub and Pereyra is designed for a class of feed-forward neural networks and tested on benchmark examples and real data.