A comparative study of the scalability of a sensitivity-based learning algorithm for artificial neural networks

Until recently, the most common criterion in machine learning for evaluating the performance of algorithms was accuracy. However, the unrestrainable growth of the volume of data in recent years in fields such as bioinformatics, intrusion detection or engineering, has raised new challenges in machine learning not simply regarding accuracy but also scalability. In this research, we are concerned with the scalability of one of the most well-known paradigms in machine learning, artificial neural networks (ANNs), particularly with the training algorithm Sensitivity-Based Linear Learning Method (SBLLM). SBLLM is a learning method for two-layer feedforward ANNs based on sensitivity analysis, that calculates the weights by solving a linear system of equations. The results show that the training algorithm SBLLM performs better in terms of scalability than five of the most popular and efficient training algorithms for ANNs.

► Researchers must now study not only accuracy but also scalability. ► Researchers are investigating machine learning scalability to large scale problems. ► The scalability of popular training algorithms for ANNs is analyzed in this research. ► The training algorithm SBLLM performs better than others in terms of scalability. ► This research contributes to the standardization of scalability studies.