کد مقاله کد نشریه سال انتشار مقاله انگلیسی نسخه تمام متن
408367 679025 2007 9 صفحه PDF دانلود رایگان
عنوان انگلیسی مقاله ISI
Heuristics for the selection of weights in sequential feed-forward neural networks: An experimental study
موضوعات مرتبط
مهندسی و علوم پایه مهندسی کامپیوتر هوش مصنوعی
پیش نمایش صفحه اول مقاله
Heuristics for the selection of weights in sequential feed-forward neural networks: An experimental study
چکیده انگلیسی

The selection of weights of the new hidden units for sequential feed-forward neural networks (FNNs) usually involves a non-linear optimization problem that cannot be solved analytically in the general case. A suboptimal solution is searched heuristically. Most models found in the literature choose the weights in the first layer that correspond to each hidden unit so that its associated output vector matches the previous residue as best as possible. The weights in the second layer can be either optimized (in a least-squares sense) or not. Several exceptions to the idea of matching the residue perform an (implicit or explicit) orthogonalization of the output vectors of the hidden units. In this case, the weights in the second layer are always optimized. An experimental study of the aforementioned approaches to select the weights for sequential FNNs is presented. Our results indicate that the orthogonalization of the output vectors of the hidden units outperforms the strategy of matching the residue, both for approximation and generalization purposes.

ناشر
Database: Elsevier - ScienceDirect (ساینس دایرکت)
Journal: Neurocomputing - Volume 70, Issues 16–18, October 2007, Pages 2735–2743
نویسندگان
, ,