Document Type : Research Paper
Author
University of Alanbar- College of Computer
Abstract
Two types of neural networks learning algorithms were created, trained, tested, and evaluated in an effort to find the appropriate neural network training method for use in numeral recognition problem. The purpose of this study was to compare the training speeds of two neural networks Backpropagation learning algorithms (Adaptive learning rate and Resilient) when exposed to ten number recognition data sets. Each algorithm was trained using ten data sets as a basic set (Boolean value), and a complex (noisy) set. The trials conducted indicated a significant difference between the two algorithms in the basic data set, with the Resilient training algorithm the neural network trained faster.The creation, training, and testing of each neural network was done using the MathWorks software package MATLAB which contains a “Neural Network Toolbox” that facilitates rapid creation, training, and testing of neural networks. MATLAB was chosen to use for learning algorithm development because this toolbox would save an enormous amount programming effort.
Keywords
Main Subjects
- Ben, K. and Patrick S. (1996). An Introduction to Neural Networks. Eighth Edition. November 1996.
- Fahlman, S. (1988). An Empirical Study of Learning Speed in Back-Propagation Networks. Carnegie Mellon: CMU-CS-88-162
- Firas, H. (2000). Handwritten Numeral Recognition Using Neural Networks. EE368, Stanford University. 27 May, 2000. Available at http://scien.stanford.edu/class/ee368/projects2000/project/node1.html.
- Goss, N. J. (2000). Resilient Backpropagation versus Quickprop for Character Recognition in Neural Networks.
- Howard, D. and Mark, B. (2002). Neural Network Toolbox for use with Matlab. 'User's Guide Version 4'. July 2002.
- Jacek, M. Zurada (1996). Introduction to Artificial Neural Systems.
- Klimis, S. (2000). Hand Gesture Recognition Using Neural Networks
- Riedmiller, M. (1994). Rprop - Description and Implementation Details Technical Report. University of Karlsruhe: W-76128 Karlsruhe.
- Riedmiller, M. (1994). Advanced Supervised Learning in Multi-layer Perceptrons From Backpropagation to Adaptive Learning Algorithms. University of Karlsruhe: W-76128 Karlsruhe.
- Riedmiller, M. and H. Braun 1993. A direct adaptive method for faster backpropagation learning: The RPROP algorithm. Proceedings of the IEEE International Conference on Neural Networks, San Francisco, 1993.
- Sang-W. M. and Seong-G. K. (2002). Pattern Recognition with Block-based Neural Networks. 0-7803-7278-6/2002 ©2002 IEEE.
)
