Fast Constructive-Covering Algorithm for neural networks and its implement in classification

Research output: Contribution to journalArticlepeer-review

22 Scopus citations

Abstract

Almost all current training algorithms for neural networks are based on gradient descending technique, which causes long training time. In this paper, we propose a novel fast training algorithm called Fast Constructive-Covering Algorithm (FCCA) for neural network construction based on geometrical expansion. Parameters are updated according to the geometrical location of the training samples in the input space, and each sample in the training set is learned only once. By doing this, FCCA is able to avoid iterative computing and much faster than traditional training algorithms. Given an input sequence in an arbitrary order, FCCA learns "easy" samples first and "confusing" samples are easily learned after these "easy" samples. This sample reordering process is done on the fly based on geometrical concept. In addition, FCCA begins with an empty hidden layer, and adds new hidden neurons when necessary. This constructive learning avoids blind selection of neural network structure. The experimental work for classification problems illustrates the advantages of FCCA, especially in learning speed.

Original languageBritish English
Pages (from-to)166-173
Number of pages8
JournalApplied Soft Computing Journal
Volume8
Issue number1
DOIs
StatePublished - Jan 2008

Keywords

  • Classification
  • Constructive learning
  • Geometric learning
  • Geometrical expansion
  • Neural networks

Fingerprint

Dive into the research topics of 'Fast Constructive-Covering Algorithm for neural networks and its implement in classification'. Together they form a unique fingerprint.

Cite this