Dynamic data condensation for classification

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Despite increasing amounts of data and rapidly increasing computational power current state-of-the-art pattern recognition models still can not handle massive and noisy corporate data warehouses, that have become the reality of today's businesses. Moreover, real-time and adaptive systems often require frequent model retraining which further hinders their use. The necessity is therefore to build the classification model on a much smaller representative subset of the original dataset. Various condensation methods ranging from data sampling up to density retention models attempt to capture the summarised data structure, yet they either do not account for labelled data or degrade the classification performance of the model trained on the condensed dataset, The proposed family of models called Dynamic Data Condensation (DDC) combine dynamic condensation, data editing and noise filtering in an attempt to maximally reduce labelled dataset yet with no harm on the performance of a classifier trained on the reduced set. The condensation is achieved by data merging and repositioning imposed by an electrostatic-type field applied to the data which attracts data from the same class but repels data from different classes, thereby trying to improve class separability. Initial experiments demonstrate that DDC outperforms competitive data condensation methods in terms of both data reduction and the classification performance, and is therefore considered better preprocessing step for classification.

Original languageBritish English
Title of host publicationArtificial Intelligence and Soft Computing - ICAISC 2006 - 8th International Conference, Proceedings
PublisherSpringer Verlag
Pages672-681
Number of pages10
ISBN (Print)3540357483, 9783540357483
DOIs
StatePublished - 2006
Event8th International Conference on Artificial Intelligence and Soft Computing, ICAISC 2006 - Zakopane, Poland
Duration: 25 Jun 200629 Jun 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4029 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference8th International Conference on Artificial Intelligence and Soft Computing, ICAISC 2006
Country/TerritoryPoland
CityZakopane
Period25/06/0629/06/06

Fingerprint

Dive into the research topics of 'Dynamic data condensation for classification'. Together they form a unique fingerprint.

Cite this