Document Type
Journal Article
Abstract
Classification can often benefit from efficient feature selection. However, the presence of linearly nonseparable data, quickresponse requirement, small sample problem, and noisy features makes the feature selection quite challenging. In this work, a classseparability criterion is developed in a high-dimensional kernel space, and feature selection is performed by the maximization of thiscriterion. To make this feature selection approach work, the issues of automatic kernel parameter tuning, numerical stability, andregularization for multiparameter optimization are addressed. Theoretical analysis uncovers the relationship of this criterion to theradius-margin bound of the Support Vector Machines (SVMs), the Kernel Fisher Discriminant Analysis (KFDA), and the kernelalignment criterion, thus providing more insight into feature selection with this criterion. This criterion is applied to a variety of selection modes using different search strategies. Extensive experimental study demonstrates its efficiency in delivering fast and robust feature selection.
RIS ID
54291
Publication Details
Wang, L. (2008). Feature selection with kernel class separability. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30 (9), 1534-1546.