University of Wollongong
Browse

File(s) not publicly available

Global and local structure preservation for feature selection

journal contribution
posted on 2024-11-16, 08:49 authored by Xinwang Liu, Lei WangLei Wang, Jian Zhang, Jianping Yin, Huan Liu
The recent literature indicates that preserving global pairwise sample similarity is of great importance for feature selection and that many existing selection criteria essentially work in this way. In this paper, we argue that besides global pairwise sample similarity, the local geometric structure of data is also critical and that these two factors play different roles in different learning scenarios. In order to show this, we propose a global and local structure preservation framework for feature selection (GLSPFS) which integrates both global pairwise sample similarity and local geometric data structure to conduct feature selection. To demonstrate the generality of our framework, we employ methods that are well known in the literature to model the local geometric data structure and develop three specific GLSPFS-based feature selection algorithms. Also, we develop an efficient optimization algorithm with proven global convergence to solve the resulting feature selection problem. A comprehensive experimental study is then conducted in order to compare our feature selection algorithms with many state-of-the-art ones in supervised, unsupervised, and semisupervised learning scenarios. The result indicates that: 1) our framework consistently achieves statistically significant improvement in selection performance when compared with the currently used algorithms; 2) in supervised and semisupervised learning scenarios, preserving global pairwise similarity is more important than preserving local geometric data structure; 3) in the unsupervised scenario, preserving local geometric data structure becomes clearly more important; and 4) the best feature selection performance is always obtained when the two factors are appropriately integrated. In summary, this paper not only validates the advantages of the proposed GLSPFS framework but also gains more insight into the information to be preserved in different feature selection tasks.

Funding

Generic Content-based News Picture Retrieval with Local Invariant Features

Australian Research Council

Find out more...

History

Citation

Liu, X., Wang, L., Zhang, J., Yin, J. & Liu, H. (2014). Global and local structure preservation for feature selection. IEEE Transaction on Neural Netwoks and Learning systems, 25 (6), 1083-1095.

Journal title

IEEE Transactions on Neural Networks and Learning Systems

Volume

25

Issue

6

Pagination

1083-1095

Language

English

RIS ID

90612

Usage metrics

    Categories

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC