Match!

Spectral feature selection for supervised and unsupervised learning

Published on Jun 20, 2007 in ICML (International Conference on Machine Learning)
· DOI :10.1145/1273496.1273641
Zheng Zhao24
Estimated H-index: 24
(ASU: Arizona State University),
Huan Liu88
Estimated H-index: 88
(ASU: Arizona State University)
View in Source
Abstract
Feature selection aims to reduce dimensionality for building comprehensible learning models with good generalization performance. Feature selection algorithms are largely studied separately according to the type of learning: supervised or unsupervised. This work exploits intrinsic properties underlying supervised and unsupervised feature selection algorithms, and proposes a unified framework for feature selection based on spectral graph theory. The proposed framework is able to generate families of algorithms for both supervised and unsupervised feature selection. And we show that existing powerful algorithms such as ReliefF (supervised) and Laplacian Score (unsupervised) are special cases of the proposed framework. To the best of our knowledge, this work is the first attempt to unify supervised and unsupervised feature selection, and enable their joint study under a general framework. Experiments demonstrated the efficacy of the novel algorithms derived from the framework.
Figures & Tables
  • References (16)
  • Citations (485)
References16
Newest
#1Zheng ZhaoH-Index: 24
#2Huan Liu (ASU: Arizona State University)H-Index: 88
188 Citations
168 Citations
#1Huan Liu (ASU: Arizona State University)H-Index: 88
#2Lei Yu (ASU: Arizona State University)H-Index: 18
1,725 CitationsSource
Jan 1, 2005 in NeurIPS (Neural Information Processing Systems)
#1Tong Zhang (Yahoo!)H-Index: 3
#2Rie Kubota Ando (IBM)H-Index: 1
61 Citations
Jan 1, 2005 in NeurIPS (Neural Information Processing Systems)
#1Xiaofei He (U of C: University of Chicago)H-Index: 56
#2Deng Cai (UIUC: University of Illinois at Urbana–Champaign)H-Index: 55
Last.Partha Niyogi (U of C: University of Chicago)H-Index: 44
view all 3 authors...
984 Citations
#1Gert R. G. Lanckriet (University of California, Berkeley)H-Index: 47
#2Nello CristianiniH-Index: 45
Last.Michael I. JordanH-Index: 128
view all 5 authors...
1,781 Citations
626 Citations
#1Marko Robnik-Šikonja (University of Ljubljana)H-Index: 15
#2Igor Kononenko (University of Ljubljana)H-Index: 31
1,442 CitationsSource
9,342 CitationsSource
Jan 1, 2003 in COLT (Conference on Learning Theory)
#1Alexander J. Smola (ANU: Australian National University)H-Index: 97
#2Risi Kondor (Columbia University)H-Index: 18
619 CitationsSource
Cited By485
Newest
#1Hina Shakir (BU: Bahria University)
#2Yiming Deng (MSU: Michigan State University)H-Index: 16
Last.Tariq Mairaj Rasool Khan (National University of Science and Technology)H-Index: 1
view all 4 authors...
Source
#1Lily Chamakura (IIT-KGP: Indian Institute of Technology Kharagpur)
#2Goutam Saha (IIT-KGP: Indian Institute of Technology Kharagpur)H-Index: 19
Source
#1Luyao Teng (VU: Victoria University, Australia)H-Index: 3
#2Zhenye Feng (GDUT: Guangdong University of Technology)
Last.Yanchun Zhang (VU: Victoria University, Australia)H-Index: 36
view all 7 authors...
Source
#1Yong Shi (CAS: Chinese Academy of Sciences)H-Index: 42
#2Jianyu Miao (CAS: Chinese Academy of Sciences)H-Index: 2
Last.Lingfeng Niu (CAS: Chinese Academy of Sciences)H-Index: 7
view all 3 authors...
Source
#1Rui Zhang (NPU: Northwestern Polytechnical University)H-Index: 7
#2Feiping Nie (NPU: Northwestern Polytechnical University)H-Index: 57
Last.Xian Wei (CAS: Chinese Academy of Sciences)H-Index: 2
view all 4 authors...
2 CitationsSource
#1Sijia Niu (TJU: Tianjin University)
#2Pengfei Zhu (TJU: Tianjin University)H-Index: 20
Last.Hong Shi (TJU: Tianjin University)
view all 4 authors...
Source
#1Rui Ma (National University of Defense Technology)
#2Yijie Wang (National University of Defense Technology)H-Index: 2
Last.Li Cheng (National University of Defense Technology)H-Index: 1
view all 3 authors...
Source
#1Lucas Pascotti Valem (UNESP: Sao Paulo State University)H-Index: 3
#2Daniel Carlos Guimarães Pedronette (UNESP: Sao Paulo State University)H-Index: 12
Source
#1Ming-Dong Yuan (Xidian University)H-Index: 2
#2Da-Zheng Feng (Xidian University)H-Index: 14
Last.Chun-Bao Xiao (Xidian University)H-Index: 2
view all 4 authors...
1 CitationsSource
#1Rui Zhang (NPU: Northwestern Polytechnical University)H-Index: 7
#2Feiping Nie (NPU: Northwestern Polytechnical University)H-Index: 57
Last.Xuelong Li (NPU: Northwestern Polytechnical University)H-Index: 82
view all 4 authors...
1 CitationsSource
View next paperRobust unsupervised feature selection