Feature selection and multi-kernel learning for adaptive graph regularized nonnegative matrix factorization

Jim Jing-Yan Wang, Jianhua Z. Huang, Yijun Sun, Xin Gao

Research output: Contribution to journalArticlepeer-review

44 Scopus citations

Abstract

Nonnegative matrix factorization (NMF), a popular part-based representation technique, does not capture the intrinsic local geometric structure of the data space. Graph regularized NMF (GNMF) was recently proposed to avoid this limitation by regularizing NMF with a nearest neighbor graph constructed from the input data set. However, GNMF has two main bottlenecks. First, using the original feature space directly to construct the graph is not necessarily optimal because of the noisy and irrelevant features and nonlinear distributions of data samples. Second, one possible way to handle the nonlinear distribution of data samples is by kernel embedding. However, it is often difficult to choose the most suitable kernel. To solve these bottlenecks, we propose two novel graph-regularized NMF methods, AGNMFFS and AGNMFMK, by introducing feature selection and multiple-kernel learning to the graph regularized NMF, respectively. Instead of using a fixed graph as in GNMF, the two proposed methods learn the nearest neighbor graph that is adaptive to the selected features and learned multiple kernels, respectively. For each method, we propose a unified objective function to conduct feature selection/multi-kernel learning, NMF and adaptive graph regularization simultaneously. We further develop two iterative algorithms to solve the two optimization problems. Experimental results on two challenging pattern classification tasks demonstrate that the proposed methods significantly outperform state-of-the-art data representation methods.
Original languageEnglish (US)
Pages (from-to)1278-1286
Number of pages9
JournalExpert Systems with Applications
Volume42
Issue number3
DOIs
StatePublished - Sep 20 2014

ASJC Scopus subject areas

  • Artificial Intelligence
  • General Engineering
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Feature selection and multi-kernel learning for adaptive graph regularized nonnegative matrix factorization'. Together they form a unique fingerprint.

Cite this