Cost-sensitive feature acquisition and classification

Shihao Ji, Lawrence Carin

Research output: Contribution to journalArticlepeer-review

86 Scopus citations


There are many sensing challenges for which one must balance the effectiveness of a given measurement with the associated sensing cost. For example, when performing a diagnosis a doctor must balance the cost and benefit of a given test (measurement), and the decision to stop sensing (stop performing tests) must account for the risk to the patient and doctor (malpractice) for a given diagnosis based on observed data. This motivates a cost-sensitive classification problem in which the features (sensing results) are not given a priori; the algorithm determines which features to acquire next, as well as when to stop sensing and make a classification decision based on previous observations (accounting for the costs of various types of errors, as well as the rewards of being correct). We formally define the cost-sensitive classification problem and solve it via a partially observable Markov decision process (POMDP). While the POMDP constitutes an intuitively appealing formulation, the intrinsic properties of classification tasks resist application of it to this problem. We circumvent the difficulties of the POMDP via a myopic approach, with an adaptive stopping criterion linked to the standard POMDP. The myopic algorithm is computationally feasible, easily handles continuous features, and seamlessly avoids repeated actions. Experiments with several benchmark data sets show that the proposed method yields state-of-the-art performance, and importantly our method uses only a small fraction of the features that are generally used in competitive approaches. © 2006 Pattern Recognition Society.
Original languageEnglish (US)
Pages (from-to)1474-1485
Number of pages12
JournalPattern Recognition
Issue number5
StatePublished - May 1 2007
Externally publishedYes


Dive into the research topics of 'Cost-sensitive feature acquisition and classification'. Together they form a unique fingerprint.

Cite this