Statistics and Its Interface

Volume 3 (2010)

Number 4

Utility-based weighted multicategory robust support vector machines

Pages: 465 – 475

DOI: https://dx.doi.org/10.4310/SII.2010.v3.n4.a5

Authors

Qinying He (Research Institute of Economics and Management, Southwestern University of Finance and Economics, Chengdu, Sichuan, China)

Yufeng Liu (Department of Statistics and Operations Research, Carolina Center for Genome Sciences, University of North Carolina, Chapel Hill, N.C., U.S.A.)

Yichao Wu (Department of Statistics, North Carolina State University, Raleigh, N.C., U.S.A.)

Abstract

The Support Vector Machine (SVM) has been an important classification technique in both machine learning and statistics communities. The robust SVM is an improved version of the SVM so that the resulting classifier can be less sensitive to outliers. In many practical problems, it may be advantageous to use different weights for different types of misclassification. However, the existing RSVM treats different kinds of misclassification equally. In this paper, we propose the weighted RSVM, as an extension of the standard SVM. We show that surprisingly, the cost-based weights do not work well for weighted extensions of the RSVM. To solve this problem, we propose a novel utility-based weighting scheme for the weighted RSVM. Both theoretical and numerical studies are presented to investigate the performance of the proposed weighted multicategory RSVM.

Keywords

multicategory classification, robustness, SVM, utility, weighted learning

Published 1 January 2010