A stochastic optimization approach for parameter tuning of Support Vector Machines

F. Imbault, K. Lebart

Research output: Contribution to journalArticlepeer-review

72 Citations (Scopus)

Abstract

Support Vector Machines (SVMs) are both mathematically well-funded and efficient in a large number of real-world applications. However, the classification results highly depend on the parameters of the model: the scale of the kernel and the regularization parameter. Estimating these parameters is referred to as tuning. Tuning requires to estimate the generalization error and to find its minimum over the parameter space. Classical methods use a local minimization approach. After empirically showing that the tuning of parameters presents local minima, we investigate in this paper the use of global minimization techniques, namely genetic algorithms and simulated annealing. This latter approach is compared to the standard tuning frameworks and provides a more reliable tuning method.

Original languageEnglish
Pages (from-to)597-600
Number of pages4
JournalProceedings - International Conference on Pattern Recognition
Volume4
Publication statusPublished - 2004
EventProceedings of the 17th International Conference on Pattern Recognition, ICPR 2004 - Cambridge, United Kingdom
Duration: 23 Aug 200426 Aug 2004

Fingerprint

Dive into the research topics of 'A stochastic optimization approach for parameter tuning of Support Vector Machines'. Together they form a unique fingerprint.

Cite this