Boosting invariance and efficiency in supervised learning

Andrea Vedaldi, Paolo Favaro, Enrico Grisan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we present a novel boosting algorithm for supervised learning that incorporates invariance to data transformations and has high generalization capabilities. While one can incorporate invariance by adding virtual samples to the data (e.g., by jittering), we adopt a much more efficient strategy and work along the lines of vicinal risk minimization and tangent distance methods. As in vicinal risk minimization, we incorporate invariance to data by applying anisotropic smoothing along the directions of invariance. Moreover, as in tangent distance methods, we provide a simple local approximation to such directions, thus obtaining an efficient computational scheme. We also show that it is possible to automatically design optimal weak classifiers by using gradient descent. To increase efficiency at run time, such optimal weak classifiers are projected on a Haar basis. This results in designing strong classifiers that are more computationally efficient than in the case of exhaustive search. For illustration and validation purposes, we demonstrate the novel algorithm both on synthetic and on real data sets that are publicly available. ©2007 IEEE.

Original languageEnglish
Title of host publicationProceedings of the IEEE International Conference on Computer Vision
DOIs
Publication statusPublished - 2007
Event2007 IEEE 11th International Conference on Computer Vision - Rio de Janeiro, Brazil
Duration: 14 Oct 200721 Oct 2007

Conference

Conference2007 IEEE 11th International Conference on Computer Vision
Abbreviated titleICCV
CountryBrazil
CityRio de Janeiro
Period14/10/0721/10/07

Fingerprint Dive into the research topics of 'Boosting invariance and efficiency in supervised learning'. Together they form a unique fingerprint.

  • Cite this

    Vedaldi, A., Favaro, P., & Grisan, E. (2007). Boosting invariance and efficiency in supervised learning. In Proceedings of the IEEE International Conference on Computer Vision https://doi.org/10.1109/ICCV.2007.4408840