An Efficient v-minimum Absolute Deviation Distribution Regression Machine

Yan Wang, Yao Wang, Yingying Song, Xuping Xie, Lan Huang, Wei Pang, George MacLeod Coghill

Research output: Contribution to journalArticle

7 Downloads (Pure)

Abstract

Support Vector Regression (SVR) and its variants are widely used regression algorithms, and they have demonstrated high generalization ability. This research proposes a new SVR-based regressor: v-minimum absolute deviation distribution regression (v-MADR) machine. Instead of merely minimizing structural risk, as with v-SVR, v-MADR aims to achieve better generalization performance by minimizing both the absolute regression deviation mean and the absolute regression deviation variance, which takes into account the positive and negative values of the regression deviation of sample points. For optimization, we propose a dual coordinate descent (DCD) algorithm for small sample problems, and we also propose an averaged stochastic gradient descent (ASGD) algorithm for large-scale problems. Furthermore, we study the statistical property of v-MADR that leads to a bound on the expectation of error. The experimental results on both artificial and real datasets indicate that our v-MADR has significant improvement in generalization performance with less training time compared to the widely used v-SVR, LS-SVR, v-TSVR, and linear ε-SVR. Finally, we open source the code of v-MADR at https://github.com/AsunaYY/v-MADR for wider dissemination.
Original languageEnglish
Pages (from-to)85533-85551
Number of pages19
JournalIEEE Access
Volume8
Early online date6 May 2020
DOIs
Publication statusPublished - 2020

Keywords

  • absolute regression deviation mean
  • absolute regression deviation variance
  • dual coordinate descent algorithm
  • v-support vector regression

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Cite this

Wang, Y., Wang, Y., Song, Y., Xie, X., Huang, L., Pang, W., & Coghill, G. M. (2020). An Efficient v-minimum Absolute Deviation Distribution Regression Machine. IEEE Access, 8, 85533-85551. https://doi.org/10.1109/ACCESS.2020.2992703