Nyström Subspace Learning for Large-scale SVMs

  • 2020-02-20 18:36:16
  • Weida Li, Mingxia Liu, Daoqiang Zhang
  • 3

Abstract

As an implementation of the Nystr\"{o}m method, Nystr\"{o}m computationalregularization (NCR) imposed on kernel classification and kernel ridgeregression has proven capable of achieving optimal bounds in the large-scalestatistical learning setting, while enjoying much better time complexity. Inthis study, we propose a Nystr\"{o}m subspace learning (NSL) framework toreveal that all you need for employing the Nystr\"{o}m method, including NCR,upon any kernel SVM is to use the efficient off-the-shelf linear SVM solvers asa black box. Based on our analysis, the bounds developed for the Nystr\"{o}mmethod are linked to NSL, and the analytical difference between two distinctimplementations of the Nystr\"{o}m method is clearly presented. Besides, NSLalso leads to sharper theoretical results for the clustered Nystr\"{o}m method.Finally, both regression and classification tasks are performed to compare twoimplementations of the Nystr\"{o}m method.

 

Quick Read (beta)

loading the full paper ...