摘要
In this paper, we consider the learning rate of support vector machines with both a func-tional predictor and a high-dimensional multivariate vectorial predictor. Similar to the literature on learning in reproducing kernel Hilbert spaces, a source condition and a capac-ity condition are used to characterize the convergence rate of the estimator. It is highly non-trivial to establish the possibly faster rate of the linear part. Using a key basic in-equality comparing losses at two carefully constructed points, we establish the learning rate of the linear part which is the same as if the functional part is known. The proof relies on empirical processes and the Rademacher complexity bound in the semi-nonparametric setting as analytic tools, Young's inequality for operators, as well as a novel "approximate convexity" assumption.
学科与关键词
- Classification with Gaussians and Convex LossXiang, Dao-Hong*; Zhou, Ding-XuanJOURNAL OF MACHINE LEARNING RESEARCH, 2009, 10: 1447-1468.被引 36
- Sparse high-dimensional semi-nonparametric quantile regression in a reproducing kernel Hilbert spaceWang, Yue; Zhou, Yan; Li, Rui*; Lian, HengCOMPUTATIONAL STATISTICS & DATA ANALYSIS, 2022, 168: 107388.被引 5
- Logistic classification with varying GaussiansXiang, Dao-Hong*Computers and Mathematics with Applications, 2011, 61(2): 397-407.被引 8
