摘要
Composite quantile regression (CQR) is an efficient method to estimate parameters of the linear model with non-Gaussian random noise. The non-smoothness of CQR loss prevents many efficient algorithms from being used. In this paper, we propose the composite smoothed quantile regression (CSQR) model and investigate the inference problem for a large-scale dataset, in which the dimensionality p$$ p $$ is allowed to increase with the sample size n$$ n $$ while p/n is an element of(0,1)$$ p/n\in \left(0,1\right) $$. After applying the convolution smoothing technique to the composite quantile loss, we obtain the convex and twice differentiable CSQR loss function, which can be optimized via the gradient descent algorithm. Theoretically, we establish the non-asymptotic error bound for the CSQR estimators and further provide the Bahadur representation and the Berry-Esseen bound, from which the asymptotic normality of CSQR estimator can be immediately derived. To make valid inference, we construct the confidence intervals that based on the asymptotic distribution. Besides, we also explore the asymptotic relative efficiency of the CSQR estimator with respect to the standard CQR estimator. At last, we provide extensive numerical experiments on both simulated and real data to demonstrate the good performance of our CSQR estimator compared with some baselines.
学科与关键词
- Confidence Intervals and Hypothesis Testing for High-dimensional Quantile Regression: Convolution Smoothing and DebiasingYan, Yibo; Wang, Xiaozhou*; Zhang, Riquan*JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24: 245.
- Online renewable smooth quantile regressionSun, Xiaofei; Wang, Hongwei; Cai, Chao*; Yao, Mei; Wang, Kangning*COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2023, 185: 107781.被引 1
- Communication-efficient estimation and inference for high-dimensional quantile regression based on smoothed decorrelated scoreDi, Fengrui; Wang, Lei*; Lian, HengStatistics in Medicine, 2022, 41(25): 5084-5101.被引 2
