摘要
The alternating direction method of multipliers (ADMM) is a natural method of choice for distributed parameter learning. For smooth and strongly convex consensus optimization problems, it has been shown that ADMM and some of its variants enjoy linear convergence in the distributed setting, much like in the traditional non-distributed setting. The optimization problem associated with parameter estimation in quantile regression is neither smooth nor strongly convex (although is convex) and thus it seems can only have sublinear convergence at best. Although this insinuates slow convergence, we show that, if the local sample size is sufficiently large compared to parameter dimension and network size, distributed estimation in quantile regression actually exhibits linear convergence up to the statistical precision, the precise meaning of which will be explained in the text.
学科与关键词
- Communication-efficient estimation and inference for high-dimensional quantile regression based on smoothed decorrelated scoreDi, Fengrui; Wang, Lei*; Lian, HengStatistics in Medicine, 2022, 41(25): 5084-5101.被引 2
- Convergence analysis of consensus-ADMM for general QCQPHuang, Huiping*; So, Hing Cheung; Zoubir, Abdelhak M.SIGNAL PROCESSING, 2023, 208: 108991.被引 2
- Communication-efficient estimation of quantile matrix regression for massive datasetsYang, Yaohong; Wang, Lei; Liu, Jiamin; Li, Rui*; Lian, HengCOMPUTATIONAL STATISTICS & DATA ANALYSIS, 2023, 187: 107812.
