ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Optimal subsampling for large-sample quantile regression with massive data

Shao, Li; Song, Shanshan; Zhou, Yong*广州大学; y
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE2023-6DOI: 10.1002/cjs.11697
3被引21阅读
引用收藏
分享

摘要

To balance the explosive growth of data volume and limited budgets for computational resources, one of the popular methods is downscaling the data volume by subsampling a subdataset that inherits the relevant property of the full data. As an alternative to the mean regression model, the quantile regression model has been studied extensively when the data are independent and the data scale is medium. This article focuses on quantile regression with massive data where the sample size n (greater than 106 in general) is extraordinarily large but the dimension d (smaller than 20 in general) is small. We first formulate the general subsampling procedure and establish the asymptotic property of the resultant estimator. Then, with the help of optimality criteria in experimental design, we derive two subsampling probabilities that are optimal in the sense of smallest asymptotic mean square error. Since the optimal subsampling probabilities depend on the full data estimator, we develop a two-step optimal subsampling algorithm and study the consistency and asymptotic normality of the resultant estimator. The empirical performance of the optimal subsampling algorithm is evaluated with synthetic and real datasets.

学科与关键词

关键词
Massive dataoptimal subsamplingquantile regression
相关
加载中…
  • Optimal decorrelated score subsampling for generalized linear models with massive data
    Gao, Junzhuo; Wang, Lei*; Lian, HengScience China Mathematics, 2024, 67(2): 405-430.被引 1
  • Functional L-Optimality Subsampling for Functional Generalized Linear Models with Massive Data
    Liu, Hua; You, Jinhong; Cao, Jiguo*JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24: 219.
  • On the asymptotic properties of a bagging estimator with a massive dataset
    Gao, Yuan; Zhang, Riquan*; Wang, HanshengSTAT, 2022, 11(1): e485.
查看全部 →

发表信息

论文状态
公开发表
期刊
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE
发表日期
2023-06
卷期
第 51 卷, 第 2 期
页码
420-443
DOI
10.1002/cjs.11697
语言
MULTI-LANGUAGE
成果收录
SCIE
资助标注
State Key Program of the National Natural Science Foundation of China [71931004, 92046005]; General Program in the National Statistical Science Research of China [2019LY57]; Guangdong Basic and Applied Basic Research Foundation [2021A1515110926]

作者

  • S

    Shao, Li (第一作者)

    guangzhou univ

  • S

    Song, Shanshan

    chinese univ hong kong

查看全部 3 位作者收起作者
  • Z

    Zhou, Yong (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417