ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Realization of Spatial Sparseness by Deep ReLU Nets With Massive Data

Chui, Charles K.; Lin, Shao-Bo*; Zhang, Bo; Zhou, Ding-Xuan西安交通大学
IEEE Transactions on Neural Networks and Learning Systems2022-1DOI: 10.1109/TNNLS.2020.3027613
14被引16阅读
引用收藏
分享

摘要

The great success of deep learning poses urgent challenges for understanding its working mechanism and rationality. The depth, structure, and massive size of the data are recognized to be three key ingredients for deep learning. Most of the recent theoretical studies for deep learning focus on the necessity and advantages of depth and structures of neural networks. In this article, we aim at rigorous verification of the importance of massive data in embodying the outperformance of deep learning. In particular, we prove that the massiveness of data is necessary for realizing the spatial sparseness, and deep nets are crucial tools to make full use of massive data in such an application. All these findings present the reasons why deep learning achieves great success in the era of big data though deep nets and numerous network structures have been proposed at least 20 years ago.

学科与关键词

关键词
Deep learningFeature extractionData miningNeural networksMathematicsLearning systemsBig DataDeep netslearning theorymassive dataspatial sparseness
相关
加载中…
  • The Unbearable Shallow Understanding of Deep Learning
    Plebe, Alessio*; Grasso, GiorgioMINDS AND MACHINES, 2019, 29(4): 515-553.被引 20
  • Depth Selection for Deep ReLU Nets in Feature Extraction and Generalization
    Han, Zhi; Yu, Siquan; Lin, Shao-Bo*; Zhou, Ding-XuanIEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(4): 1853-1868.被引 16
  • Editorial: Deep dictionary learning: Algorithm, theory and application
    Zhang, Zhao; Wang, Meng; Li, Sheng; Zhang, ZhengNEUROCOMPUTING, 2022, 491: 492-493.被引 1
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Neural Networks and Learning Systems
发表日期
2022-01
卷期
第 33 卷, 第 1 期
页码
229-243
DOI
10.1109/TNNLS.2020.3027613
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
Hong Hong Research Council [12300917, 12303218]; Hong Kong Baptist University [RC-ICRS/16-17/03, RC-FNRA-IG/1819/SCI/01]; National Natural Science Foundation of China [61876133, 61977038]; Research Grant Council of Hong Kong [CityU 11306318]

作者

  • C

    Chui, Charles K. (第一作者)

    hong kong baptist univ

  • L

    Lin, Shao-Bo (通讯)

    xi an jiao tong univ

查看全部 4 位作者收起作者
  • Z

    Zhang, Bo

    hong kong baptist univ

  • Z

    Zhou, Ding-Xuan

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417