ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

SignReLU neural network and its approximation ability

Li, Jianfei; Feng, Han*; Zhou, Ding-Xuan
Journal of Computational and Applied Mathematics2024-4DOI: 10.1016/j.cam.2023.115551
5阅读
引用收藏
分享

摘要

Deep neural networks (DNNs) have garnered significant attention in various fields of science and technology in recent years. Activation functions define how neurons in DNNs process incoming signals for them. They are essential for learning non-linear transformations and for performing diverse computations among successive neuron layers. In the last few years, researchers have investigated the approximation ability of DNNs to explain their power and success. In this paper, we explore the approximation ability of DNNs using a different activation function, called SignReLU. Our theoretical results demonstrate that SignReLU networks outperform rational and ReLU networks in terms of approximation performance. Numerical experiments are conducted comparing SignReLU with the existing activations such as ReLU, Leaky ReLU, and ELU, which illustrate the competitive practical performance of SignReLU.

学科与关键词

关键词
Deep neural networksActivation functionApproximation powerSignReLU activation
相关
加载中…
  • Approximation of Nonlinear Functionals Using Deep ReLU Networks
    Song, Linhao; Fan, Jun*; Chen, Di-Rong; Zhou, Ding-XuanJOURNAL OF FOURIER ANALYSIS AND APPLICATIONS, 2023, 29(4): 50.被引 2
  • Approximation of Nonlinear Functionals Using Deep ReLU Networks (vol 29, 50, 2023)
    Song, Linhao; Fan, Jun*; Chen, Di-Rong; Zhou, Ding-XuanJOURNAL OF FOURIER ANALYSIS AND APPLICATIONS, 2023, 29(5): 57.
  • Approximation of smooth functionals using deep ReLU networks
    Song, Linhao*; Liu, Ying; Fan, Jun; Zhou, Ding-XuanNeural Networks, 2023, 166: 424-436.被引 1
查看全部 →

发表信息

论文状态
公开发表
期刊
Journal of Computational and Applied Mathematics
发表日期
2024-04
卷期
第 440 卷
页码
115551
DOI
10.1016/j.cam.2023.115551
语言
ENGLISH
成果收录
SCIE
资助标注
Research Grants Council of Hong Kong [C1013-21GF, 11306220, 11308121]; Germany/Hong Kong Joint Research Scheme [G-CityU101/20]; CityU Strategic Interdisciplinary Research Grant [7020010]; National Science Foundation of China [12061160462]; Hong Kong Institute for Data Science; Laboratory for AI -Powered Financial Technologies

作者

  • L

    Li, Jianfei (第一作者)

  • F

    Feng, Han (通讯)

查看全部 3 位作者收起作者
  • Z

    Zhou, Ding-Xuan

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417