ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

How neural networks work: Unraveling the mystery of randomized neural networks for functions and chaotic dynamical systems

Bollt, Erik*
Chaos2024-12DOI: 10.1063/5.0206840
2阅读
引用收藏
分享

摘要

Artificial Neural Networks (ANNs) have proven to be fantastic at a wide range of machine learning tasks, and they have certainly come into their own in all sorts of technologies that are widely consumed today in society as a whole. A basic task of machine learning that neural networks are well suited to is supervised learning, including when learning orbits from time samples of dynamical systems. The usual construct in ANN is to fully train all of the perhaps many millions of parameters that define the network architecture. However, there are certain ANN algorithms that work well with random designs. We have previously presented an explanation as to how the reservoir computing recurrent neural network architecture succeeds despite randomness. Here, we explain how the random feedforward neural networks called the random project networks work. In particular, we present examples for both general function learning and also for learning a flow from samples of orbits of chaotic dynamical systems. There is an interesting geometric explanation of the success, in the case of the ReLu activation function, that relates to the classical mathematical question of how configurations of random lines fall in a plane, or how planes or hyperplanes may fall in higher dimensional spaces. These random configurations lead to a refinement of the domain so that piecewise linear continuous functions result that are dense in continuous functions. This relates neural networks to finite element methods. We highlight the universality of this representation by forecasting the skill of chaotic dynamical systems.

学科与关键词

关键词
EXTREME LEARNING MACHINESMULTILAYER FEEDFORWARD NETWORKSAPPROXIMATIONBACKPROPAGATIONMODEL
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
Chaos
发表日期
2024-12
卷期
第 34 卷, 第 12 期
页码
123164
DOI
10.1063/5.0206840
语言
ENGLISH
成果收录
SCIE
资助标注
NIH-CRCNS; ARO; AFSOR; ONR

作者

  • B

    Bollt, Erik (通讯) (第一作者)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417