ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

A random energy approach to deep learning

Xie, Rongrong; Marsili, Matteo*i
JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT2022-7-1DOI: 10.1088/1742-5468/ac7794
1被引12阅读
引用收藏
分享

摘要

We study a generic ensemble of deep belief networks (DBN) which is parametrized by the distribution of energy levels of the hidden states of each layer. We show that, within a random energy approach, statistical dependence can propagate from the visible to deep layers only if each layer is tuned close to the critical point during learning. As a consequence, efficiently trained learning machines are characterised by a broad distribution of energy levels. The analysis of DBNs and restricted Boltzmann machines on different datasets confirms these conclusions.

学科与关键词

关键词
deep learningenergy landscapeslearning theorymachine learning
相关
加载中…
  • Deep learning systems as complex networks
    Testolin, Alberto; Piccolini, Michele; Suweis, Samir*Journal of Complex Networks, 2020, 8(1): cnz018.被引 14
  • A Developmental Approach for Training Deep Belief Networks
    Zambra, Matteo; Testolin, Alberto*; Zorzi, Marco*Cognitive Computation, 2023, 15(1): 103-120.被引 10
  • Maximal relevance and optimal learning machines
    Duranthon, O.; Marsili, M.*; Xie, R.JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2021, 2021(3): 033409.被引 6
查看全部 →

发表信息

论文状态
公开发表
期刊
JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT
发表日期
2022-07-01
卷期
第 2022 卷, 第 7 期
页码
073404
DOI
10.1088/1742-5468/ac7794
语言
ENGLISH
期刊等级
3区
成果收录
SCIE
资助标注
China Scholarship Council (CSC) [202006770018]

作者

  • X

    Xie, Rongrong (第一作者)

    cent china normal univ

  • M

    Marsili, Matteo (通讯)

    i

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417