ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Learning predictive cognitive maps with spiking neurons during behavior and replays

Bono, Jacopo; Zannone, Sara; Pedrosa, Victor; Clopath, Claudia*
eLife2023-3-16DOI: 10.7554/eLife.80671
11被引15阅读
引用收藏
分享

摘要

The hippocampus has been proposed to encode environments using a representation that contains predictive information about likely future states, called the successor representation. However, it is not clear how such a representation could be learned in the hippocampal circuit. Here, we propose a plasticity rule that can learn this predictive map of the environment using a spiking neural network. We connect this biologically plausible plasticity rule to reinforcement learning, mathematically and numerically showing that it implements the TD-lambda algorithm. By spanning these different levels, we show how our framework naturally encompasses behavioral activity and replays, smoothly moving from rate to temporal coding, and allows learning over behavioral timescales with a plasticity rule acting on a timescale of milliseconds. We discuss how biological parameters such as dwelling times at states, neuronal firing rates and neuromodulation relate to the delay discounting parameter of the TD algorithm, and how they influence the learned representation. We also find that, in agreement with psychological studies and contrary to reinforcement learning theory, the discount factor decreases hyperbolically with time. Finally, our framework suggests a role for replays, in both aiding learning in novel environments and finding shortcut trajectories that were not experienced during behavior, in agreement with experimental data.

学科与关键词

关键词
predictivesuccessor representationhippocampusmodellingMouse
相关
加载中…
  • A Hippocampal Model for Behavioral Time Acquisition and Fast Bidirectional Replay of Spatio-Temporal Memory Sequences
    Gauy, Marcelo Matheus*; Lengler, Johannes; Einarsson, Hafsteinn; Meier, Florian; Weissenberger, Felix; Yanik, Mehmet Fatih; Steger, AngelikaFrontiers in Neuroscience, 2018, 12: 961.被引 8
  • A robotic model of hippocampal reverse replay for reinforcement learning
    Whelan, Matthew T.; Jimenez-Rodriguez, Alejandro; Prescott, Tony J.; Vasilaki, Eleni*Bioinspiration & Biomimetics, 2023, 18(1): 015007.被引 1
  • Learning spatiotemporal signals using a recurrent spiking network that discretizes time
    Maes, Amadeus; Barahona, Mauricio; Clopath, Claudia*PLoS Computational Biology, 2020, 16(1).被引 38
查看全部 →

发表信息

论文状态
公开发表
期刊
eLife
发表日期
2023-03-16
卷期
第 12 卷
页码
e80671
DOI
10.7554/eLife.80671
语言
ENGLISH
成果收录
SCIE
资助标注
Wellcome Trust [200790/Z/16/Z]; Engineering and Physical Sciences Research Council [EP/R035806/1]; Simons Foundation [564408]; EPSRC [EP/R035806/1] Funding Source: UKRI; Wellcome Trust [200790/Z/16/Z] Funding Source: Wellcome Trust

作者

  • B

    Bono, Jacopo (第一作者)

  • Z

    Zannone, Sara

查看全部 4 位作者收起作者
  • P

    Pedrosa, Victor

  • C

    Clopath, Claudia (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417