ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Temporal sequence learning, prediction, and control:: A review of different models and their relation to biological mechanisms

Wrgtter, F; Porr, B
Neural Computation2005-2DOI: 10.1162/0899766053011555
134被引2阅读
引用收藏
分享

摘要

In this review, we compare methods for temporal sequence learning (TSL) across the disciplines machine-control, classical conditioning, neuronal models for TSL as well as spike-timing-dependent plasticity (STDP). This review introduces the most influential models and focuses on two questions: To what degree are reward-based (e.g., TD learning) and correlation-based (Hebbian) learning related? and How do the different models correspond to possibly underlying biological mechanisms of synaptic plasticity? We first compare the different models in an open-loop condition, where behavioral feedback does not alter the learning. Here we observe that reward-based and correlation-based learning are indeed very similar. Machine control is then used to introduce the problem of closed-loop control (e.g., actor-critic architectures). Here the problem of evaluative (rewards) versus nonevaluative (correlations) feedback from the environment will be discussed, showing that both learning approaches are fundamentally different in the closed-loop condition. In trying to answer the second question, we compare neuronal versions of the different learning architectures to the anatomy of the involved brain structures (basal-ganglia, thalamus, and cortex) and the molecular biophysics of glutamatergic and dopaminergic synapses. Finally, we discuss the different algorithms used to model STDP and compare them to reward-based learning rules. Certain similarities are found in spite of the strongly different timescales. Here we focus on the biophysics of the different calcium-release mechanisms known to be involved in STDP.

学科与关键词

关键词
LONG-TERM POTENTIATIONDEPENDENT SYNAPTIC PLASTICITYRABBIT FOLLOWING STIMULATIONSELECTIVE SIMPLE CELLSNEURAL-NETWORK MODELDOPAMINE-RECEPTORNEURONAL-ACTIVITYCOMPARTMENTAL ORGANIZATIONCORTICOSTRIATAL SYNAPSESFREQUENCY STIMULATION
相关
加载中…
  • Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity
    Fremaux, Nicolas; Sprekeler, Henning; Gerstner, WulframJournal of Neuroscience, 2010, 30(40): 13326-13337.被引 88
  • Learning a Sparse Code for Temporal Sequences Using STDP and Sequence Compression
    Byrnes, Sean*; Burkitt, Anthony N.; Grayden, David B.; Meffin, HamishNeural Computation, 2011, 23(10): 2567-2598.被引 19
  • A model for complex sequence learning and reproduction in neural populations
    Verduzco-Flores, Sergio Oscar*; Bodner, Mark; Ermentrout, BardJournal of Computational Neuroscience, 2012, 32(3): 403-423.被引 22
查看全部 →

发表信息

论文状态
公开发表
期刊
Neural Computation
发表日期
2005-02
卷期
第 17 卷, 第 2 期
页码
245-319
DOI
10.1162/0899766053011555
语言
ENGLISH
成果收录
SCIE

作者

  • W

    Wrgtter, F (第一作者)

  • P

    Porr, B

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417