ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Predicting eye movement patterns from fMRI responses to natural scenes

O'Connell, Thomas P.*; Chun, Marvin M.
Nature Communications2018-12-4DOI: 10.1038/s41467-018-07471-9
24被引6阅读
引用收藏
分享

摘要

Eye tracking has long been used to measure overt spatial attention, and computational models of spatial attention reliably predict eye movements to natural images. However, researchers lack techniques to noninvasively access spatial representations in the human brain that guide eye movements. Here, we use functional magnetic resonance imaging (fMRI) to predict eye movement patterns from reconstructed spatial representations evoked by natural scenes. First, we reconstruct fixation maps to directly predict eye movement patterns from fMRI activity. Next, we use a model-based decoding pipeline that aligns fMRI activity to deep convolutional neural network activity to reconstruct spatial priority maps and predict eye movements in a zero-shot fashion. We predict human eye movement patterns from fMRI responses to natural scenes, provide evidence that visual representations of scenes and objects map onto neural representations that predict eye movements, and find a novel three-way link between brain activity, deep neural network models, and behavior.

学科与关键词

关键词
SURFACE-BASED ANALYSISDEEP NEURAL-NETWORKSGEOMETRICALLY ACCURATEVISUAL-ATTENTIONREPRESENTATIONSMODELSIMAGESINFORMATIONPARIETALPRIORITY
相关
加载中…
  • Detection of eye movements from fMRI data
    Beauchamp, MS*Magnetic Resonance in Medicine, 2003, 49(2): 376-380.被引 33
  • Cortical regions involved in eye movements, shifts of attention, and gaze perception
    Grosbras, MN; Laird, AR; Paus, THUMAN BRAIN MAPPING, 2005, 25(1): 140-154.被引 245
  • Visual attention: Insights from brain imaging
    Kanwisher, N; Wojciulik, ENature Reviews Neuroscience, 2000, 1(2): 91-100.被引 481
查看全部 →

发表信息

论文状态
公开发表
期刊
Nature Communications
发表日期
2018-12-04
卷期
第 9 卷
页码
5159
DOI
10.1038/s41467-018-07471-9
语言
ENGLISH
期刊收录
NATURE-INDEX
期刊等级
Q1
成果收录
SCIE
资助标注
Yale FAS Program - Office of the Provost; Department of Psychology; US National Science Foundation Graduate Research Fellowship; NSF [BCS 1558497]; NIH [MH 108591]

作者

  • O

    O'Connell, Thomas P. (通讯) (第一作者)

  • C

    Chun, Marvin M.

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417