摘要
Eye tracking has long been used to measure overt spatial attention, and computational models of spatial attention reliably predict eye movements to natural images. However, researchers lack techniques to noninvasively access spatial representations in the human brain that guide eye movements. Here, we use functional magnetic resonance imaging (fMRI) to predict eye movement patterns from reconstructed spatial representations evoked by natural scenes. First, we reconstruct fixation maps to directly predict eye movement patterns from fMRI activity. Next, we use a model-based decoding pipeline that aligns fMRI activity to deep convolutional neural network activity to reconstruct spatial priority maps and predict eye movements in a zero-shot fashion. We predict human eye movement patterns from fMRI responses to natural scenes, provide evidence that visual representations of scenes and objects map onto neural representations that predict eye movements, and find a novel three-way link between brain activity, deep neural network models, and behavior.
学科与关键词
- Detection of eye movements from fMRI dataBeauchamp, MS*Magnetic Resonance in Medicine, 2003, 49(2): 376-380.被引 33
- Cortical regions involved in eye movements, shifts of attention, and gaze perceptionGrosbras, MN; Laird, AR; Paus, THUMAN BRAIN MAPPING, 2005, 25(1): 140-154.被引 245
- Visual attention: Insights from brain imagingKanwisher, N; Wojciulik, ENature Reviews Neuroscience, 2000, 1(2): 91-100.被引 481
