ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

ADINet: Attention-guided dual-branch integration network for atypical visual saliency prediction

Wang, Qi; Zhou, Xiaofei*; Zhu, Zunjie; Zhang, Jiyong; Yan, Chengganghangzhou dianzi univ
JOURNAL OF ELECTRONIC IMAGING2023-3-1DOI: 10.1117/1.JEI.32.2.023047
1阅读
引用收藏
分享

摘要

Compared with typically developed people, patients with autism spectrum disorder (ASD) have many differences, including visual attention. Recently, researchers have employed saliency prediction to conduct early diagnosis for patients with ASD by observing whether the fixation maps of the patients are consistent with prediction results. Though numerous saliency models have been designed, which promotes the performance of saliency prediction significantly, the efforts major in atypical attention prediction are fewer. Therefore, we propose a novel atypical saliency model, namely attention-guided dual-branch integration network, to perform atypical visual saliency prediction. Generally, our model is a U-shaped architecture including an encoder and a decoder. In the encoder, we first deploy the dual-branch fusion module to extract multiscale deep features, where the dual branches consist of a coarse branch and a fine branch. Particularly, the multiscale features of each branch are integrated in a bilateral way. Then, we employ the multiattention module consisting of dilated convolution, channel attention, and spatial attention to further elevate the high-level semantic cues. Particularly, the attention units are constructed in a cascaded way. Besides, to give an effective representation for the differences between atypical saliency estimation and the typical saliency estimation, we design a new discriminative mask to compute the loss function. Extensive experiments are performed on challenging datasets, and the results show the superiority and effectiveness of our atypical saliency model when compared with the state-of-the-art saliency prediction models.

学科与关键词

关键词
autism spectrum disordersaliency predictionatypical saliencyvisual attentionfeature integration
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
JOURNAL OF ELECTRONIC IMAGING
发表日期
2023-03-01
卷期
第 32 卷, 第 2 期
页码
023047
DOI
10.1117/1.JEI.32.2.023047
语言
ENGLISH
成果收录
SCIE
资助标注
National Key Research and Development Program of China [2020YFB1406604]; Fundamental Research Funds for the Provincial Universities of Zhejiang [GK219909299001-407, GK229909299001-009]; National Natural Science Foundation of China [62271180, 62171002, U21B2024, 61931008, 62071415, 61972123, 62001146]; Zhejiang Province Nature Science Foundation of China [LR17F030006, LY19F030022, LZ22F020003]; Hangzhou Dianzi University (HDU); China Electronics Corporation DATA (CECDATA) Joint Research Center of Big Data Technologies [KYH063120009]; 111 Project [D17019]

作者

  • W

    Wang, Qi (第一作者)

    hangzhou dianzi univ

  • Z

    Zhou, Xiaofei (通讯)

    hangzhou dianzi univ

查看全部 5 位作者收起作者
  • Z

    Zhu, Zunjie

    hangzhou dianzi univ

  • Z

    Zhang, Jiyong

    hangzhou dianzi univ

  • Y

    Yan, Chenggang

    hangzhou dianzi univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417