ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Scalable Zero-Shot Learning via Binary Visual-Semantic Embeddings

Shen, Fumin; Zhou, Xiang; Yu, Jun; Yang, Yang; Liu, Li; Shen, Heng Tao*电子科技大学; 杭州电子科技大学
IEEE Transactions on Image Processing2019-7DOI: 10.1109/TIP.2019.2899987
1被引3阅读
引用收藏
分享

摘要

Zero-shot learning aims to classify the visual instances from unseen classes in the absence of training examples. This is typically achieved by directly mapping visual features to a semantic embedding space of classes (e.g., attributes or word vectors), where the similarity between the two modalities can be readily measured. However, the semantic space may not be reliable for recognition due to the noisy class embeddings or visual bias problem. In this paper, we propose a novel binary embedding-based zero-shot learning (BZSL) method, which recognizes the visual instances from unseen classes through an intermediate discriminative Hamming space. Specifically, BZSL jointly learns two binary coding functions to encode both visual instances and class embeddings into the Hamming space, which well alleviates the visual-semantic bias problem. As a desiring property, classifying an unseen instance thereby can he efficiently done by retrieving its nearest class codes with minimal Hamming distance. During training, by introducing two auxiliary variables for the coding functions, we formulate an equivalent correlation maximization problem, which admits an analytical solution. The resulting algorithm thus enjoys both highly efficient training and scalable novel class inferring. Extensive experiments on four benchmark datasets, including the full ImageNet Fall 2011 dataset with over 20k unseen classes, demonstrate the superiority of our method on the zero-shot learning task. Particularly, we show that increasing the binary embedding dimension can inevitably improve the recognition accuracy.

学科与关键词

关键词
Zero-shot learningbinary embeddings
被引文献 (1)相关
加载中…
  • Flexible Discrete Multi-view Hashing with Collective Latent Feature Learning
    Luyao, Liu; Zheng, Zhang; Zi, HuangNEURAL PROCESSING LETTERS, 2020, 52(3): 1765-1791.

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Image Processing
发表日期
2019-07
卷期
第 28 卷, 第 7 期
页码
3662-3674
DOI
10.1109/TIP.2019.2899987
语言
ENGLISH
成果收录
SCIE
资助标注
National Natural Science Foundation of China [61502081, 61572108, 61622205, 61632007, 61836002]; Sichuan Science and Technology Program [2018GZDZX0032]

作者

  • S

    Shen, Fumin (第一作者)

    univ elect sci & technol china

  • Z

    Zhou, Xiang

    univ elect sci & technol china

查看全部 6 位作者收起作者
  • Y

    Yu, Jun

    hangzhou dianzi univ

  • Y

    Yang, Yang

    univ elect sci & technol china

  • L

    Liu, Li

  • S

    Shen, Heng Tao (通讯)

    univ elect sci & technol china

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417