ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Collocated Clothing Synthesis with GANs Aided by Textual Information: A Multi-Modal Framework

Liu, Linlin; Zhang, Haijun*; Li, Qun; Ma, Jianghong; Zhang, Zhaoharbin inst technol
ACM Transactions on Multimedia Computing Communications and Applications2024-1DOI: 10.1145/3614097
12阅读
引用收藏
分享

摘要

Synthesizing realistic images of fashion items which are compatible with given clothing images, as well as conditioning on multiple modalities, brings novel and exciting applications together with enormous economic potential. In this work, we propose a multi-modal collocation framework based on generative adversarial network (GAN) for synthesizing compatible clothing images. Given an input clothing item that consists of an image and a text description, our model works on synthesizing a clothing image which is compatible with the input clothing, as well as being guided by a given text description from the target domain. Specifically, a generator aims to synthesize realistic and collocated clothing images relying on image- and text-based latent representations learned from the source domain. An auxiliary text representation from the target domain is added for supervising the generation results. In addition, a multi-discriminator framework is carried out to determine compatibility between the generated clothing images and the input clothing images, as well as visual-semantic matching between the generated clothing images and the targeted textual information. Extensive quantitative and qualitative results demonstrate that our model substantially outperforms state-of-the-art methods in terms of authenticity, diversity, and visual-semantic similarity between image and text.

学科与关键词

关键词
Multi-modalclothes collocationgenerative adversarial networksimage translationfashion data
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
ACM Transactions on Multimedia Computing Communications and Applications
发表日期
2024-01
卷期
第 20 卷, 第 1 期
页码
26
DOI
10.1145/3614097
语言
ENGLISH
成果收录
SCIE
资助标注
National Natural Science Foundation of China [61972112, 61832004, 62202122]; Guangdong Basic and Applied Basic Research Foundation [2021B1515020088]; Shenzhen Science and Technology Program [JCYJ20210324131203009]; HITSZJ&A Joint Laboratory of Digital Design and Intelligent Fabrication [HITSZ-JA-2021A01]

作者

  • L

    Liu, Linlin (第一作者)

    harbin inst technol

  • Z

    Zhang, Haijun (通讯)

    harbin inst technol

查看全部 5 位作者收起作者
  • L

    Li, Qun

    harbin inst technol

  • M

    Ma, Jianghong

    harbin inst technol

  • Z

    Zhang, Zhao

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417