Chat-to-Design: AI Assisted Personalized Fashion Design

by   Weiming Zhuang, et al.

In this demo, we present Chat-to-Design, a new multimodal interaction system for personalized fashion design. Compared to classic systems that recommend apparel based on keywords, Chat-to-Design enables users to design clothes in two steps: 1) coarse-grained selection via conversation and 2) fine-grained editing via an interactive interface. It encompasses three sub-systems to deliver an immersive user experience: A conversation system empowered by natural language understanding to accept users' requests and manages dialogs; A multimodal fashion retrieval system empowered by a large-scale pretrained language-image network to retrieve requested apparel; A fashion design system empowered by emerging generative techniques to edit attributes of retrieved clothes.


page 1

page 2


Talk-to-Edit: Fine-Grained Facial Editing via Dialog

Facial editing is an important task in vision and graphics with numerous...

FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-training

Fashion vision-language pre-training models have shown efficacy for a wi...

Fashion Image Retrieval with Multi-Granular Alignment

Fashion image retrieval task aims to search relevant clothing items of a...

Hybrid Interest Modeling for Long-tailed Users

User behavior modeling is a key technique for recommender systems. Howev...

Adjusting Image Attributes of Localized Regions with Low-level Dialogue

Natural Language Image Editing (NLIE) aims to use natural language instr...

Learning to Customize Language Model for Generation-based dialog systems

Personalized conversation systems have received increasing attention rec...

Edit As You Wish: Video Description Editing with Multi-grained Commands

Automatically narrating a video with natural language can assist people ...

Please sign up or login with your details

Forgot password? Click here to reset