HyperDomainNet: Universal Domain Adaptation for Generative Adversarial Networks

by   Aibek Alanov, et al.

Domain adaptation framework of GANs has achieved great progress in recent years as a main successful approach of training contemporary GANs in the case of very limited training data. In this work, we significantly improve this framework by proposing an extremely compact parameter space for fine-tuning the generator. We introduce a novel domain-modulation technique that allows to optimize only 6 thousand-dimensional vector instead of 30 million weights of StyleGAN2 to adapt to a target domain. We apply this parameterization to the state-of-art domain adaptation methods and show that it has almost the same expressiveness as the full parameter space. Additionally, we propose a new regularization loss that considerably enhances the diversity of the fine-tuned generator. Inspired by the reduction in the size of the optimizing parameter space we consider the problem of multi-domain adaptation of GANs, i.e. setting when the same model can adapt to several domains depending on the input query. We propose the HyperDomainNet that is a hypernetwork that predicts our parameterization given the target domain. We empirically confirm that it can successfully learn a number of domains at once and may even generalize to unseen domains. Source code can be found at https://github.com/MACderRu/HyperDomainNet


page 7

page 18

page 21

page 24

page 25

page 26

page 28

page 30


Light-weight Calibrator: a Separable Component for Unsupervised Domain Adaptation

Existing domain adaptation methods aim at learning features that can be ...

StyleDomain: Analysis of StyleSpace for Domain Adaptation of StyleGAN

Domain adaptation of GANs is a problem of fine-tuning the state-of-the-a...

Transferring GANs: generating images from limited data

Transferring the knowledge of pretrained networks to new domains by mean...

Domain Re-Modulation for Few-Shot Generative Domain Adaptation

In this study, we investigate the task of few-shot Generative Domain Ada...

Low-Resource Domain Adaptation for Speaker Recognition Using Cycle-GANs

Current speaker recognition technology provides great performance with t...

Domain Adaptation based on Human Feedback for Enhancing Generative Model Denoising Abilities

How can we apply human feedback into generative model? As answer of this...

Taxonomy-Structured Domain Adaptation

Domain adaptation aims to mitigate distribution shifts among different d...

Please sign up or login with your details

Forgot password? Click here to reset