Parallel waveform synthesis based on generative adversarial networks with voicing-aware conditional discriminators

10/27/2020

∙

This paper proposes voicing-aware conditional discriminators for Parallel WaveGAN-based waveform synthesis systems. In this framework, we adopt a projection-based conditioning method that can significantly improve the discriminator's performance. Furthermore, the conventional discriminator is separated into two waveform discriminators for modeling voiced and unvoiced speech. As each discriminator learns the distinctive characteristics of the harmonic and noise components, respectively, the adversarial training process becomes more efficient, allowing the generator to produce more realistic speech waveforms. Subjective test results demonstrate the superiority of the proposed method over the conventional Parallel WaveGAN and WaveNet systems. In particular, our speaker-independently trained model within a FastSpeech 2 based text-to-speech framework achieves the mean opinion scores of 4.20, 4.18, 4.21, and 4.31 for four Japanese speakers, respectively.

READ FULL TEXT

Parallel waveform synthesis based on generative adversarial networks with voicing-aware conditional discriminators

Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram

Improved parallel WaveGAN vocoder with perceptually weighted spectrogram loss

DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Training

Multi-Task Adversarial Training Algorithm for Multi-Speaker Neural Text-to-Speech

Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networks

Facetron: Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representations

MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis

Parallel waveform synthesis based on generative adversarial networks with voicing-aware conditional discriminators

Related Research

Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram

Improved parallel WaveGAN vocoder with perceptually weighted spectrogram loss

DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Training

Multi-Task Adversarial Training Algorithm for Multi-Speaker Neural Text-to-Speech

Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networks

Facetron: Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representations

MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis