Multilingual Pre-training with Language and Task Adaptation for Multilingual Text Style Transfer

03/16/2022
by   Huiyuan Lai, et al.
9

We exploit the pre-trained seq2seq model mBART for multilingual text style transfer. Using machine translated data as well as gold aligned English sentences yields state-of-the-art results in the three target languages we consider. Besides, in view of the general scarcity of parallel data, we propose a modular approach for multilingual formality transfer, which consists of two training strategies that target adaptation to both language and task. Our approach achieves competitive performance without monolingual task-specific parallel data and can be applied to other style transfer tasks as well as to other languages.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2021

XFORMAL: A Benchmark for Multilingual Formality Style Transfer

We take the first step towards multilingual style transfer by creating a...
research
09/02/2020

Defeating Author Gender Identification with Text Style Transfer

Text Style Transfer can be named as one of the most important Natural La...
research
09/09/2021

Generic resources are what you need: Style transfer tasks without task-specific parallel training data

Style transfer aims to rewrite a source text in a different target style...
research
03/27/2019

Grammatical Error Correction and Style Transfer via Zero-shot Monolingual Translation

Both grammatical error correction and text style transfer can be viewed ...
research
10/18/2018

Large-scale Hierarchical Alignment for Author Style Transfer

We propose a simple method for extracting pseudo-parallel monolingual se...
research
09/08/2021

Smelting Gold and Silver for Improved Multilingual AMR-to-Text Generation

Recent work on multilingual AMR-to-text generation has exclusively focus...
research
11/06/2022

Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecasting

Deep motion forecasting models have achieved great success when trained ...

Please sign up or login with your details

Forgot password? Click here to reset