research
∙
02/09/2023
ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Models
In recent years, there has been an increased popularity in image and spe...
share
research
∙
12/13/2022
ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages
Software engineers working with the same programming language (PL) may s...
research
∙
11/30/2022
X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection
Detecting sarcasm and verbal irony from people's subjective statements i...
research
∙
11/27/2022
X-PuDu at SemEval-2022 Task 7: A Replaced Token Detection Task Pre-trained Model with Pattern-aware Ensembling for Identifying Plausible Clarifications
This paper describes our winning system on SemEval 2022 Task 7: Identify...
research
∙
11/09/2022
ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation
Recent cross-lingual cross-modal works attempt to extend Vision-Language...
research
∙
11/07/2022
ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-Speech
Speech representation learning has improved both speech understanding an...
research
∙
10/21/2022
Clip-Tuning: Towards Derivative-free Prompt Learning with a Mixture of Rewards
Derivative-free prompt learning has emerged as a lightweight alternative...
research
∙
05/19/2022
Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters
The ever-growing model size and scale of compute have attracted increasi...
research
∙
12/23/2021
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Pre-trained language models have achieved state-of-the-art results in va...
research
∙
07/05/2021
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Pre-trained models have achieved state-of-the-art results in various Nat...
research
∙
12/31/2020
ERNIE-DOC: The Retrospective Long-Document Modeling Transformer
Transformers are not suited for processing long document input due to it...
research
∙
12/31/2020
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora
Recent studies have demonstrated that pre-trained cross-lingual models a...
research
∙
10/07/2020
Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification using Pre-trained Language Models
This paper describes Galileo's performance in SemEval-2020 Task 12 on de...
research
∙
09/08/2020
ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model
This paper describes the system designed by ERNIE Team which achieved th...
research
∙
09/08/2020
kk2018 at SemEval-2020 Task 9: Adversarial Training for Code-Mixing Sentiment Classification
Code switching is a linguistic phenomenon that may occur within a multil...
research
∙
07/29/2019
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding
Recently, pre-trained models have achieved state-of-the-art results in v...
research
∙
04/19/2019