research
∙
05/20/2022
SE-MoE: A Scalable and Efficient Mixture-of-Experts Distributed Training and Inference System
With the increasing diversity of ML infrastructures nowadays, distribute...
share
research
∙
05/19/2022
Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters
The ever-growing model size and scale of compute have attracted increasi...
research
∙
12/23/2021
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Pre-trained language models have achieved state-of-the-art results in va...
research
∙
12/06/2021
End-to-end Adaptive Distributed Training on PaddlePaddle
Distributed training has become a pervasive and effective approach for t...
research
∙
07/05/2021