research
∙
01/18/2023
ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training
A key performance bottleneck when training graph neural network (GNN) mo...
share
research
∙
10/05/2022
GLM-130B: An Open Bilingual Pre-trained Model
We introduce GLM-130B, a bilingual (English and Chinese) pre-trained lan...
research
∙
03/24/2021
FastMoE: A Fast Mixture-of-Expert Training System
Mixture-of-Expert (MoE) presents a strong potential in enlarging the siz...
research
∙
08/17/2020
