research
∙
06/11/2023
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model
Currently, the reduction in the parameter scale of large-scale pre-train...
share
research
∙
06/11/2023
Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method
The large scale of pre-trained language models poses a challenge for the...
research
∙
01/08/2022
