Sukjin Hong | DeepAI

DeepAI

AI Chat AI Image Generator AI Video AI Music Generator

Featured Co-authors

Se-Young Yun
50 publications
Wonyong Sung
28 publications
Jungwook Choi
17 publications
Minsoo Kim
16 publications
Jongwoo Ko
6 publications
Minchan Jeong
4 publications
Janghwan Lee
3 publications
Sihwa Lee
3 publications
Du-Seong Chang
3 publications
Seungjoon Park
1 publication
Euijai Ahn
1 publication

research

∙ 08/13/2023

Token-Scaled Logit Distillation for Ternary Weight Generative Language Models

Generative Language Models (GLMs) have shown impressive performance in t...

0 Minsoo Kim, et al. ∙

research

∙ 02/03/2023

Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective

Knowledge distillation (KD) is a highly promising method for mitigating ...

0 Jongwoo Ko, et al. ∙

research

∙ 11/20/2022

Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders

Knowledge distillation (KD) has been a ubiquitous method for model compr...

0 Minsoo Kim, et al. ∙