research
∙
07/19/2023
Challenges and Applications of Large Language Models
Large Language Models (LLMs) went from non-existent to ubiquitous in the...
share
research
∙
07/12/2023
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
The computation necessary for training Transformer-based language models...
research
∙
04/18/2023
TTIDA: Controllable Generative Data Augmentation via Text-to-Text and Text-to-Image Models
Data augmentation has been established as an efficacious approach to sup...
research
∙
04/17/2023
The MiniPile Challenge for Data-Efficient Language Models
The ever-growing diversity of pre-training text corpora has equipped lan...
research
∙
01/27/2023
DAG Learning on the Permutahedron
We propose a continuous optimization framework for discovering a latent ...
research
∙
09/29/2022
Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging
Training vision or language models on large datasets can take days, if n...
research
∙
07/17/2020