research
∙
02/16/2023
LEVER: Learning to Verify Language-to-Code Generation with Execution
The advent of large language models trained on code (code LLMs) has led ...
share
research
∙
12/22/2022
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Recent work has shown that fine-tuning large pre-trained language models...
research
∙
12/19/2022
Training Trajectories of Language Models Across Scales
Scaling up language models has led to unprecedented performance gains, b...
research
∙
11/25/2022
Complementary Explanations for Effective In-Context Learning
Large language models (LLMs) have exhibited remarkable capabilities in l...
research
∙
05/30/2022
Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models
Pre-trained masked language models successfully perform few-shot learnin...
research
∙
05/25/2022
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection
Hate speech detection is complex; it relies on commonsense reasoning, kn...
research
∙
05/24/2022
On the Role of Bidirectionality in Language Model Pre-Training
Prior work on language model pre-training has explored different archite...
research
∙
03/14/2022
Efficient Language Modeling with Sparse all-MLP
All-MLP architectures have attracted increasing interest as an alternati...
research
∙
12/20/2021
Efficient Large Scale Language Modeling with Mixtures of Experts
Mixture of Experts layers (MoEs) enable efficient scaling of language mo...
research
∙
11/03/2020
Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning
State-of-the-art natural language understanding classification models fo...
research
∙
10/05/2020
Self-training Improves Pre-training for Natural Language Understanding
Unsupervised pre-training has led to much recent progress in natural lan...
research
∙
09/28/2020
Conversational Semantic Parsing
The structured representation for semantic parsing in task-oriented assi...
research
∙
09/22/2020
Preserving Integrity in Online Social Networks
Online social networks provide a platform for sharing information and fr...
research
∙
10/29/2019