research
∙
09/11/2023
Large Language Model for Science: A Study on P vs. NP
In this work, we use large language models (LLMs) to augment and acceler...
share
research
∙
06/26/2023
Kosmos-2: Grounding Multimodal Large Language Models to the World
We introduce Kosmos-2, a Multimodal Large Language Model (MLLM), enablin...
research
∙
02/27/2023
Language Is Not All You Need: Aligning Perception with Language Models
A big convergence of language, multimodal perception, action, and world ...
research
∙
12/20/2022
Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers
Large pretrained language models have shown surprising In-Context Learni...
research
∙
12/19/2022
Optimizing Prompts for Text-to-Image Generation
Well-designed prompts can guide text-to-image models to generate amazing...
research
∙
12/13/2022
Structured Prompting: Scaling In-Context Learning to 1,000 Examples
Large language models have exhibited intriguing in-context learning capa...
research
∙
11/24/2022
Prototypical Fine-tuning: Towards Robust Performance Under Varying Data Sizes
In this paper, we move towards combining large parametric models with no...
research
∙
06/13/2022
Language Models are General-Purpose Interfaces
Foundation models have received much attention due to their effectivenes...
research
∙
05/20/2022
Prototypical Calibration for Few-shot Learning of Language Models
In-context learning of GPT-like models has been recognized as fragile ac...
research
∙
06/25/2021
Learning to Sample Replacements for ELECTRA Pre-Training
ELECTRA pretrains a discriminator to detect replaced tokens, where the r...
research
∙
04/18/2021
Knowledge Neurons in Pretrained Transformers
Large-scale pretrained language models are surprisingly good at recallin...
research
∙
04/23/2020
Self-Attention Attribution: Interpreting Information Interactions Inside Transformer
The great success of Transformer-based models benefits from the powerful...
research
∙
08/15/2019