research
∙
04/21/2023
Emergent and Predictable Memorization in Large Language Models
Memorization, or the tendency of large language models (LLMs) to output ...
share
research
∙
04/03/2023
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
How do large language models (LLMs) develop and evolve over the course o...
research
∙
03/23/2023
Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages
While code-mixing is a common linguistic practice in many parts of the w...
research
∙
12/19/2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
The BLOOM model is a large open-source multilingual language model capab...
research
∙
11/03/2022
Crosslingual Generalization through Multitask Finetuning
Multitask prompted finetuning (MTF) has been shown to help large languag...
research
∙
10/27/2022
What Language Model to Train if You Have One Million GPU Hours?
The crystallization of modeling methods around the Transformer architect...
research
∙
11/20/2021
Data Processing Matters: SRPH-Konvergen AI's Machine Translation System for WMT'21
In this paper, we describe the submission of the joint Samsung Research ...
research
∙
10/15/2021