research
∙
09/15/2023
Headless Language Models: Learning without Predicting with Contrastive Weight Tying
Self-supervised pre-training of language models usually consists in pred...
share
research
∙
06/27/2023
CamemBERT-bio: a Tasty French Language Model Better for your Health
Clinical data in hospitals are increasingly accessible for research thro...
research
∙
06/13/2023
Is Anisotropy Inherent to Transformers?
The representation degeneration problem is a phenomenon that is widely o...
research
∙
12/14/2022
MANTa: Efficient Gradient-Based Tokenization for Robust End-to-End Language Modeling
Static subword tokenization algorithms have been an essential component ...
research
∙
11/18/2020
Clustering-based Automatic Construction of Legal Entity Knowledge Base from Contracts
In contract analysis and contract automation, a knowledge base (KB) of l...
research
∙
05/01/2020
Multilingual Unsupervised Sentence Simplification
Progress in Sentence Simplification has been hindered by the lack of sup...
research
∙
10/07/2019