research
∙
03/11/2022
Staged Training for Transformer Language Models
The current standard approach to scaling transformer language models tra...
share
research
∙
06/01/2021
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World
We propose PIGLeT: a model that learns physical commonsense knowledge th...
research
∙
08/29/2019
Shallow Syntax in Deep Water
Shallow syntax provides an approximation of phrase-syntactic structure o...
research
∙
03/21/2019
Linguistic Knowledge and Transferability of Contextual Representations
Contextual word representations derived from large-scale neural language...
research
∙
03/14/2019
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks
While most previous work has focused on different pretraining objectives...
research
∙
05/16/2018
Extending a Parser to Distant Domains Using a Few Dozen Partially Annotated Examples
We revisit domain adaptation for parsers in the neural era. First we sho...
research
∙
05/06/2018
Construction of the Literature Graph in Semantic Scholar
We describe a deployed scalable system for organizing published scientif...
research
∙
03/20/2018