research
∙
12/19/2022
A Natural Bias for Language Generation Models
After just a few hundred training updates, a standard probabilistic mode...
share
research
∙
12/08/2021
Ethical and social risks of harm from Language Models
This paper aims to help structure the risk landscape associated with lar...
research
∙
09/06/2021
You should evaluate your language model on marginal likelihood overtokenisations
Neural language models typically tokenise input text into sub-word units...
research
∙
03/18/2021
Pretraining the Noisy Channel Model for Task-Oriented Dialogue
Direct decoding for task-oriented dialogue is known to suffer from the e...
research
∙
06/01/2020
Probing Emergent Semantics in Predictive Agents via Question Answering
Recent work has shown how predictive modeling can endow agents with rich...
research
∙
05/27/2020
Syntactic Structure Distillation Pretraining For Bidirectional Encoders
Textual representation learners trained on large amounts of data have ac...
research
∙
09/24/2019
Neural Generative Rhetorical Structure Parsing
Rhetorical structure trees have been shown to be useful for several docu...
research
∙
06/14/2019
Scalable Syntax-Aware Language Models Using Knowledge Distillation
Prior work has shown that, on small amounts of training data, syntactic ...
research
∙
08/02/2016
Proceedings of the 2016 Workshop on Semantic Spaces at the Intersection of NLP, Physics and Cognitive Science
This volume contains the Proceedings of the 2016 Workshop on Semantic Sp...
research
∙
09/05/2015
Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learning
Recent work on word embeddings has shown that simple vector subtraction ...
research
∙
11/28/2014