research
∙
04/28/2023
Dissecting Recall of Factual Associations in Auto-Regressive Language Models
Transformer-based language models (LMs) are known to capture factual kno...
share
research
∙
05/23/2022
Simple Recurrence Improves Masked Language Models
In this work, we explore whether modeling recurrence into the Transforme...
research
∙
03/31/2022
Scaling Up Models and Data with and
Recent neural network-based language models have benefited greatly from ...
research
∙
01/27/2022
Diagnosing AI Explanation Methods with Folk Concepts of Behavior
When explaining AI behavior to humans, how is the communicated informati...
research
∙
11/14/2021
"Will You Find These Shortcuts?" A Protocol for Evaluating the Faithfulness of Input Salience Methods for Text Classification
Feature attribution a.k.a. input salience methods which assign an import...
research
∙
10/05/2021
Autoregressive Diffusion Models
We introduce Autoregressive Diffusion Models (ARDMs), a model class enco...
research
∙
06/30/2021
The MultiBERTs: BERT Reproductions for Robustness Analysis
Experiments with pretrained models such as BERT are often based on a sin...
research
∙
10/12/2020
The elephant in the interpretability room: Why use attention as explanation when we have saliency methods?
There is a recent surge of interest in using attention as explanation of...
research
∙
08/12/2020