research
∙
04/06/2023
Noise-Robust Dense Retrieval via Contrastive Alignment Post Training
The success of contextual word representations and advances in neural in...
share
research
∙
04/05/2023
To Asymmetry and Beyond: Structured Pruning of Sequence to Sequence Models for Improved Inference Efficiency
Sequence-to-sequence language models can be used to produce abstractive ...
research
∙
03/31/2023
Dense Sparse Retrieval: Using Sparse Language Models for Inference Efficient Dense Retrieval
Vector-based retrieval systems have become a common staple for academic ...
research
∙
03/31/2023
Quick Dense Retrievers Consume KALE: Post Training Kullback Leibler Alignment of Embeddings for Asymmetrical dual encoders
In this paper, we consider the problem of improving the inference latenc...
research
∙
03/30/2023
oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes
In this paper, we introduce the range of oBERTa language models, an easy...
research
∙
11/29/2022
Compressing Cross-Lingual Multi-Task Models at Qualtrics
Experience management is an emerging business area where organizations f...
research
∙
05/25/2022
Sparse*BERT: Sparse Models are Robust
Large Language Models have become the core architecture upon which most ...
research
∙
03/14/2022
The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models
Pre-trained Transformer-based language models have become a key building...
research
∙
09/03/2021
IMG2SMI: Translating Molecular Structure Images to Simplified Molecular-input Line-entry System
Like many scientific fields, new chemistry literature has grown at a sta...
research
∙
08/04/2021
Curriculum learning for language modeling
Language Models like ELMo and BERT have provided robust representations ...
research
∙
05/09/2021
MS MARCO: Benchmarking Ranking Models in the Large-Data Regime
Evaluation efforts such as TREC, CLEF, NTCIR and FIRE, alongside public ...
research
∙
04/19/2021
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime
The TREC Deep Learning (DL) Track studies ad hoc search in the large dat...
research
∙
02/25/2021
Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard
Leaderboards are a ubiquitous part of modern research in applied machine...
research
∙
02/15/2021
Overview of the TREC 2020 deep learning track
This is the second year of the TREC Deep Learning Track, with the goal o...
research
∙
06/09/2020
ORCAS: 18 Million Clicked Query-Document Pairs for Analyzing Search
Users of Web search engines reveal their information needs through queri...
research
∙
04/28/2020
On the Reliability of Test Collections for Evaluating Systems of Different Types
As deep learning based models are increasingly being used for informatio...
research
∙
03/17/2020
Overview of the TREC 2019 deep learning track
The Deep Learning Track is a new track for TREC 2019, with the goal of s...
research
∙
11/06/2019
Open Domain Web Keyphrase Extraction Beyond Language Modeling
This paper studies keyphrase extraction in real-world scenarios where do...
research
∙
10/09/2019