research
∙
06/24/2023
Graph Neural Networks Provably Benefit from Structural Information: A Feature Learning Perspective
Graph neural networks (GNNs) have pioneered advancements in graph repres...
share
research
∙
06/20/2023
The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks
We study the implicit bias of batch normalization trained by gradient de...
research
∙
06/08/2023
Speech-to-Text Adapter and Speech-to-Entity Retriever Augmented LLMs for Speech Understanding
Large Language Models (LLMs) have been applied in the speech domain, oft...
research
∙
05/30/2023
Grammar Prompting for Domain-Specific Language Generation with Large Language Models
Large language models (LLMs) can learn to perform a wide range of natura...
research
∙
05/20/2023
Can Public Large Language Models Help Private Cross-device Federated Learning?
We study (differentially) private federated learning (FL) of language mo...
research
∙
05/17/2023
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Language models are increasingly being deployed for general problem solv...
research
∙
04/21/2023
Learn to Cluster Faces with Better Subgraphs
Face clustering can provide pseudo-labels to the massive unlabeled face ...
research
∙
03/31/2023
Per-Example Gradient Regularization Improves Learning Signals from Noisy Data
Gradient regularization, as described in <cit.>, is a highly effective t...
research
∙
03/15/2023
The Benefits of Mixup for Feature Learning
Mixup, a simple data augmentation method that randomly mixes two data po...
research
∙
02/24/2023
MUX-PLMs: Pre-training Language Models with Data Multiplexing
Data multiplexing is a recently proposed method for improving a model's ...
research
∙
02/09/2023
Binarized Neural Machine Translation
The rapid scaling of language models is motivating research using low-bi...
research
∙
02/08/2023
SimCGNN: Simple Contrastive Graph Neural Network for Session-based Recommendation
Session-based recommendation (SBR) problem, which focuses on next-item p...
research
∙
12/20/2022
AnyTOD: A Programmable Task-Oriented Dialog System
We propose AnyTOD, an end-to-end task-oriented dialog (TOD) system with ...
research
∙
12/16/2022
Speech Aware Dialog System Technology Challenge (DSTC11)
Most research on task oriented dialog modeling is based on written text ...
research
∙
12/03/2022
Fast Online Hashing with Multi-Label Projection
Hashing has been widely researched to solve the large-scale approximate ...
research
∙
10/13/2022
Knowledge-grounded Dialog State Tracking
Knowledge (including structured knowledge such as schema and ontology, a...
research
∙
10/06/2022
ReAct: Synergizing Reasoning and Acting in Language Models
While large language models (LLMs) have demonstrated impressive capabili...
research
∙
08/21/2022
Multiple Descent in the Multiple Random Feature Model
Recent works have demonstrated a double descent phenomenon in over-param...
research
∙
05/09/2022
Unsupervised Slot Schema Induction for Task-oriented Dialog
Carefully-designed schemas describing how to collect and annotate dialog...
research
∙
05/09/2022
Building Machine Translation Systems for the Next Thousand Languages
In this paper we share findings from our effort to build practical machi...
research
∙
05/02/2022
The Implicit Length Bias of Label Smoothing on Beam Search Decoding
Label smoothing is ubiquitously applied in Neural Machine Translation (N...
research
∙
04/08/2022
Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue
Building universal dialogue systems that can seamlessly operate across m...
research
∙
03/17/2022
Nearest Neighbor Classifier with Margin Penalty for Active Learning
As deep learning becomes the mainstream in the field of natural language...
research
∙
03/15/2022
Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation
Multilingual neural machine translation models are trained to maximize t...
research
∙
02/14/2022
Benign Overfitting in Two-layer Convolutional Neural Networks
Modern neural networks often have great expressive power and can be trai...
research
∙
01/21/2022
Description-Driven Task-Oriented Dialog Modeling
Task-oriented dialogue (TOD) systems are required to identify key inform...
research
∙
01/09/2022
Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning
Achieving universal translation between all human language pairs is the ...
research
∙
12/31/2021
Benign Overfitting in Adversarially Robust Linear Classification
"Benign overfitting", where classifiers memorize noisy training data yet...
research
∙
10/28/2021
Understanding How Encoder-Decoder Architectures Attend
Encoder-decoder networks with attention have proven to be a powerful way...
research
∙
10/13/2021
SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems
Zero/few-shot transfer to unseen services is a critical challenge in tas...
research
∙
10/06/2021
Efficient and Private Federated Learning with Partially Trainable Networks
Federated learning is used for decentralized training of machine learnin...
research
∙
09/19/2021
Towards Zero-Label Language Learning
This paper explores zero-label learning in Natural Language Processing (...
research
∙
08/31/2021
Effective Sequence-to-Sequence Dialogue State Tracking
Sequence-to-sequence models have been applied to a wide variety of NLP t...
research
∙
08/25/2021
Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization
Adaptive gradient methods such as Adam have gained increasing popularity...
research
∙
08/24/2021
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
With recent progress in joint modeling of visual and textual representat...
research
∙
06/07/2021
A Comprehensive Survey on Image Dehazing Based on Deep Learning
The presence of haze significantly reduces the quality of images. Resear...
research
∙
05/17/2021
Construction and enumeration of left dihedral codes satisfying certain duality properties
Let 𝔽_q be the finite field of q elements and let D_2n=⟨ x,y| x^n=1, y^2...
research
∙
04/28/2021
Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian Mixtures
Modern machine learning systems such as deep neural networks are often h...
research
∙
02/27/2021
Improving Longer-range Dialogue State Tracking
Dialogue state tracking (DST) is a pivotal component in task-oriented di...
research
∙
02/18/2021
Echo State Speech Recognition
We propose automatic speech recognition (ASR) models inspired by echo st...
research
∙
01/04/2021
Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise
We consider a one-hidden-layer leaky ReLU network of arbitrary width tra...
research
∙
11/11/2020
Towards NNGP-guided Neural Architecture Search
The predictions of wide Bayesian neural networks are described by a Gaus...
research
∙
10/28/2020
The geometry of integration in text classification RNNs
Despite the widespread application of recurrent neural networks (RNNs) a...
research
∙
10/23/2020
Rapid Domain Adaptation for Machine Translation with Monolingual Data
One challenge of machine translation is how to quickly adapt to unseen d...
research
∙
10/21/2020
Deciphering Undersegmented Ancient Scripts Using Phonetic Prior
Most undeciphered lost languages exhibit two characteristics that pose s...
research
∙
10/12/2020
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models
Massively multilingual models subsuming tens or even hundreds of languag...
research
∙
10/01/2020
Agnostic Learning of Halfspaces with Gradient Descent via Soft Margins
We analyze the properties of gradient descent on convex surrogates for t...
research
∙
07/19/2020
An explicit expression for Euclidean self-dual cyclic codes of length 2^k over Galois ring GR(4,m)
For any positive integers m and k, existing literature only determines t...
research
∙
05/29/2020
Agnostic Learning of a Single Neuron with Gradient Descent
We consider the problem of learning the best-fitting single neuron as me...
research
∙
05/11/2020