research
∙
09/05/2023
Cognitive Architectures for Language Agents
Recent efforts have incorporated large language models (LLMs) with exter...
share
research
∙
07/18/2023
Scaling Laws for Imitation Learning in NetHack
Imitation Learning (IL) is one of the most widely used methods in machin...
research
∙
07/17/2023
COLLIE: Systematic Construction of Constrained Text Generation Tasks
Text generation under constraints have seen increasing interests in natu...
research
∙
07/01/2023
InstructEval: Systematic Evaluation of Instruction Selection Methods
In-context learning (ICL) performs tasks by prompting a large language m...
research
∙
06/26/2023
InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback
Humans write code in a fundamentally interactive manner and rely on cons...
research
∙
05/24/2023
Referral Augmentation for Zero-Shot Information Retrieval
We propose Referral-Augmented Retrieval (RAR), a simple technique that c...
research
∙
05/24/2023
CSTS: Conditional Semantic Textual Similarity
Semantic textual similarity (STS) has been a cornerstone task in NLP tha...
research
∙
05/24/2023
Anthropomorphization of AI: Opportunities and Risks
Anthropomorphization is the tendency to attribute human-like traits to n...
research
∙
05/24/2023
PruMUX: Augmenting Data Multiplexing with Model Compression
As language models increase in size by the day, methods for efficient in...
research
∙
05/17/2023
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Language models are increasingly being deployed for general problem solv...
research
∙
04/11/2023
Toxicity in ChatGPT: Analyzing Persona-assigned Language Models
Large language models (LLMs) have shown incredible capabilities and tran...
research
∙
02/24/2023
MUX-PLMs: Pre-training Language Models with Data Multiplexing
Data multiplexing is a recently proposed method for improving a model's ...
research
∙
01/26/2023
SemSup-XC: Semantic Supervision for Zero and Few-shot Extreme Classification
Extreme classification (XC) involves predicting over large numbers of cl...
research
∙
12/20/2022
Controllable Text Generation with Language Constraints
We consider the task of text generation in language models with constrai...
research
∙
11/29/2022
SPARTAN: Sparse Hierarchical Memory for Parameter-Efficient Transformers
Fine-tuning pre-trained language models (PLMs) achieves impressive perfo...
research
∙
11/15/2022
ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training
Multilingual pre-trained models exhibit zero-shot cross-lingual transfer...
research
∙
10/06/2022
ReAct: Synergizing Reasoning and Acting in Language Models
While large language models (LLMs) have demonstrated impressive capabili...
research
∙
07/04/2022
WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents
Existing benchmarks for grounding language in interactive environments e...
research
∙
06/27/2022
Leveraging Language for Accelerated Learning of Tool Manipulation
Robust and generalized tool manipulation requires an understanding of th...
research
∙
05/23/2022
Using Natural Language and Program Abstractions to Instill Human Inductive Biases in Machines
Strong inductive biases are a key component of human intelligence, allow...
research
∙
04/25/2022
Can Rationalization Improve Robustness?
A growing line of work has investigated the development of neural NLP mo...
research
∙
03/15/2022
CARETS: A Consistency And Robustness Evaluative Test Suite for VQA
We introduce CARETS, a systematic test suite to measure consistency and ...
research
∙
02/26/2022
Semantic Supervision: Enabling Generalization over Output Spaces
In this paper, we propose Semantic Supervision (SemSup) - a unified para...
research
∙
02/18/2022
DataMUX: Data Multiplexing for Neural Networks
In this paper, we introduce data multiplexing (DataMUX), a technique tha...
research
∙
01/10/2022
Multi-query Video Retrieval
Retrieving target videos based on text descriptions is a task of great p...
research
∙
01/04/2022
Multi-Stage Episodic Control for Strategic Exploration in Text Games
Text adventure games present unique challenges to reinforcement learning...
research
∙
10/27/2021
When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer
While recent work on multilingual language models has demonstrated their...
research
∙
10/20/2021
SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmark
Existing work in language grounding typically study single environments....
research
∙
06/28/2021
Revelio: ML-Generated Debugging Queries for Distributed Systems
A major difficulty in debugging distributed systems lies in manually det...
research
∙
05/24/2021
Self-Attention Networks Can Process Bounded Hierarchical Languages
Despite their impressive performance in NLP, self-attention networks wer...
research
∙
03/25/2021
Reading and Acting while Blindfolded: The Need for Semantics in Text Game Agents
Text-based games simulate worlds and interact with players using natural...
research
∙
01/19/2021
Grounding Language to Entities and Dynamics for Generalization in Reinforcement Learning
In this paper, we consider the problem of leveraging textual description...
research
∙
11/27/2020
Connecting Context-specific Adaptation in Humans to Meta-learning
Cognitive control, the ability of a system to adapt to the demands of a ...
research
∙
10/20/2020
Generating Strategic Dialogue for Negotiation with Theory of Mind
We propose a framework to integrate the concept of Theory of Mind (ToM) ...
research
∙
10/11/2020
Safe Reinforcement Learning with Natural Language Constraints
In this paper, we tackle the problem of learning control policies for ta...
research
∙
10/07/2020
Projection-Based Constrained Policy Optimization
We consider the problem of learning control policies that optimize a rew...
research
∙
10/06/2020
Keep CALM and Explore: Language Models for Action Generation in Text-based Games
Text-based games present a unique challenge for autonomous agents to ope...
research
∙
10/06/2020
Guiding Attention for Self-Supervised Learning with Transformers
In this paper, we propose a simple and effective technique to allow for ...
research
∙
09/30/2020
Learning Rewards from Linguistic Feedback
We explore unconstrained natural language feedback as a learning signal ...
research
∙
09/08/2020
Towards Unique and Informative Captioning of Images
Despite considerable progress, state of the art image captioning models ...
research
∙
07/11/2020
Evolving Graphical Planner: Contextual Global Planning for Vision-and-Language Navigation
The ability to perform effective planning is crucial for building an ins...
research
∙
06/20/2020
Accelerating Safe Reinforcement Learning with Constraint-mismatched Policies
We consider the problem of reinforcement learning when provided with a b...
research
∙
05/01/2020
Universal Adversarial Attacks with Natural Triggers for Text Classification
Recent work has demonstrated the vulnerability of modern text classifier...
research
∙
03/31/2020
Take the Scenic Route: Improving Generalization in Vision-and-Language Navigation
In the Vision-and-Language Navigation (VLN) task, an agent with egocentr...
research
∙
08/21/2019
A Generalized Algorithm for Multi-Objective Reinforcement Learning and Policy Adaptation
We introduce a new algorithm for multi-objective reinforcement learning ...
research
∙
06/11/2019
Calibration, Entropy Rates, and Memory in Language Models
Building accurate language models that capture meaningful long-term depe...
research
∙
05/13/2019
Task-Agnostic Dynamics Priors for Deep Reinforcement Learning
While model-based deep reinforcement learning (RL) holds great promise f...
research
∙
08/01/2017
Deep Transfer in Reinforcement Learning by Language Grounding
In this paper, we explore the utilization of natural language to drive t...
research
∙
07/13/2017
Representation Learning for Grounded Spatial Reasoning
The interpretation of spatial references is highly contextual, requiring...
research
∙
02/22/2017