research
∙
09/08/2023
Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models
Vision-language models (VLMs) have recently demonstrated strong efficacy...
share
research
∙
06/04/2023
Predicting Information Pathways Across Online Communities
The problem of community-level information pathway prediction (CLIPP) ai...
research
∙
04/07/2023
Probing Conceptual Understanding of Large Visual-Language Models
We present a novel framework for probing and improving relational, compo...
research
∙
09/29/2022
Unpacking Large Language Models with Conceptual Consistency
If a Large Language Model (LLM) answers "yes" to the question "Are mount...
research
∙
08/09/2022
Model-Free Generative Replay for Lifelong Reinforcement Learning: Application to Starcraft-2
One approach to meet the challenges of deep lifelong reinforcement learn...
research
∙
07/15/2022
Towards Understanding Confusion and Affective States Under Communication Failures in Voice-Based Human-Machine Interaction
We present a series of two studies conducted to understand user's affect...
research
∙
04/08/2022
Broadening AI Ethics Narratives: An Indic Art View
Incorporating interdisciplinary perspectives is seen as an essential ste...
research
∙
02/11/2022
Detecting out-of-context objects using contextual cues
This paper presents an approach to detect out-of-context (OOC) objects i...
research
∙
10/22/2021
Challenges in Procedural Multimodal Machine Comprehension:A Novel Way To Benchmark
We focus on Multimodal Machine Reading Comprehension (M3C) where a model...
research
∙
06/08/2021
Comprehension Based Question Answering using Bloom's Taxonomy
Current pre-trained language models have lots of knowledge, but a more l...
research
∙
04/20/2021
Towards Solving Multimodal Comprehension
This paper targets the problem of procedural multimodal machine comprehe...
research
∙
12/03/2020
Detecting Trojaned DNNs Using Counterfactual Attributions
We target the problem of detecting Trojans or backdoors in DNNs. Such mo...
research
∙
11/21/2020
Zero-Shot Learning with Knowledge Enhanced Visual Semantic Embeddings
We improve zero-shot learning (ZSL) by incorporating common-sense knowle...
research
∙
11/19/2020
Hybrid Consistency Training with Prototype Adaptation for Few-Shot Learning
Few-Shot Learning (FSL) aims to improve a model's generalization capabil...
research
∙
07/14/2020
Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective Transfer
We introduce the eigentask framework for lifelong learning. An eigentask...
research
∙
03/16/2020
Deep Adaptive Semantic Logic (DASL): Compiling Declarative Knowledge into Deep Neural Networks
We introduce Deep Adaptive Semantic Logic (DASL), a novel framework for ...
research
∙
03/08/2020
Progressive Growing of Neural ODEs
Neural Ordinary Differential Equations (NODEs) have proven to be a power...
research
∙
09/10/2019
Sunny and Dark Outside?! Improving Answer Consistency in VQA through Entailed Question Generation
While models for Visual Question Answering (VQA) have steadily improved ...
research
∙
07/14/2019
FoodX-251: A Dataset for Fine-grained Food Classification
Food classification is a challenging problem due to the large number of ...
research
∙
05/17/2019
Deep Unified Multimodal Embeddings for Understanding both Content and Users in Social Media Networks
There has been an explosion of multimodal content generated on social me...
research
∙
05/08/2019
Data-Efficient Mutual Information Neural Estimator
Measuring Mutual Information (MI) between high-dimensional, continuous, ...
research
∙
04/19/2019
Integrating Text and Image: Determining Multimodal Document Intent in Instagram Posts
Computing author intent from multimodal data like Instagram posts requir...
research
∙
04/05/2019
Lucid Explanations Help: Using a Human-AI Image-Guessing Game to Evaluate Machine Explanation Helpfulness
While there have been many proposals on how to make AI algorithms more t...
research
∙
03/27/2019
Align2Ground: Weakly Supervised Phrase Grounding Guided by Image-Caption Alignment
We address the problem of grounding free-form textual phrases by using w...
research
∙
11/26/2018
Stacked Spatio-Temporal Graph Convolutional Networks for Action Segmentation
We propose novel Stacked Spatio-Temporal Graph Convolutional Networks (S...
research
∙
07/04/2018
Understanding Visual Ads by Aligning Symbols and Objects using Co-Attention
We tackle the problem of understanding visual ads where given an ad imag...
research
∙
04/12/2018
Zero-Shot Object Detection
We introduce and tackle the problem of zero-shot object detection (ZSD),...
research
∙
12/23/2017