research
∙
07/05/2023
What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?
Recent advancements in Large Language Models (LLMs) such as GPT4 have di...
share
research
∙
04/20/2023
eTag: Class-Incremental Learning with Embedding Distillation and Task-Oriented Generation
Class-Incremental Learning (CIL) aims to solve the neural networks' cata...
research
∙
03/28/2023
CryoFormer: Continuous Reconstruction of 3D Structures from Cryo-EM Data using Transformer-based Neural Representations
High-resolution heterogeneous reconstruction of 3D structures of protein...
research
∙
02/10/2023
A Survey on Causal Reinforcement Learning
While Reinforcement Learning (RL) achieves tremendous success in sequent...
research
∙
01/12/2023
Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Tasks
Foundation models or pre-trained models have substantially improved the ...
research
∙
11/22/2022
X^2-VLM: All-In-One Pre-trained Model For Vision-Language Tasks
Vision language pre-training aims to learn alignments between vision and...
research
∙
10/14/2022
EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning
Pre-trained vision-language models (VLMs) have achieved impressive resul...
research
∙
06/01/2022
Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training
In this paper, we introduce Cross-View Language Modeling, a simple and e...
research
∙
05/30/2022
VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models
Recent advances in vision-language pre-training (VLP) have demonstrated ...
research
∙
01/23/2022
ULSA: Unified Language of Synthesis Actions for Representation of Synthesis Protocols
Applying AI power to predict syntheses of novel materials requires high-...
research
∙
11/16/2021
Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts
Most existing methods in vision language pre-training rely on object-cen...
research
∙
03/30/2021
A probabilistic deep learning approach to automate the interpretation of multi-phase diffraction spectra
Autonomous synthesis and characterization of inorganic materials require...
research
∙
10/24/2020
Multi-Domain Dialogue State Tracking – A Purely Transformer-Based Generative Approach
We investigate the problem of multi-domain Dialogue State Tracking (DST)...
research
∙
10/24/2020
Open-Domain Dialogue Generation Based on Pre-trained Language Models
Pre-trained language models have been successfully used in response gene...
research
∙
10/21/2020
Generalized Conditioned Dialogue Generation Based on Pre-trained Language Model
We investigate the general problem of conditioned dialogue, in which a c...
research
∙
10/21/2020
Multi-Domain Dialogue State Tracking based on State Graph
We investigate the problem of multi-domain Dialogue State Tracking (DST)...
research
∙
09/19/2020
Causal Discovery with Multi-Domain LiNGAM for Latent Factors
Discovering causal structures among latent factors from observed data is...
research
∙
12/04/2018