b'Yu Qiao'

research

∙ 09/20/2023

StructChart: Perception, Structuring, Reasoning for Visual Chart Understanding

Charts are common in literature across different scientific fields, conv...

0 Renqiu Xia, et al. ∙

research

∙ 09/19/2023

SPOT: Scalable 3D Pre-training via Occupancy Prediction for Autonomous Driving

Annotating 3D LiDAR point clouds for perception tasks including 3D objec...

0 Xiangchao Yan, et al. ∙

research

∙ 09/11/2023

UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebase

Point-, voxel-, and range-views are three representative forms of point ...

0 Youquan Liu, et al. ∙

research

∙ 09/11/2023

ReSimAD: Zero-Shot 3D Domain Transfer for Autonomous Driving with Source Reconstruction and Target Simulation

Domain shifts such as sensor type changes and geographical situation var...

0 Bo Zhang, et al. ∙

research

∙ 09/08/2023

Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation

Modern displays are capable of rendering video content with high dynamic...

0 Xiangyu Chen, et al. ∙

research

∙ 09/07/2023

A-Eval: A Benchmark for Cross-Dataset Evaluation of Abdominal Multi-Organ Segmentation

Although deep learning have revolutionized abdominal multi-organ segment...

0 Ziyan Huang, et al. ∙

research

∙ 09/07/2023

ImageBind-LLM: Multi-modality Instruction Tuning

We present ImageBind-LLM, a multi-modality instruction tuning method of ...

0 Jiaming Han, et al. ∙

research

∙ 08/30/2023

SAM-Med2D

The Segment Anything Model (SAM) represents a state-of-the-art research ...

0 Junlong Cheng, et al. ∙

research

∙ 08/29/2023

DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior

We present DiffBIR, which leverages pretrained text-to-image diffusion m...

0 Xinqi Lin, et al. ∙

research

∙ 08/25/2023

OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models

Large language models (LLMs) have revolutionized natural language proces...

0 Wenqi Shao, et al. ∙

research

∙ 08/21/2023

MGMAE: Motion Guided Masking for Video Masked Autoencoding

Masked autoencoding has shown excellent performance on self-supervised v...

0 Bingkun Huang, et al. ∙

research

∙ 08/13/2023

Shrinking Class Space for Enhanced Certainty in Semi-Supervised Learning

Semi-supervised learning is attracting blooming attention, due to its su...

0 Lihe Yang, et al. ∙

research

∙ 08/11/2023

Foundation Model is Efficient Multimodal Multitask Model Selector

This paper investigates an under-explored but important problem: given a...

0 Fanqing Meng, et al. ∙

research

∙ 08/07/2023

Tiny LVLM-eHub: Early Multimodal Experiments with Bard

Recent advancements in Large Vision-Language Models (LVLMs) have demonst...

0 Wenqi Shao, et al. ∙

research

∙ 08/03/2023

The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World

We present the All-Seeing (AS) project: a large-scale data and model for...

0 Weiyun Wang, et al. ∙

research

∙ 07/27/2023

Scaling TransNormer to 175 Billion Parameters

We present TransNormerLLM, the first linear attention-based Large Langua...

0 Zhen Qin, et al. ∙

research

∙ 07/27/2023

Text-guided Foundation Model Adaptation for Pathological Image Classification

The recent surge of foundation models in computer vision and natural lan...

0 Yunkun Zhang, et al. ∙

research

∙ 07/25/2023

FedMEKT: Distillation-based Embedding Knowledge Transfer for Multimodal Federated Learning

Federated learning (FL) enables a decentralized machine learning paradig...

0 Huy Q. Le, et al. ∙

research

∙ 07/20/2023

Meta-Transformer: A Unified Framework for Multimodal Learning

Multimodal learning aims to build models that can process and relate inf...

0 Yiyuan Zhang, et al. ∙

research

∙ 07/20/2023

Boosting Federated Learning Convergence with Prototype Regularization

As a distributed machine learning technique, federated learning (FL) req...

0 Yu Qiao, et al. ∙

research

∙ 07/14/2023

Drive Like a Human: Rethinking Autonomous Driving with Large Language Models

In this paper, we explore the potential of using a large language model ...

0 Daocheng Fu, et al. ∙

research

∙ 07/13/2023

InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation

This paper introduces InternVid, a large-scale video-centric multimodal ...

0 Yi Wang, et al. ∙

research

∙ 07/13/2023

LimSim: A Long-term Interactive Multi-scenario Traffic Simulator

With the growing popularity of digital twin and autonomous driving in tr...

0 Licheng Wen, et al. ∙

research

∙ 07/10/2023

AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning

With the advance of text-to-image models (e.g., Stable Diffusion) and co...

0 Yuwei Guo, et al. ∙

research

∙ 07/03/2023

JourneyDB: A Benchmark for Generative Image Understanding

While recent advancements in vision-language models have revolutionized ...

0 Junting Pan, et al. ∙

research

∙ 06/25/2023

Faster Segment Anything: Towards Lightweight SAM for Mobile Applications

Segment anything model (SAM) is a prompt-guided vision foundation model ...

0 Chaoning Zhang, et al. ∙

research

∙ 06/20/2023

Align, Adapt and Inject: Sound-guided Unified Image Generation

Text-guided image generation has witnessed unprecedented progress due to...

0 Yue Yang, et al. ∙

research

∙ 06/15/2023

Retrieving-to-Answer: Zero-Shot Video Question Answering with Frozen Large Language Models

Video Question Answering (VideoQA) has been significantly advanced from ...

0 Junting Pan, et al. ∙

research

∙ 06/15/2023

LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models

Large Vision-Language Models (LVLMs) have recently played a dominant rol...

0 Peng Xu, et al. ∙

research

∙ 06/13/2023

Robustness of SAM: Segment Anything Under Corruptions and Beyond

Segment anything model (SAM), as the name suggests, is claimed to be cap...

0 Yu Qiao, et al. ∙

research

∙ 06/09/2023

DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Clouds

Existing offboard 3D detectors always follow a modular pipeline design t...

0 Tao Ma, et al. ∙

research

∙ 06/02/2023

Denoising Diffusion Semantic Segmentation with Mask Prior Modeling

The evolution of semantic segmentation has long been dominated by learni...

0 Zeqiang Lai, et al. ∙

research

∙ 06/01/2023

AD-PT: Autonomous Driving Pre-Training with Large-scale Point Cloud Dataset

It is a long-term vision for Autonomous Driving (AD) community that the ...

0 Jiakang Yuan, et al. ∙

research

∙ 06/01/2023

DiffRoom: Diffusion-based High-Quality 3D Room Reconstruction and Generation

We present DiffRoom, a novel framework for tackling the problem of high-...

0 Xiaoliang Ju, et al. ∙

research

∙ 05/29/2023

DiffRate : Differentiable Compression Rate for Efficient Vision Transformers

Token compression aims to speed up large-scale vision transformers (e.g....

0 Mengzhao Chen, et al. ∙

research

∙ 05/25/2023

Ghost in the Minecraft: Generally Capable Agents for Open-World Enviroments via Large Language Models with Text-based Knowledge and Memory

The captivating realm of Minecraft has attracted substantial research in...

0 Xizhou Zhu, et al. ∙

research

∙ 05/25/2023

Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation

Recently, video object segmentation (VOS) referred by multi-modal signal...

0 Shilin Yan, et al. ∙

research

∙ 05/24/2023

Networks are Slacking Off: Understanding Generalization Problem in Image Deraining

Deep deraining networks, while successful in laboratory benchmarks, cons...

0 Jinjin Gu, et al. ∙

research

∙ 05/22/2023

VideoLLM: Modeling Video Sequence with Large Language Models

With the exponential growth of video data, there is an urgent need for a...

0 Guo Chen, et al. ∙

research

∙ 05/18/2023

Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model

Foundation models have made significant strides in various applications,...

3 Siyuan Huang, et al. ∙

research

∙ 05/18/2023

VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Tasks

Large language models (LLMs) have notably accelerated progress towards a...

0 Wenhai Wang, et al. ∙

research

∙ 05/10/2023

VideoChat: Chat-Centric Video Understanding

In this study, we initiate an exploration into video understanding by in...

0 Kunchang Li, et al. ∙

research

∙ 05/09/2023

InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language

We present an interactive visual framework named InternGPT, or iGPT for ...

0 Zhaoyang Liu, et al. ∙

research

∙ 05/09/2023

Causal Discovery with Unobserved Variables: A Proxy Variable Approach

Discovering causal relations from observational data is important. The e...

0 Mingzhou Liu, et al. ∙

research

∙ 05/06/2023

LEO: Generative Latent Image Animator for Human Video Synthesis

Spatio-temporal coherency is a major challenge in synthesizing high qual...

5 Yaohui Wang, et al. ∙

research

∙ 05/02/2023

Long-Term Rhythmic Video Soundtracker

We consider the problem of generating musical soundtracks in sync with r...

7 Jiashuo Yu, et al. ∙

research

∙ 04/29/2023

Segment Anything Model (SAM) Meets Glass: Mirror and Transparent Objects Cannot Be Easily Detected

Meta AI Research has recently released SAM (Segment Anything Model) whic...

0 Dongsheng Han, et al. ∙

research

∙ 04/28/2023

LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model

How to efficiently transform large language models (LLMs) into instructi...

1 Peng Gao, et al. ∙

research

∙ 04/24/2023

Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation

Diffusion models have attained impressive visual quality for image synth...

0 zeyu-lu, et al. ∙

research

∙ 04/19/2023

Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehicles

We propose a perception imitation method to simulate results of a certai...

0 Xiaoliang Ju, et al. ∙

Yu Qiao

Featured Co-authors