research
∙
09/11/2023
Robot Parkour Learning
Parkour is a grand challenge for legged locomotion that requires robots ...
share
research
∙
08/24/2023
StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Construction
High-Definition (HD) maps are essential for the safety of autonomous dri...
research
∙
08/16/2023
Radio2Text: Streaming Speech Recognition Using mmWave Radio Signals
Millimeter wave (mmWave) based speech recognition provides more possibil...
research
∙
07/26/2023
Learning-based Control for PMSM Using Distributed Gaussian Processes with Optimal Aggregation Strategy
The growing demand for accurate control in varying and unknown environme...
research
∙
06/29/2023
Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
The Video-to-Audio (V2A) model has recently gained attention for its pra...
research
∙
06/20/2023
BEVScope: Enhancing Self-Supervised Depth Estimation Leveraging Bird's-Eye-View in Dynamic Scenarios
Depth estimation is a cornerstone of perception in autonomous driving an...
research
∙
06/06/2023
ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory
Large language models (LLMs) with memory are computationally universal. ...
research
∙
05/15/2023
GeoMAE: Masked Geometric Target Prediction for Self-supervised Point Cloud Pre-Training
This paper tries to address a fundamental question in point cloud self-s...
research
∙
05/02/2023
On Uni-Modal Feature Learning in Supervised Multi-Modal Learning
We abstract the features (i.e. learned representations) of multi-modal d...
research
∙
04/27/2023
Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving
Robotic perception requires the modeling of both 3D geometry and semanti...
research
∙
04/26/2023
What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging
Inferring past human motion from RGB images is challenging due to the in...
research
∙
04/17/2023
Neural Map Prior for Autonomous Driving
High-definition (HD) semantic maps are crucial for autonomous vehicles n...
research
∙
03/30/2023
SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer
High-resolution images enable neural networks to learn richer visual rep...
research
∙
12/07/2022
AsyInst: Asymmetric Affinity with DepthGrad and Color for Box-Supervised Instance Segmentation
The weakly supervised instance segmentation is a challenging task. The e...
research
∙
12/05/2022
Learning Physically Realizable Skills for Online Packing of General 3D Shapes
We study the problem of learning online packing skills for irregular 3D ...
research
∙
11/21/2022
PVT++: A Simple End-to-End Latency-Aware Visual Tracking Framework
Visual object tracking is an essential capability of intelligent robots....
research
∙
11/03/2022
P4P: Conflict-Aware Motion Prediction for Planning in Autonomous Driving
Motion prediction is crucial in enabling safe motion planning for autono...
research
∙
10/26/2022
InterSim: Interactive Traffic Simulation via Explicit Relation Modeling
Interactive traffic simulation is crucial to autonomous driving systems ...
research
∙
08/09/2022
VectorFlow: Combining Images and Vectors for Traffic Occupancy and Flow Prediction
Predicting future behaviors of road agents is a key task in autonomous d...
research
∙
08/02/2022
ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queries
Existing autonomous driving pipelines separate the perception module fro...
research
∙
07/13/2022
Controllable and Lossless Non-Autoregressive End-to-End Text-to-Speech
Some recent studies have demonstrated the feasibility of single-stage ne...
research
∙
07/03/2022
Beyond Visual Field of View: Perceiving 3D Environment with Echoes and Vision
This paper focuses on perceiving and navigating 3D environments using ec...
research
∙
06/22/2022
Radio2Speech: High Quality Speech Recovery from Radio Frequency Signals
Considering the microphone is easily affected by noise and soundproof ma...
research
∙
06/18/2022
Augmented Imagefication: A Data-driven Fault Detection Method for Aircraft Air Data Sensors
In this paper, a novel data-driven approach named Augmented Imageficatio...
research
∙
06/17/2022
VectorMapNet: End-to-end Vectorized HD Map Learning
Autonomous driving systems require a good understanding of surrounding e...
research
∙
06/13/2022
The Modality Focusing Hypothesis: On the Blink of Multimodal Knowledge Distillation
Multimodal knowledge distillation (KD) extends traditional knowledge dis...
research
∙
06/10/2022
R4D: Utilizing Reference Objects for Long-Range Distance Estimation
Estimating the distance of objects is a safety-critical task for autonom...
research
∙
06/08/2022
Depth Estimation Matters Most: Improving Per-Object Depth Estimation for Monocular 3D Detection and Tracking
Monocular image-based 3D perception has become an active research area i...
research
∙
05/10/2022
Learning Visual Styles from Audio-Visual Associations
From the patter of rain to the crunch of snow, the sounds we hear often ...
research
∙
05/06/2022
Sound2Synth: Interpreting Sound via FM Synthesizer Parameters Estimation
Synthesizer is a type of electronic musical instrument that is now widel...
research
∙
05/02/2022
MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queries
Accurate and consistent 3D tracking from multiple cameras is a key compo...
research
∙
03/24/2022
Egocentric Prediction of Action Target in 3D
We are interested in anticipating as early as possible the target locati...
research
∙
03/22/2022
Self-supervision through Random Segments with Autoregressive Coding (RandSAC)
Inspired by the success of self-supervised autoregressive representation...
research
∙
03/20/2022
FUTR3D: A Unified Sensor Fusion Framework for 3D Detection
Sensor fusion is an essential topic in many perception systems, such as ...
research
∙
02/24/2022
M2I: From Factored Marginal Trajectory Prediction to Interactive Prediction
Predicting future motions of road participants is an important task for ...
research
∙
02/21/2022
S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification
In this paper, we propose S3T, a self-supervised pre-training method wit...
research
∙
01/17/2022
AutoAlign: Pixel-Instance Feature Aggregation for Multi-Modal 3D Object Detection
Object detection through either RGB images or the LiDAR point clouds has...
research
∙
12/13/2021
Embracing Single Stride 3D Object Detector with Sparse Transformer
In LiDAR-based 3D object detection for autonomous driving, the ratio of ...
research
∙
12/10/2021
IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenes
Building embodied intelligent agents that can interact with 3D indoor en...
research
∙
12/09/2021
SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-Training for Spatial-Aware Visual Representations
Pre-training has become a standard paradigm in many computer vision task...
research
∙
10/15/2021
Neural Dubber: Dubbing for Videos According to Scripts
Dubbing is a post-production process of re-recording actors' dialogues, ...
research
∙
10/13/2021
DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries
We introduce a framework for multi-camera 3D object detection. In contra...
research
∙
08/31/2021
Learning Practically Feasible Policies for Online 3D Bin Packing
We tackle the Online 3D Bin Packing Problem, a challenging yet practical...
research
∙
08/22/2021
DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets
Due to the stochasticity of human behaviors, predicting the future traje...
research
∙
07/13/2021
HDMapNet: An Online HD Map Construction and Evaluation Framework
High-definition map (HD map) construction is a crucial problem for auton...
research
∙
06/28/2021
HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps
High Definition (HD) maps are maps with precise definitions of road lane...
research
∙
06/27/2021
DenseTNT: Waymo Open Dataset Motion Prediction Challenge 1st Place Solution
In autonomous driving, goal-based multi-trajectory prediction methods ar...
research
∙
06/23/2021
Co-advise: Cross Inductive Bias Distillation
Transformers recently are adapted from the community of natural language...
research
∙
06/21/2021
Improving Multi-Modal Learning with Uni-Modal Teachers
Learning multi-modal representations is an essential step towards real-w...
research
∙
06/08/2021