research
∙
08/25/2023
Joint Modeling of Feature, Correspondence, and a Compressed Memory for Video Object Segmentation
Current prevailing Video Object Segmentation (VOS) methods usually perfo...
share
research
∙
08/21/2023
MGMAE: Motion Guided Masking for Video Masked Autoencoding
Masked autoencoding has shown excellent performance on self-supervised v...
research
∙
08/18/2023
Deep Equilibrium Object Detection
Query-based object detectors directly decode image features into object ...
research
∙
08/18/2023
SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos
Camera-based 3D object detection in BEV (Bird's Eye View) space has draw...
research
∙
08/17/2023
On Data Imbalance in Molecular Property Prediction with Pre-training
Revealing and analyzing the various properties of materials is an essent...
research
∙
08/16/2023
Is Self-Supervised Pretraining Good for Extrapolation in Molecular Property Prediction?
The prediction of material properties plays a crucial role in the develo...
research
∙
08/15/2023
Memory-and-Anticipation Transformer for Online Action Understanding
Most existing forecasting systems are memory-based methods, which attemp...
research
∙
07/28/2023
MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Tracking
As a video task, Multiple Object Tracking (MOT) is expected to capture t...
research
∙
07/13/2023
InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation
This paper introduces InternVid, a large-scale video-centric multimodal ...
research
∙
06/09/2023
Pave the Way to Grasp Anything: Transferring Foundation Models for Universal Pick-Place Robots
Improving the generalization capabilities of general-purpose robotic age...
research
∙
05/30/2023
AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation
We propose a novel framework for learning high-level cognitive capabilit...
research
∙
05/25/2023
MixFormerV2: Efficient Fully Transformer Tracking
Transformer-based trackers have achieved strong accuracy on the standard...
research
∙
05/22/2023
VideoLLM: Modeling Video Sequence with Large Language Models
With the exponential growth of video data, there is an urgent need for a...
research
∙
05/10/2023
VideoChat: Chat-Centric Video Understanding
In this study, we initiate an exploration into video understanding by in...
research
∙
05/09/2023
InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language
We present an interactive visual framework named InternGPT, or iGPT for ...
research
∙
05/04/2023
Understanding the Benefits of Hardware-Accelerated Communication in Model-Serving Applications
It is commonly assumed that the end-to-end networking performance of edg...
research
∙
04/29/2023
An Evidential Real-Time Multi-Mode Fault Diagnosis Approach Based on Broad Learning System
Fault diagnosis is a crucial area of research in the industry due to div...
research
∙
04/17/2023
Efficient Video Action Detection with Token Dropout and Context Refinement
Streaming video clips with large-scale video tokens impede vision transf...
research
∙
04/11/2023
SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenes
Multi-object tracking in sports scenes plays a critical role in gatherin...
research
∙
04/11/2023
StageInteractor: Query-based Object Detector with Cross-stage Interaction
Previous object detectors make predictions based on dense grid points or...
research
∙
04/07/2023
SparseFormer: Sparse Visual Recognition via Limited Latent Tokens
Human visual recognition is a sparse process, where only a few salient v...
research
∙
03/29/2023
VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking
Scale is the primary factor for building a powerful foundation model tha...
research
∙
03/28/2023
CycleACR: Cycle Modeling of Actor-Context Relations for Video Action Detection
The relation modeling between actors and scene context advances video ac...
research
∙
03/28/2023
LinK: Linear Kernel for LiDAR-based 3D Perception
Extending the success of 2D Large Kernel to 3D perception is challenging...
research
∙
03/28/2023
Unmasked Teacher: Towards Training-Efficient Video Foundation Models
Video Foundation Models (VFMs) have received limited exploration due to ...
research
∙
03/28/2023
STMixer: A One-Stage Sparse Action Detector
Traditional video action detectors typically adopt the two-stage pipelin...
research
∙
03/26/2023
PDPP:Projected Diffusion for Procedure Planning in Instructional Videos
In this paper, we study the problem of procedure planning in instruction...
research
∙
03/21/2023
Learning Optical Flow and Scene Flow with Bidirectional Camera-LiDAR Fusion
In this paper, we study the problem of jointly estimating the optical fl...
research
∙
03/01/2023
Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolation
Effectively extracting inter-frame motion and appearance information is ...
research
∙
02/13/2023
CoMAE: Single Model Hybrid Pre-training on Small-Scale RGB-D Datasets
Current RGB-D scene recognition approaches often train two standalone ba...
research
∙
12/06/2022
InternVideo: General Video Foundation Models via Generative and Discriminative Learning
The foundation models have recently shown excellent performance on a var...
research
∙
12/03/2022
VLG: General Video Recognition with Web Textual Knowledge
Video recognition in an open and dynamic world is quite challenging, as ...
research
∙
11/17/2022
UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormer
Learning discriminative spatiotemporal representation is the key problem...
research
∙
11/17/2022
InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challenges
In this report, we present our champion solutions to five tracks at Ego4...
research
∙
11/16/2022
Exploring State Change Capture of Heterogeneous Backbones @ Ego4D Hands and Objects Challenge 2022
Capturing the state changes of interacting objects is a key technology f...
research
∙
10/20/2022
PointTAD: Multi-Label Temporal Action Detection with Learnable Query Points
Traditional temporal action detection (TAD) usually handles untrimmed vi...
research
∙
09/28/2022
Dynamic MDETR: A Dynamic Multimodal Transformer Decoder for Visual Grounding
Multimodal transformer exhibits high capacity and flexibility to align i...
research
∙
06/30/2022
Submission to Generic Event Boundary Detection Challenge@CVPR 2022: Local Context Modeling and Global Boundary Decoding Approach
Generic event boundary detection (GEBD) is an important yet challenging ...
research
∙
05/26/2022
Cross-Architecture Self-supervised Video Representation Learning
In this paper, we present a new cross-architecture contrastive learning ...
research
∙
05/05/2022
BasicTAD: an Astounding RGB-Only Baseline for Temporal Action Detection
Temporal action detection (TAD) is extensively studied in the video unde...
research
∙
05/02/2022
APP-Net: Auxiliary-point-based Push and Pull Operations for Efficient Point Cloud Classification
Point-cloud-based 3D classification task involves aggregating features f...
research
∙
04/25/2022
Joint-Modal Label Denoising for Weakly-Supervised Audio-Visual Video Parsing
This paper focuses on the weakly-supervised audio-visual video parsing t...
research
∙
03/31/2022
Logit Normalization for Long-tail Object Detection
Real-world data exhibiting skewed distributions pose a serious challenge...
research
∙
03/30/2022
AdaMixer: A Fast-Converging Query-Based Object Detector
Traditional object detectors employ the dense paradigm of scanning over ...
research
∙
03/29/2022
Task-specific Inconsistency Alignment for Domain Adaptive Object Detection
Detectors trained with massive labeled data often exhibit dramatic perfo...
research
∙
03/23/2022
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
Pre-training video transformers on extra large-scale datasets is general...
research
∙
03/21/2022
MixFormer: End-to-End Tracking with Iterative Mixed Attention
Tracking often uses a multi-stage pipeline of feature extraction, target...
research
∙
03/03/2022
Recovering 3D Human Mesh from Monocular Images: A Survey
Estimating human pose and shape from monocular images is a long-standing...
research
∙
03/01/2022
Temporal Perceiver: A General Architecture for Arbitrary Boundary Detection
Generic Boundary Detection (GBD) aims at locating general boundaries tha...
research
∙
01/12/2022