Comprehensive Video Understanding: Video summarization with content-based video recommender design

by   Yudong Jiang, et al.

Video summarization aims to extract keyframes/shots from a long video. Previous methods mainly take diversity and representativeness of generated summaries as prior knowledge in algorithm design. In this paper, we formulate video summarization as a content-based recommender problem, which should distill the most useful content from a long video for users who suffer from information overload. A scalable deep neural network is proposed on predicting if one video segment is a useful segment for users by explicitly modelling both segment and video. Moreover, we accomplish scene and action recognition in untrimmed videos in order to find more correlations among different aspects of video understanding tasks. Also, our paper will discuss the effect of audio and visual features in summarization task. We also extend our work by data augmentation and multi-task learning for preventing the model from early-stage overfitting. The final results of our model win the first place in ICCV 2019 CoView Workshop Challenge Track.


page 4

page 5


Video Summarization using Deep Semantic Features

This paper presents a video summarization technique for an Internet vide...

Role of Audio in Audio-Visual Video Summarization

Video summarization attracts attention for efficient video representatio...

Audiovisual Highlight Detection in Videos

In this paper, we test the hypothesis that interesting events in unstruc...

Show and Recall: Learning What Makes Videos Memorable

With the explosion of video content on the Internet, there is a need for...

Audio Summarization with Audio Features and Probability Distribution Divergence

The automatic summarization of multimedia sources is an important task t...

Generation of Multimedia Artifacts: An Extractive Summarization-based Approach

We explore methods for content selection and address the issue of cohere...

Please sign up or login with your details

Forgot password? Click here to reset