SumGraph: Video Summarization via Recursive Graph Modeling

by   Jungin Park, et al.

The goal of video summarization is to select keyframes that are visually diverse and can represent a whole story of an input video. State-of-the-art approaches for video summarization have mostly regarded the task as a frame-wise keyframe selection problem by aggregating all frames with equal weight. However, to find informative parts of the video, it is necessary to consider how all the frames of the video are related to each other. To this end, we cast video summarization as a graph modeling problem. We propose recursive graph modeling networks for video summarization, termed SumGraph, to represent a relation graph, where frames are regarded as nodes and nodes are connected by semantic relationships among frames. Our networks accomplish this through a recursive approach to refine an initially estimated graph to correctly classify each node as a keyframe by reasoning the graph representation via graph convolutional networks. To leverage SumGraph in a more practical environment, we also present a way to adapt our graph modeling in an unsupervised fashion. With SumGraph, we achieved state-of-the-art performance on several benchmarks for video summarization in both supervised and unsupervised manners.


page 2

page 7

page 11

page 14


FrameRank: A Text Processing Approach to Video Summarization

Video summarization has been extensively studied in the past decades. Ho...

Video Summarization Using Fully Convolutional Sequence Networks

This paper addresses the problem of video summarization. Given an input ...

A Graph-based Ranking Approach to Extract Key-frames for Static Video Summarization

Video abstraction has become one of the efficient approaches to grasp th...

Cycle-SUM: Cycle-consistent Adversarial LSTM Networks for Unsupervised Video Summarization

In this paper, we present a novel unsupervised video summarization model...

Exploring global diverse attention via pairwise temporal relation for video summarization

Video summarization is an effective way to facilitate video searching an...

Reconstructive Sequence-Graph Network for Video Summarization

Exploiting the inner-shot and inter-shot dependencies is essential for k...

Belief Propagation for Maximum Coverage on Weighted Bipartite Graph and Application to Text Summarization

We study text summarization from the viewpoint of maximum coverage probl...

Please sign up or login with your details

Forgot password? Click here to reset