Key Frame Extraction with Attention Based Deep Neural Networks

by   Samed Arslan, et al.

Automatic keyframe detection from videos is an exercise in selecting scenes that can best summarize the content for long videos. Providing a summary of the video is an important task to facilitate quick browsing and content summarization. The resulting photos are used for automated works (e.g. summarizing security footage, detecting different scenes used in music clips) in different industries. In addition, processing high-volume videos in advanced machine learning methods also creates resource costs. Keyframes obtained; It can be used as an input feature to the methods and models to be used. In this study; We propose a deep learning-based approach for keyframe detection using a deep auto-encoder model with an attention layer. The proposed method first extracts the features from the video frames using the encoder part of the autoencoder and applies segmentation using the k-means clustering algorithm to group these features and similar frames together. Then, keyframes are selected from each cluster by selecting the frames closest to the center of the clusters. The method was evaluated on the TVSUM video dataset and achieved a classification accuracy of 0.77, indicating a higher success rate than many existing methods. The proposed method offers a promising solution for key frame extraction in video analysis and can be applied to various applications such as video summarization and video retrieval.


page 1

page 2

page 5


RPCA-KFE: Key Frame Extraction for Consumer Video based Robust Principal Component Analysis

Key frame extraction algorithms consider the problem of selecting a subs...

Aerial Imagery Pile burn detection using Deep Learning: the FLAME dataset

Wildfires are one of the costliest and deadliest natural disasters in th...

A Graph-based Ranking Approach to Extract Key-frames for Static Video Summarization

Video abstraction has become one of the efficient approaches to grasp th...

Video Summarization using Keyframe Extraction and Video Skimming

Video is one of the robust sources of information and the consumption of...

Unsupervised Object-Level Video Summarization with Online Motion Auto-Encoder

Unsupervised video summarization plays an important role on digesting, b...

Where is this? Video geolocation based on neural network features

In this work we propose a method that geolocates videos within a delimit...

Efficient Video Summarization Framework using EEG and Eye-tracking Signals

This paper proposes an efficient video summarization framework that will...

Please sign up or login with your details

Forgot password? Click here to reset