Temporal Video Segmentation Using Optical Flow Estimation

Authors

  • Eman Hato Computer Science Department, College of Science, Al-Mustansiriyah University

DOI:

https://doi.org/10.24996/ijs.2021.62.11.36

Keywords:

Abrupt transition, Candidate transition, Projection, Optical flow, Video Segmentation

Abstract

Shot boundary detection is the process of segmenting a video into basic units known as shots by discovering transition frames between shots. Researches have been conducted to accurately detect the shot boundaries. However, the acceleration of the shot detection process with higher accuracy needs improvement. A new method was introduced in this paper to find out the boundaries of abrupt shots in the video with high accuracy and lower computational cost. The proposed method consists of two stages. First, projection features were used to distinguish non boundary transitions and candidate transitions that may contain abrupt boundary. Only candidate transitions were conserved for next stage. Thus, the speed of shot detection was improved by reducing the detection scope. In the second stage, the candidate segments were refined using motion feature derived from the optical flow to remove non boundary frames. The results manifest that the proposed method achieved excellent detection accuracy (0.98 according to F-Score) and effectively speeded up detection process. In addition, the comparative analysis results confirmed the superior performance of the proposed method versus other methods.

Downloads

Download data is not yet available.

Downloads

Published

2021-11-30

How to Cite

Hato, E. . (2021). Temporal Video Segmentation Using Optical Flow Estimation. Iraqi Journal of Science, 62(11), 4181–4194. https://doi.org/10.24996/ijs.2021.62.11.36

Issue

Section

Computer Science