Key Frame Identification in Video Sequences

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video summarization techniques are inadequate for efficiently identifying key frames from video sequences, making it difficult for users to browse through large collections of videos effectively.

Innovation Solution

An apparatus and method that calculates scores for frames based on properties like luminance, edge detection, and entropy, and selects key frames within a specified time period or based on user input, while also detecting segment boundaries and grouping similar frames for improved video summarization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If video summarization techniques are used to identify key frames, then browsing efficiency is improved, but the existing techniques are inadequate for efficiently identifying key frames from video sequences

Engineering Contradiction:
Improvebrowsing efficiencyVSAvoidkey frame identification accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The video sequence is divided into segments based on scene changes detected through frame difference analysis. By segmenting the video into meaningful units, the system can identify key frames within each segment independently, improving both browsing efficiency and identification accuracy. The segmentation allows the system to focus computational resources on relevant portions of the video.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary analysis of frame properties (luminance, edge detection, entropy) and calculates scores for potential key frames before final selection. This preliminary scoring and filtering process enables efficient identification of candidate key frames, resolving the contradiction between browsing speed and identification accuracy by pre-processing and ranking frames based on multiple criteria.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple frame properties are analyzed to calculate scores, then key frame identification accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improveframe quality assessment accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Different regions and aspects of frames are evaluated using different quality metrics. Luminance is assessed for brightness distribution, edge detection for structural information, and entropy for information density. By applying local quality assessment with multiple specialized metrics rather than a single global metric, the system achieves high measurement precision while managing computational complexity through targeted analysis.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system transforms frame data into multiple derived parameters (luminance values, edge densities, entropy measures) and combines them into a composite score. By changing parameters and creating derived metrics from raw pixel data, the system achieves comprehensive frame quality assessment. The use of weighted combinations of parameters allows flexible adjustment of computational load while maintaining assessment accuracy.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9064186B2Limited-context-based identifying key frame from video sequence
Publication Date: 2015.06.23 NOKIA TECHNOLOGIES OY
  • US9064186B2 patent drawing
  • US9064186B2 patent drawing
  • US9064186B2 patent drawing

AI summary

An example apparatus is caused to receive a video sequence of a plurality of frames, and perform a number of operations as each of at least some of the frames is received but before all of the frames are received. The apparatus is caused to calculate a score for the frame, and compare the score for the frame to a predefined threshold. The apparatus is caused to cause output of the frame as a key frame in an instance in which the frame is received within a specified period of time and the score for the frame is above the predefined threshold. Otherwise, in an instance in which none of the scores for frames received within the specified period of time is above the predefined threshold, the apparatus is caused to cause output of one of the frames received within the specified period of time as a key frame.