Interpolation Reference Frame Selection for Duplicate Video Frames

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video processing technologies face issues with selecting accurate interpolation reference frames, leading to picture shaking and blurring due to frame loss or duplication, especially when dealing with non-ideal frame ordering in complex video environments.

Innovation Solution

A method for dynamically adjusting the current frame interpolation step size and phase by comparing pixel brightness differences and historical frame information to adaptively select the reference frame, ensuring smooth and natural video display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If reference frames are selected based on ordering rules of frames under a specific movie mode, then the frame rate conversion process is simple and efficient, but duplicate frames may be selected as reference frames causing picture shaking or blurring

Engineering Contradiction:
Improveframe rate conversion efficiencyVSAvoidreference frame selection accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent replaces the mechanical frame-based selection method with a pixel brightness difference-based detection method. Instead of relying on frame ordering rules, the system calculates brightness differences between adjacent frames to identify duplicate frames, substituting a computational approach for a structural one.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the selection criterion from frame position/ordering to pixel brightness difference values. By using brightness difference as the selection parameter, the system can dynamically identify whether frames are duplicates regardless of their position in the sequence, resolving the contradiction between simple selection and accurate selection.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If duplicate frames are selected as reference frames, then the frame rate conversion process is simplified, but calculation errors on motion vectors occur reducing video display quality

Engineering Contradiction:
Improvereference frame selection complexityVSAvoidmotion vector calculation accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent substitutes the mechanical ordering rule-based selection with a computational brightness difference detection system. This replacement enables accurate identification of duplicate frames through pixel-level comparison, preventing motion vector calculation errors while maintaining systematic operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-detection of duplicate frames by automatically calculating brightness differences and identifying duplicates without external intervention. This self-service mechanism ensures accurate reference frame selection while maintaining operational simplicity.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If frame loss or frame increment occurs in video, then the video stream becomes non-ideal, but fixed ordering rules cannot adapt to these changes

Engineering Contradiction:
Improveframe selection adaptabilityVSAvoidframe detection and selection mechanism
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a dynamic frame selection mechanism that adapts to changing video conditions. Instead of fixed ordering rules, the system continuously calculates brightness differences and adjusts reference frame selection based on real-time detection of duplicate frames, enabling adaptation to frame loss or increment scenarios.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the selection parameter from static frame position to dynamic brightness difference values. This parameter change enables the system to adapt to non-ideal video streams with frame loss or increment, as brightness differences naturally reflect the actual content changes regardless of frame positioning issues.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3941036B1Method, electronic device, and storage medium for selecting reference frame
Publication Date: 2025.12.31 AMLOGIC (SHANGHAI) CO LTD
  • EP3941036B1 patent drawingFigure 1
  • EP3941036B1 patent drawingFigure 2
  • EP3941036B1 patent drawingFigure 3~4

AI summary

The disclosure may provide a method for selecting a reference frame, an electronic device, and a storage medium. The method for frame interpolation processing on frame rate conversion FRC, includes: obtaining frames in a video; calculating a sum of absolute values of pixel brightness differences of corresponding pixel locations in a current frame and a previous frame; determining frame attribute of the current frame based on the sum of absolute values of pixel brightness differences, the frame attribute including a raw frame and a duplicate frame; counting a number of raw frames in M historical frames previous to the current frame; obtaining a current frame interpolation step size based on the number of raw frames in the M historical frames; obtaining a next frame phase to be interpolated based on a current frame interpolation phase and the current frame interpolation step size; and determining an interpolation reference frame based on the next frame to be interpolated. The method may avoid selecting duplicate frames as reference frames due to frame loss (or drop) or frame increment, reduce occurrences of picture shaking or blurring, and improve the quality of video display.