Interpolation Reference Frame Selection for Duplicate Video Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing technologies face issues with selecting accurate interpolation reference frames, leading to picture shaking and blurring due to frame loss or duplication, especially when dealing with non-ideal frame ordering in complex video environments.
Innovation Solution
A method for dynamically adjusting the current frame interpolation step size and phase by comparing pixel brightness differences and historical frame information to adaptively select the reference frame, ensuring smooth and natural video display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If reference frames are selected based on ordering rules of frames under a specific movie mode, then the frame rate conversion process is simple and efficient, but duplicate frames may be selected as reference frames causing picture shaking or blurring
Solution Approach 1:
The patent replaces the mechanical frame-based selection method with a pixel brightness difference-based detection method. Instead of relying on frame ordering rules, the system calculates brightness differences between adjacent frames to identify duplicate frames, substituting a computational approach for a structural one.
Solution Approach 2:
The patent changes the selection criterion from frame position/ordering to pixel brightness difference values. By using brightness difference as the selection parameter, the system can dynamically identify whether frames are duplicates regardless of their position in the sequence, resolving the contradiction between simple selection and accurate selection.
2Device complexity
If duplicate frames are selected as reference frames, then the frame rate conversion process is simplified, but calculation errors on motion vectors occur reducing video display quality
Solution Approach 1:
The patent substitutes the mechanical ordering rule-based selection with a computational brightness difference detection system. This replacement enables accurate identification of duplicate frames through pixel-level comparison, preventing motion vector calculation errors while maintaining systematic operation.
Solution Approach 2:
The system performs self-detection of duplicate frames by automatically calculating brightness differences and identifying duplicates without external intervention. This self-service mechanism ensures accurate reference frame selection while maintaining operational simplicity.
3Adaptability or versatility
If frame loss or frame increment occurs in video, then the video stream becomes non-ideal, but fixed ordering rules cannot adapt to these changes
Solution Approach 1:
The patent implements a dynamic frame selection mechanism that adapts to changing video conditions. Instead of fixed ordering rules, the system continuously calculates brightness differences and adjusts reference frame selection based on real-time detection of duplicate frames, enabling adaptation to frame loss or increment scenarios.
Solution Approach 2:
The patent changes the selection parameter from static frame position to dynamic brightness difference values. This parameter change enables the system to adapt to non-ideal video streams with frame loss or increment, as brightness differences naturally reflect the actual content changes regardless of frame positioning issues.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
The disclosure may provide a method for selecting a reference frame, an electronic device, and a storage medium. The method for frame interpolation processing on frame rate conversion FRC, includes: obtaining frames in a video; calculating a sum of absolute values of pixel brightness differences of corresponding pixel locations in a current frame and a previous frame; determining frame attribute of the current frame based on the sum of absolute values of pixel brightness differences, the frame attribute including a raw frame and a duplicate frame; counting a number of raw frames in M historical frames previous to the current frame; obtaining a current frame interpolation step size based on the number of raw frames in the M historical frames; obtaining a next frame phase to be interpolated based on a current frame interpolation phase and the current frame interpolation step size; and determining an interpolation reference frame based on the next frame to be interpolated. The method may avoid selecting duplicate frames as reference frames due to frame loss (or drop) or frame increment, reduce occurrences of picture shaking or blurring, and improve the quality of video display.