Dynamic Frame Rate Conversion Mode Selection for Video Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current frame rate conversion (FRC) technologies face challenges in balancing complexity and computational cost, often resulting in motion judder or noticeable lags, especially when dealing with random motions in image content, which can lead to unwanted visual artifacts.
Innovation Solution
A dynamic adjustment mechanism that determines optimal FRC operational modes based on motion characteristics, such as smooth or random motions, by analyzing optical flow and motion vectors, allowing for real-time selection between replication and interpolation to minimize artifacts and optimize viewing experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If complicated motion interpolation systems are designed for FRC, then image quality is improved, but computational cost increases and noticeable lags occur
Solution Approach 1:
The patent applies dynamics by making the FRC operational mode adjustable and changeable in real-time based on motion characteristics. The system dynamically switches between multiple operational modes (first mode with image replication, second mode with image interpolation) depending on the detected motion type, rather than using a fixed complicated interpolation system. This resolves the contradiction by providing high image quality only when needed while maintaining low computational cost for static or simple motion content.
Solution Approach 2:
The patent changes the operational parameter (FRC mode) based on motion characteristics analysis. By analyzing optical flow and motion vectors, the system determines whether to apply strong image replication, weak image replication, or image interpolation, effectively changing the processing parameter to match the content requirements. This resolves the contradiction by applying complex processing only when necessary.
2Manufacturing precision
If complicated motion interpolation systems are designed for FRC, then image quality is improved, but system complexity increases
Solution Approach 1:
The system dynamically selects from multiple operational modes based on motion characteristics, making the complexity adaptive rather than fixed. The FRC mechanism changes its complexity level according to the content requirements, using simple replication for static content and more complex interpolation only when motion is detected. This resolves the contradiction by making system complexity variable rather than constantly high.
Solution Approach 2:
The patent changes the operational parameter (strength of image replication or type of interpolation) based on motion characteristics. The system adjusts the FRC operational mode parameter to match the motion complexity in the content, using simpler operations for simple content and more complex operations only when needed. This resolves the contradiction by making system complexity content-dependent rather than universally high.
3Device complexity
If image replication is used for FRC, then system complexity is reduced, but motion judder occurs
Solution Approach 1:
The patent makes the FRC operational mode dynamic, switching between image replication and image interpolation based on detected motion characteristics. The system uses simple replication for static or simple motion content to maintain low complexity, and transitions to interpolation modes when motion is detected to maintain reliability and smoothness. This resolves the contradiction by making the system adapt its complexity to the content requirements.
Solution Approach 2:
The patent changes the FRC operational mode parameter based on motion characteristics analysis. The system adjusts the replication strength or switches to interpolation when motion is detected, effectively changing the parameter to maintain motion smoothness while keeping the system simple for static content. This resolves the contradiction by making reliability parameter-dependent rather than constantly compromised.
4Reliability
If image interpolation is applied for FRC, then motion smoothness is improved, but computational cost increases
Solution Approach 1:
The patent makes the FRC operational mode dynamic, using image interpolation only when motion characteristics indicate it is needed. The system switches between replication and interpolation modes based on real-time analysis of optical flow and motion vectors, applying computationally expensive interpolation only when it provides value for motion smoothness. This resolves the contradiction by making computational cost variable rather than constantly high.
Solution Approach 2:
The patent changes the FRC operational mode parameter based on motion characteristics, adjusting the level of interpolation or replication strength according to the motion content. The system applies stronger processing (interpolation) only when motion smoothness is required, and uses simpler replication for static or simple motion content. This resolves the contradiction by making computational cost content-dependent rather than universally high.
Data Source
AI summary
Motion characteristics related to the images are determined. A motion characteristics metadata portion is generated based on the motion characteristics, and is to be used for determining an optimal FRC operational mode with a downstream device for the images. The images are encoded into a video stream. The motion characteristics metadata portion is encoded into the video stream as a part of image metadata. The video stream is transmitted to the downstream device. The downstream receives the video stream and operates the optimal FRC operational mode to generate, based on the images, additional images. The images and the additional images are rendered on a display device at an image refresh rate different from an input image refresh rate represented by images encoded in the video stream.