Motion Compensated Picture Rate Up-Conversion Using Compressed Stream Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Legacy video compression systems struggle to optimally display low picture-rate videos on modern display screens due to bandwidth limitations, resulting in the need for picture-rate conversion, which often leads to artifacts like motion judder and inability to accurately depict motion.
Innovation Solution
A system and method for motion-compensated picture rate up-conversion (PRUC) using information extracted from a compressed video stream, which generates interpolated pictures based on local block motion vectors, block coding modes, quantization levels, and quantized residual data, reducing noise and artifacts through motion-compensated interpolation and filtering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If picture rate is reduced to lower bandwidth requirements, then transmission bandwidth is reduced, but motion depiction accuracy deteriorates and motion judder artifacts appear
Solution Approach 1:
The system performs preliminary extraction of motion vectors and residual data from the compressed video stream before decomposition, storing this information for later use in generating interpolated frames. This preliminary action enables accurate motion compensation during picture rate conversion without requiring additional transmission bandwidth.
Solution Approach 2:
The invention introduces an intermediary processing stage that extracts motion information from the compressed stream and uses it to generate intermediate frames during picture rate conversion. This intermediary process acts as a bridge between the low-bitrate compressed stream and the high-picture-rate display requirement, reducing motion judder artifacts.
2Manufacturing precision
If additional motion vector and residual data are transmitted to improve PRUC quality, then motion depiction accuracy improves, but transmission bandwidth increases
Solution Approach 1:
The system performs self-service by extracting and utilizing motion vectors and residual data that are already present in the compressed video stream. Instead of requiring additional transmitted data, the system leverages the existing compressed stream's inherent motion information to perform high-quality picture rate up-conversion locally at the decoding device.
Solution Approach 2:
The invention changes the processing parameters by extracting motion information at a different stage in the decoding process. Rather than waiting for full decomposition, the system extracts motion vectors and residual data from the compressed stream itself, changing the temporal and computational parameters of when and how this information becomes available.
3Adaptability or versatility
If traditional picture rate conversion is used to display low picture-rate video on high picture-rate screens, then display compatibility is improved, but motion judder and artifacts increase
Solution Approach 1:
The invention replaces traditional mechanical interpolation methods with motion-compensated field-based interpolation. Instead of simple temporal averaging or duplicate frame insertion, the system uses extracted motion vectors to calculate precise pixel positions in intermediate frames, substituting sophisticated field processing for simple mechanical repetition.
Solution Approach 2:
The system segments the picture rate conversion process into distinct stages: extraction of motion information from compressed stream, decomposition of the video stream, generation of interpolated frames using motion compensation, and recombination. This segmentation allows each stage to be optimized independently, reducing artifacts while maintaining compatibility.
Data Source
AI summary
Certain aspects of a method and system for motion-compensated picture rate up-conversion (PRUC) using information extracted from a compressed video stream may include extracting PRUC data from a compressed video data stream while the compressed video data stream is being decompressed by a video decompression engine. The PRUC data may comprise, for example, local block motion vectors, block coding modes, quantization levels, quantized residual data and decoded pictures. A plurality of interpolated pictures may be generated based on extracting the PRUC data.