High-Frame-Rate Reception with Inverse Mixing for Backward Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems face issues with discontinuity in motion when transmitting high frame rate image data, leading to unnatural motion in receivers not adapted for high frame rates, due to sub-sampling and lack of backward compatibility.
Innovation Solution
A reception device and method that processes high frame rate image data by mixing and encoding in linear or non-linear spaces, with inverse mixing processes to ensure compatibility, using a reception unit to decode and combine image data from base and enhanced layers, and a transmission device to insert processing space information for accurate frame rate restoration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If sub-sampling is performed in receivers not adapted for high frame rate, then backward compatibility is maintained, but motion continuity is lost and unnatural motion is displayed
Solution Approach 1:
The mixing process is performed in advance during encoding, combining multiple high frame rate pictures into a single base layer picture before transmission. This preliminary action ensures that when conventional receivers decode only the base layer, they receive pre-processed images that maintain motion continuity without requiring post-processing or inverse mixing capabilities.
2Reliability
If mixing process is performed on base layer in encoder, then motion discontinuity is reduced, but receivers without inverse mixing function display mixed images for every frame
Solution Approach 1:
The patent introduces processing space information (linear space or non-linear space) as a parameter that guides the inverse mixing process. By embedding this parameter in the encoded stream, the system enables receivers with inverse mixing capability to correctly restore high frame rate images by changing their processing parameters, while conventional receivers simply display the mixed base layer images without being affected by this additional information.
3Measurement precision
If inverse mixing process is performed in incorrect space, then processing accuracy is compromised, but performing in correct space requires accurate space identification
Solution Approach 1:
The processing space information acts as feedback from the encoder to the decoder, providing explicit guidance about the mixing space used. This feedback mechanism eliminates the difficulty of detecting and measuring the correct processing space by directly communicating it through the encoded stream, ensuring that inverse mixing is always performed in the correct space when the capability exists.
Data Source
Figure 1~2(b)
Figure 3
Figure 4(a)~4(c)
AI summary
High frame rate image data having backward compatibility is favorably transmitted. Image data of each picture of a base layer included in a base stream sent from a transmission side has been subjected to a mixing process in a linear space or a non-linear space. On a reception side, the inverse mixing process can be performed appropriately by performing in a corresponding space on the basis of processing space information indicating whether or not the mixing process is performed in the linear space or the non-linear space.