Video Stream Auxiliary Information for Resolution Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Receivers not supporting super-high definition services struggle to obtain image data with suitable resolution when scalable coding is not applied, leading to difficulties in downscaling high-resolution image data.
Innovation Solution
A transmission device inserts auxiliary information into the video stream to downscale spatial and/or temporal resolution, allowing receivers to adjust image data to match their display capabilities, even without scalable coding, by using a container format like MPEG-2 TS or MP4, and includes identifying information to facilitate this process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If scalable coding is not applied to super-high definition image data, then transmission complexity is reduced, but receivers not supporting super-high definition service cannot obtain image data with suitable resolution
Solution Approach 1:
The patent applies preliminary action by inserting auxiliary information about downscaling capabilities into the video stream before transmission. This allows receivers to pre-determine the appropriate resolution based on their display capabilities without requiring complex scalable coding structures, thus reducing transmission complexity while maintaining resolution adaptability.
2Adaptability or versatility
If auxiliary information for downscaling is inserted into the video stream, then resolution adaptability for non-super-high-definition receivers is improved, but data stream complexity increases
Solution Approach 1:
The patent uses auxiliary information as an intermediary element that mediates between the super-high-definition video content and receivers with lower resolution capabilities. This auxiliary information acts as a guide, enabling simple receivers to achieve resolution adaptability without requiring complex scalable coding structures, thus balancing adaptability improvement with minimal data stream complexity increase.
3Adaptability or versatility
If downscaling processing is performed in receivers not supporting super-high definition service, then display compatibility is improved, but processing load on the receiver increases
Solution Approach 1:
The patent reduces receiver processing load by performing preliminary preparation of downscaling information at the transmitter side. The auxiliary information inserted into the video stream provides pre-calculated guidance for downscaling operations, allowing receivers to perform simpler interpolation-based downscaling rather than complex computational downscaling, thus improving display compatibility while minimizing processing load.
Data Source
AI summary
In the case where image data of a super-high definition service is transmitted without scalable coding, image data suitable to own display capability in a receiver not supporting the super-high definition service can be easily obtained.A container in a predetermined format having a video stream including encoded image data is transmitted. Auxiliary information for downscaling a spatial and/or temporal resolution of the image data is inserted into the video stream. For example, the auxiliary information indicates a limit of accuracy for a motion vector included in the encoded image data. Further, for example, the auxiliary information identifies a picture to be selected at the time of downscaling the temporal resolution at a predetermined ratio.