360-Degree Video Sub-Picture Processing for Adaptive Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for processing and transmitting 360-degree video data in VR systems face challenges in providing high-quality images and spatial sound, particularly in efficiently encoding, decoding, and rendering 360-degree video data while maintaining interactivity and adaptability to user viewing orientations.
Innovation Solution
A method and apparatus for processing 360-degree video data using sub-pictures, which involves receiving and decoding 360-degree video data, constructing a composition picture, deriving a projected picture, and transmitting metadata indicating whether the composition picture is identical to the projected picture, enabling efficient encoding, decoding, and rendering, as well as adaptive streaming and interactivity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If 360-degree video data is processed using traditional methods, then the system can provide basic VR functionality, but the image quality and spatial sound quality are insufficient
Solution Approach 1:
The patent divides the 360-degree video data into multiple sub-pictures, allowing independent processing and encoding of each sub-picture. This segmentation enables higher quality rendering while managing processing complexity through distributed handling of video data portions.
Solution Approach 2:
The patent applies different processing and encoding parameters to different sub-pictures based on their specific characteristics and importance. This allows optimization of image quality for critical regions while managing overall processing complexity through localized quality adjustments.
2Manufacturing precision
If high-quality 360-degree video is transmitted, then image quality improves, but transmission bandwidth and processing requirements increase
Solution Approach 1:
By segmenting the video into sub-pictures, the system can selectively transmit and process only the necessary portions at high quality, reducing overall data volume while maintaining perceived video quality in important regions.
Solution Approach 2:
The patent changes encoding parameters for different sub-pictures based on their importance and viewing characteristics, allowing high quality transmission for critical regions while using lower bitrates for less important areas, thus optimizing the quality-to-data-volume ratio.
3Adaptability or versatility
If the system processes complete 360-degree video frames, then comprehensive coverage is achieved, but processing time and computational load increase
Solution Approach 1:
The patent segments video frames into sub-pictures that can be processed independently and in parallel, significantly reducing processing time while maintaining comprehensive 360-degree viewing adaptability through reassembly of the sub-picture portions.
Solution Approach 2:
The system performs preliminary processing and encoding of sub-pictures separately before final assembly, allowing parallel processing operations that reduce overall processing time while maintaining the ability to adapt to different viewing orientations.
4Measurement precision
If metadata is transmitted for every picture composition, then rendering accuracy improves, but transmission overhead increases
Solution Approach 1:
The patent segments metadata transmission to accompany only specific sub-pictures or groups of sub-pictures rather than complete frames, reducing overall metadata volume while maintaining sufficient rendering precision for the transmitted portions.
Data Source
AI summary
The present invention relates to a 360-degree video data processing method performed by a 360-degree video reception apparatus, the method comprising: receiving 360-degree video data, obtaining information on an encoded picture and metadata from the 360-degree video data, decoding at least a part of a picture based on the information on the encoded picture and rendering at least a part of the decoded picture based on the metadata, and the decoded picture is a composition picture and the metadata includes indication information related to whether the composition picture is identical to a projected picture.