360 Video Overlay Rendering via Alpha Plane Metadata Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 360-degree video systems face challenges in efficiently processing and transmitting metadata for overlay processing in VR and AR environments, leading to suboptimal user experiences due to limitations in rendering and interaction capabilities.
Innovation Solution
A method and apparatus for processing 360-degree video data that includes receiving and decoding image data, generating and encoding metadata with overlay-related information, and rendering overlays based on alpha plane data, which is integrated into the image or video track, enabling efficient transmission and storage of 360-degree video content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If overlay-related metadata is included in image item or video track, then rendering efficiency is improved, but data structure complexity increases
Solution Approach 1:
The patent combines overlay-related metadata directly into the image item or video track structures, merging previously separate metadata handling into the main data flow. This integration eliminates the need for separate metadata processing pathways, thereby improving rendering efficiency while managing complexity through standardized container formats.
Solution Approach 2:
The image item and video track structures are designed to serve multiple functions: they carry both the primary video data and the overlay-related metadata simultaneously. This multi-functionality allows the same data structure to handle both rendering information and overlay information, improving efficiency without requiring additional specialized structures.
2Manufacturing precision
If alpha plane information is integrated into image item or video track, then overlay rendering quality is improved, but processing complexity increases
Solution Approach 1:
The overlay data is segmented into specific parameters including alpha plane information, which is then integrated into the image item or video track. This segmentation allows the rendering system to process only the necessary overlay parameters rather than handling complete overlay images, improving rendering quality through precise alpha channel control while managing processing complexity through parameter-level operations.
3Reliability
If 360-degree video data is processed with overlay metadata, then user experience quality is improved, but transmission bandwidth requirements increase
Solution Approach 1:
The patent extracts only the essential overlay-related parameters and metadata needed for rendering, rather than transmitting complete overlay images or excessive metadata. By taking out only the necessary information (such as alpha plane data and overlay parameters), the system improves user experience quality through accurate overlay rendering while reducing transmission bandwidth requirements by eliminating redundant data.
Data Source
AI summary
Provided is a 360-degree image data processing method performed by a 360-degree video reception apparatus. The method includes receiving 360-degree image data, obtaining information on an encoded picture and metadata from the 360-degree image data, decoding a picture based on the information on the encoded picture, rendering the decoded picture and an overlay based on the metadata, in which the metadata includes overlay related metadata, the overlay is rendered based on the overlay related metadata, the overlay related metadata includes information on an alpha plane of the overlay, and the information on the alpha plane of the overlay is included in a image item or a video track.