360 Video Viewpoint Switching via Metadata Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for processing and transmitting 360-degree video data face challenges in efficiently handling multiple viewpoints, leading to inefficiencies in rendering and switching between viewpoints, particularly in providing high-quality interactive experiences over next-generation hybrid broadcasting networks.
Innovation Solution
A method and apparatus for processing 360 video data by acquiring and decoding image information and metadata from multiple viewpoints, rendering images in 3D space, and generating metadata for efficient viewpoint switching, using a 360 video reception apparatus with a reception processor, data decoder, and renderer, and a 360 video transmission apparatus with a data input unit, projection processor, and metadata processor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 360 video data with multiple viewpoints is transmitted and rendered, then the interactive experience quality is improved, but the transmission capacity requirements and processing complexity increase
Solution Approach 1:
The patent divides the 360 video content into multiple independent viewpoint segments, each with its own encoded image data. Instead of transmitting and rendering all viewpoints simultaneously, the system segments the content by viewpoint and transmits only the currently needed viewpoint data, reducing overall processing complexity while maintaining interactive quality.
Solution Approach 2:
The patent performs preliminary encoding and organization of multiple viewpoint data during the content preparation phase. Metadata about all possible viewpoints is prepared in advance, allowing the reception apparatus to quickly select and decode only the necessary viewpoint data during playback, reducing real-time processing complexity.
2Adaptability or versatility
If multiple viewpoint images are decoded and rendered in real-time, then the interactive experience is improved, but the transmission bandwidth and processing power requirements increase
Solution Approach 1:
The patent extracts and transmits only the essential viewpoint information needed for current display, rather than transmitting complete data for all possible viewpoints. The reception apparatus extracts the specific viewpoint data corresponding to the current viewing direction, reducing transmission bandwidth requirements while maintaining viewpoint switching capability.
Solution Approach 2:
The patent implements dynamic viewpoint selection where the transmitted and decoded viewpoint data changes based on the user's current viewing direction. The system dynamically adjusts which viewpoint images are decoded and rendered in real-time, optimizing bandwidth usage by only transmitting necessary viewpoint data rather than all viewpoints continuously.
3Measurement precision
If complete metadata for all viewpoints is transmitted, then the viewpoint switching accuracy is improved, but the data transmission volume increases
Solution Approach 1:
The patent applies local quality by transmitting detailed metadata only for the currently active viewpoint, while using compressed or simplified metadata representations for other potential viewpoints. This approach maintains high viewpoint switching accuracy for the current view while reducing overall metadata transmission volume through selective detail provision.
Data Source
AI summary
A method for 360 video data processing based on multiple viewpoints performed by a 360 video receiving apparatus according to the present invention comprises the steps of: acquiring, from received video signals, image information for pictures of multiple viewpoints-based 360 videos and metadata for the multiple viewpoints-based 360 videos, wherein the metadata includes multiple viewpoint information; decoding an image of a first viewport of a first viewpoint on the basis of the metadata and the image information; rendering the image of the first viewport into a 3D space; decoding an image of a second viewport of a second viewpoint on the basis of the metadata and the image information; deriving, in a case in which the hotspot in the first viewport is selected, the second viewport in the second viewpoint connected through a hotspot on the basis of the multiple viewpoint information; and rendering the image of the second viewport into the 3D space.