360-Degree Video Bitstream Packing for VR Viewpoint Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality (VR) systems face challenges in providing efficient data transmission, network robustness, and flexible interaction, particularly for 360-degree video content, and existing subtitle features are not adapted for VR services, limiting the user experience.
Innovation Solution
A method and apparatus for transmitting and receiving 360-degree video that includes a decoder, unpacker, view regenerator, and view synthesizer to process bitstreams based on viewing position and viewport information, with inter-view redundancy removal and advanced signaling information to enhance viewing experience and bit efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If general TTML based subtitles or bitmap based subtitles are used, then subtitle functionality is provided, but they are not adapted for 360-degree video and cannot provide subtitles suitable for VR service
Solution Approach 1:
The patent extends subtitle-related features and signaling information by changing the parameters of existing TTML-based subtitle systems to accommodate 360-degree video characteristics, including viewpoint-dependent subtitle positioning and orientation parameters
Solution Approach 2:
The patent creates a universal subtitle system that can function for both traditional 2D video and 360-degree VR video by extending the existing TTML framework with additional VR-specific parameters, allowing one system to serve multiple purposes
2Adaptability or versatility
If multiple pictures for multiple viewing positions are transmitted, then interactive VR experience with head motion parallax is provided, but data transmission amount increases
Solution Approach 1:
The patent merges multiple pictures for different viewing positions into a single packed picture structure, where multiple views are combined into one bitstream that can be efficiently transmitted without requiring separate transmission channels for each viewpoint
Solution Approach 2:
The patent segments the packed picture into multiple view components that can be independently decoded and synthesized, allowing the receiver to extract only the necessary viewpoint information based on user head position, reducing actual processing load despite receiving comprehensive data
3Productivity
If pictures are packed to reduce transmission data, then bit efficiency is improved, but unpacking and view regeneration complexity increases
Solution Approach 1:
The packing process performs preliminary organization of multiple view pictures into a structured format with embedded metadata and synthesis parameters, so that during unpacking the receiver can efficiently extract and regenerate views without performing complex computational operations
Data Source
AI summary
An apparatus for receiving a video according to embodiments of the present invention comprises a decoder configured to decode bitstream based on viewing position and viewport information; an unpacker configured to unpack pictures in the decoded bitstream; a view regenerator configured to perform view regenerating the unpacked pictures; and a view synthesizer configured to perform view synthesis on the view regenerated pictures. A method of transmitting a video, the method comprising inter-view redundancy removing pictures for multiple viewing positions; packing the inter-view redundancy removed pictures; and encoding the packed pictures and signaling information.