360 Video Transmission with Depth Map Subtitles
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR systems face inefficiencies in data transmission, network robustness, and subtitle-related features for 360-degree video content, particularly in mobile reception and interactive experiences.
Innovation Solution
A method and device for transmitting and receiving 360-degree video that includes pre-processing, encoding, and transmitting video data, along with decoding and rendering, while enhancing subtitle features and signaling to support interactive VR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If general TTML-based subtitles or bitmap-based subtitles are used for 360 video, then subtitle transmission is simple, but subtitle quality and user experience are insufficient for VR environments
Solution Approach 1:
The patent changes the parameter of subtitle representation from traditional TTML or bitmap formats to depth map-based formats. This allows subtitles to be rendered in three-dimensional space with proper occlusion handling, significantly improving subtitle quality and realism in VR environments while maintaining manageable system complexity through standardized depth map encoding
Solution Approach 2:
The patent introduces depth maps as an intermediary element between the subtitle content and the final rendered output. These depth maps enable the rendering system to understand the spatial position of subtitles relative to 360 video content, allowing for proper occlusion and depth-aware compositing without requiring complex scene understanding algorithms
2Manufacturing precision
If 360 video data is transmitted with high quality, then image quality is improved, but data transmission bandwidth requirements increase
Solution Approach 1:
The patent segments the 360 video content into multiple spherical coordinate system layers or resolutions, allowing the receiver to selectively decode only the necessary portions based on viewport information. This segmentation enables high-quality transmission of full 360 content while efficient delivery of only the relevant portion to the user, reducing overall data transmission requirements
Solution Approach 2:
The patent implements dynamic adaptation of video quality and resolution based on real-time viewport information from the user's head tracking data. The system dynamically adjusts the transmitted video resolution and quality parameters to match the current viewing requirements, ensuring high quality where needed while minimizing data transmission for areas not currently being viewed
Data Source
AI summary
A method for transmitting video, according to embodiments, comprises: a pre-processing step of processing video data; a step of encoding the video data; and/or a step of transmitting a bitstream including the video data. A method for receiving video, according to embodiments, comprises the steps of: receiving video data; decoding the video data; and/or rendering the video data.