360-Degree Video Pre-Processor for Low-Latency VR Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR systems face inefficiencies in data transmission, particularly for 360-degree video content, and lack robustness and flexibility in network transmission, especially for mobile devices, as well as inadequate subtitle features and signaling for VR services.
Innovation Solution
A video transmission method and device that includes a pre-processor for selecting and analyzing video data, an encoder for encoding, and a transmitter for transmitting, with features like view selection, region-wise packing, and metadata processing to optimize 3 DoF+ video transmission and reception, ensuring low latency and robustness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 360-degree video data is transmitted to provide VR environment, then users can experience immersive VR content, but data transmission efficiency deteriorates due to large data volume
Solution Approach 1:
The patent segments 360-degree video data into multiple views corresponding to different directional ranges. The pre-processor divides the spherical video content into discrete view segments, allowing selective transmission of only the views needed for the current viewport, thereby reducing overall data transmission requirements while maintaining immersive VR experience
Solution Approach 2:
The patent applies different quality levels to different view segments based on their importance to the current viewport. Views that are more likely to be displayed or needed for potential viewport changes are transmitted with higher quality, while less critical views use lower quality encoding, optimizing the balance between VR experience and transmission efficiency
2Productivity
If view-select and pack processes are applied to optimize transmission, then data transmission efficiency is improved, but device complexity increases
Solution Approach 1:
The pre-processor performs view-selection and packing operations in advance, before encoding and transmission. By pre-organizing video data into view-specific segments and determining which views to transmit based on predicted viewport needs, the system reduces real-time processing requirements at the receiver and simplifies the overall transmission pipeline
Solution Approach 2:
The pre-processor acts as an intermediary component between the video source and the encoder. It performs view-selection and packing as intermediate processing steps, transforming raw 360-degree video into a format optimized for efficient transmission, thereby separating complex processing from the transmission and decoding stages
3Ease of operation
If general TTML-based subtitles are used for VR content, then subtitle functionality is provided, but subtitle suitability deteriorates for 360 video
Solution Approach 1:
The patent extends TTML subtitle parameters and attributes to accommodate 360-degree video characteristics. By modifying subtitle parameters to include spatial positioning information compatible with spherical geometry and viewport-dependent rendering, subtitles can be dynamically positioned and rendered appropriately for different viewing directions in VR environments
Data Source
AI summary
A video transmitting device according to embodiments of the present invention can comprise a pre-processor for processing video data, an encoder for encoding the pre-processed video data and a transmitting unit for transmitting the encoded video data. Additionally, the video transmitting device further comprises a projector for generating a picture and a projection parameter related to the picture by projecting the video data, and the pre-processor can view-select video data for a specific view from among the video data. Furthermore, the pre-processor of the video transmitting device can pack the video data into specific video data by view-analyzing the video data.