Omnidirectional Video Transmission via 3D Projection and Region Packing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in efficiently transmitting and receiving omnidirectional video content, particularly in providing interactive experiences and ensuring data transmission efficiency, robustness, and network flexibility, especially for mobile receivers and 360-degree video services.
Innovation Solution
The method involves defining, storing, and signaling metadata related to omnidirectional video to allow users to view intended viewpoints or regions, using a 360-degree video transmission and reception system that includes data input, stitching, projection, region-wise packing, encoding, and feedback processing to enhance data transmission and rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If omnidirectional video content is transmitted using conventional methods, then data transmission can be performed, but data transmission efficiency is insufficient and network robustness is inadequate
Solution Approach 1:
The omnidirectional video stream is segmented into multiple sub-streams with different resolutions and qualities. The transmission system divides the content into base layer and enhancement layers, allowing efficient bandwidth utilization while maintaining robustness through selective transmission of critical layers
Solution Approach 2:
The system dynamically changes transmission parameters including resolution, bitrate, and quality levels based on network conditions. Metadata signaling enables adaptive parameter adjustment to optimize both transmission efficiency and reception robustness under varying network environments
2Productivity
If omnidirectional video is transmitted without metadata signaling, then transmission capacity is utilized, but the ability to deliver intended viewpoints and regions is lost
Solution Approach 1:
Metadata acts as an intermediary between the omnidirectional video content and the receiver. This structured data carries viewpoint, region, and rendering information that guides the receiver on how to properly process and display the video content from intended perspectives
Solution Approach 2:
Viewpoint and region information is prepared and signaled in advance through metadata before the actual video rendering. This preliminary action enables the receiver to pre-configure rendering parameters and efficiently process the omnidirectional content according to producer intentions
3Ease of operation
If conventional video transmission methods are used, then basic transmission is achieved, but interactive experience and network flexibility for mobile receivers are insufficient
Solution Approach 1:
The transmission system implements dynamic adaptability where video streams and metadata are adjusted in real-time based on receiver capabilities and network conditions. Mobile receivers can dynamically switch between different stream configurations to maintain interactive experience across varying network environments
Solution Approach 2:
The system provides universal compatibility across different network types and receiver devices. The metadata framework and multi-stream architecture enable the same omnidirectional content to be efficiently delivered to various platforms including mobile devices, desktops, and VR systems with different capabilities
Data Source
Figure 1
Figure 2
Figure 3
AI summary
According to an aspect of the present invention, a method for transmitting omnidirectional video is disclosed. The method of transmitting omnidirectional video according to an embodiment of the present invention includes acquiring an image for the omnidirectional video, projecting the image for the omnidirectional video onto a 3D projection structure, packing the image projected onto the 3D projection structure in a 2D frame, encoding the image packed into the 2D frame, and transmitting a data signal containing the encoded image and metadata about the omnidirectional video.