Point Cloud Sub-Space Transmission for 360 Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality technologies face challenges in efficiently transmitting and rendering three-dimensional (3D) content, particularly in providing high-resolution views while minimizing data transmission, to prevent holes in the 3D content and background images.
Innovation Solution
A method and apparatus for transmitting and receiving data related to omnidirectional images and point cloud objects, which involves generating and transmitting media data and metadata that specify sub-spaces of a bounding space, allowing for partial transmission and improved compression efficiency, and rendering content based on received metadata.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If partial transmission of point cloud data is performed to increase compression efficiency, then data transmission volume is reduced, but holes may occur in the 3D content and background image
Solution Approach 1:
The point cloud data is divided into multiple sub-spaces based on the bounding space metadata. The server performs partial transmission by sending only the point cloud data corresponding to the user's current viewing space sub-region, rather than transmitting the entire point cloud dataset. This segmentation allows efficient compression while maintaining visual completeness in the visible area.
Solution Approach 2:
The system transmits point cloud data with higher quality and resolution specifically for the user's current viewing space sub-region, while reducing or omitting data for other areas. This local quality enhancement ensures that the visible portion of the 3D content is rendered without holes or artifacts, while minimizing overall data transmission volume.
2Manufacturing precision
If high-resolution point cloud data is transmitted for the user's viewing space, then rendering quality is improved, but data transmission volume increases
Solution Approach 1:
The system transmits point cloud data at high resolution only for the specific sub-region corresponding to the user's current viewing space, rather than transmitting high-resolution data for the entire 3D scene. This partial action approach maintains high rendering quality in the visible area while significantly reducing overall data transmission volume compared to transmitting complete high-resolution data.
3Reliability
If complete point cloud data is transmitted to prevent holes in 3D content, then content completeness is ensured, but compression efficiency decreases
Solution Approach 1:
The server performs preliminary processing by generating metadata that describes the bounding space and divides it into multiple sub-spaces before transmission. This preliminary organization allows the client to identify and request only the point cloud data needed for the current viewing space, enabling efficient compression and transmission without compromising the completeness of the visible content.
Data Source
AI summary
A method and an apparatus for transmitting and receiving video content including 3D data are provided. According to an embodiment, a method for transmitting data related to content including an omnidirectional image and a point cloud object is provided. The method includes generating media data and metadata for the content including the omnidirectional image and the point cloud object; and transmitting the generated media data and the generated metadata, wherein the metadata comprises information for specifying sub-spaces of a bounding space related to the point cloud object.