Viewport Adaptive Volumetric Content Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high volume and complexity of three-dimensional volumetric content, such as point clouds and immersive video, result in significant storage and transmission challenges, limiting real-time applications and requiring substantial bandwidth and storage resources.
Innovation Solution
A system that segments three-dimensional point clouds into sub-point clouds based on defined viewing areas, allowing for the streaming and rendering of only the portions relevant to the current viewport, reducing data transmission and latency by encoding and decoding these sub-point clouds using video-based and geometry-based compression techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the full three-dimensional point cloud is transmitted, then complete volumetric content is provided, but data transmission volume and bandwidth consumption increase significantly
Solution Approach 1:
The patent divides the complete three-dimensional point cloud into multiple two-dimensional projection views (front, back, left, right, top, bottom). Each projection view contains only the points visible from that particular angle, eliminating the need to transmit occluded points. This segmentation approach maintains complete volumetric content when all views are combined while significantly reducing the data volume of each individual transmission stream.
2Manufacturing precision
If high-resolution three-dimensional volumetric content is transmitted, then rendering quality is improved, but transmission bandwidth and storage requirements increase
Solution Approach 1:
The patent transmits only the necessary subset of points required for each specific viewing angle rather than the complete point cloud. For any given viewport, only points that are visible and relevant to that particular view are transmitted, avoiding the transmission of occluded or irrelevant points. This partial action approach maintains high rendering quality for the current view while reducing overall bandwidth consumption.
3Adaptability or versatility
If the entire point cloud is processed and transmitted, then all viewing angles are supported, but processing time and latency increase
Solution Approach 1:
The patent pre-computes and organizes point cloud data into multiple projection views during the encoding phase. Each projection view is prepared in advance with its specific set of visible points. When a client requests a particular viewing angle, the corresponding pre-processed projection data can be transmitted immediately without requiring real-time filtering or processing, thereby reducing latency while maintaining support for multiple viewing angles.
Data Source
AI summary
A system comprises an encoder configured to compress and encode data for three-dimensional volumetric content. The encoder also is configured to segment the three-dimensional volumetric content based on viewing areas, wherein different ones of the viewing areas correspond to visible portions of the volumetric content. The system may provide metadata to a client device to support viewport adaptive rendering of the three-dimensional volumetric content or may adaptively stream portions of the three-dimensional volumetric content to a rending device based on viewing areas of the three-dimensional volumetric content that are to be rendered at the rendering device.