Reduced 6DoF Video Rendering via Projection Plane Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The rendering of six degree of freedom (6DoF) video using point cloud data is computationally expensive and requires large storage or transmission capacity, making it difficult to achieve high frame rates and resolutions.
Innovation Solution
The use of Moving Picture Experts Group (MPEG) point cloud coding (PCC) test model is optimized to reduce the complexity of 6DoF rendering, enabling improved performance for higher resolutions and frame rates by compressing and rendering only visible projection planes directly on graphics processing units (GPUs).
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If point cloud data is used to represent 6DoF video, then immersive video quality is improved, but rendering complexity and computational cost increase significantly
Solution Approach 1:
The point cloud data is divided into multiple projection planes, which are processed and rendered separately. This segmentation reduces the complexity of rendering the entire point cloud at once, allowing each plane to be handled independently with lower computational requirements while maintaining overall video quality.
Solution Approach 2:
Only the visible projection planes are extracted and rendered, rather than processing all possible projection planes. This selective extraction reduces the amount of data that needs to be rendered, decreasing computational complexity and rendering time while preserving the essential immersive video quality.
2Productivity
If point cloud data is used for 6DoF video, then video resolution and frame rate can be improved, but data rate and storage capacity requirements increase
Solution Approach 1:
Only the necessary visible projection planes are extracted from the complete point cloud data for rendering. This selective approach reduces the data rate required for transmission and storage, as unnecessary data is excluded, while still enabling high frame rates by reducing the processing burden.
Solution Approach 2:
Instead of processing and transmitting all point cloud data, only the partial subset of visible projection planes is processed. This partial action approach achieves the desired frame rate improvement without the excessive data rate requirements that would result from complete data processing.
3Loss of information
If all projection planes are rendered, then complete scene visibility is achieved, but rendering time and computational resources increase
Solution Approach 1:
Only the visible projection planes are extracted and rendered, eliminating the need to process hidden or non-visible planes. This extraction maintains complete visibility of the observable scene while significantly reducing rendering time by excluding unnecessary computational work.
Solution Approach 2:
The rendering process performs partial action by processing only the visible projection planes rather than all possible planes. This partial processing maintains adequate scene visibility for the viewer's current viewpoint while reducing rendering time and computational resource requirements.
Data Source
AI summary
Embodiments described herein provide for techniques to reduce the complexity of rendering immersive 3D video content. One embodiment provides for an apparatus comprising one or more processors to receive a data set that represents a two-dimensional encoding of planar projections of a frame of a three-dimensional video, decode the two-dimensional encoding into texture data, geometry data, and metadata, determine, based on the metadata, a visibility status and an occupancy status for a sample position in the three-dimensional video, and render video data for the sample position when the sample position is visible and occupied.