Immersive Video Rendering Using Patch Only Cells
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3DoF+ video content requires large amounts of data and faces challenges with seamless transitions between cells due to inaccurate user position prediction, especially during fast movements, leading to inefficient data usage and potential user experience issues.
Innovation Solution
The introduction of Patch Only (PO) cells, which are lighter and extend conventional 3DoF+ cells, allowing for seamless transitions by generating parallax information from differently positioned virtual cameras, reducing the need for multiple cells and optimizing data usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional 3DoF+ video content is used to provide 6DoF experience, then immersion and parallax are improved, but data quantity and storage requirements increase significantly
Solution Approach 1:
The video content is segmented into two distinct types: full 3DoF+ cells that provide complete parallax information for central viewpoints, and Patch Only (PO) cells that contain only peripheral patch information for extending the viewing area. This segmentation allows the system to use minimal data (PO cells) when full 6DoF experience is not required, while still providing 6DoF capability when needed.
Solution Approach 2:
Different regions of the immersive video content are provided with different qualities of parallax information. Central viewpoints receive full 3DoF+ treatment with complete parallax data, while peripheral regions use simplified PO cells with only essential patch information. This local quality differentiation optimizes data usage by providing high-quality 6DoF experience only where necessary.
2Measurement precision
If multiple full 3DoF+ cells are used to enable seamless transitions, then user position prediction accuracy is improved, but data usage efficiency deteriorates
Solution Approach 1:
Instead of providing complete 3DoF+ cell data for all possible user positions and movements, the system uses partial action by implementing Patch Only cells that contain only the essential peripheral patches needed for seamless transitions. This partial approach provides sufficient information for maintaining immersion during transitions without the excessive data overhead of full 3DoF+ cells for every possible viewpoint.
3Loss of information
If full 3DoF+ cells are used throughout, then parallax information completeness is improved, but device complexity and processing requirements increase
Solution Approach 1:
The system changes the parameter of information completeness by using different cell types with different levels of parallax information. Full 3DoF+ cells provide complete parallax data when needed, while Patch Only cells provide minimal parallax information for peripheral areas. This parameter change allows the system to maintain immersion quality while reducing processing complexity and device requirements.
Data Source
AI summary
Immersive 3D video content includes a plurality of preferably overlapping cells, each cell representative of a volume in the content, wherein a cell providing both content corresponding to a virtual central camera in the cell and parallax information from virtual peripheral cameras around the centre position can be next to a cell providing only parallax information to be used with the content corresponding to the virtual central camera. A device for rendering immersive video, renders a viewpoint corresponding to a user's current position, tracks and predicts the user position, and if the user position moves to a cell with central camera content, retrieves the content and parallax information, and if the user position moves to a cell with only parallax information, retrieves the parallax information and, if necessary, also the cell with the content. This arrangement can reduce bandwidth and storage for the immersive 3D video content.