Volumetric Video Encoder Using UV Coordinate Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current volumetric video compression methods, such as MPEG Video-Based Point Cloud Coding (V-PCC), face inefficiencies in compressing dynamic 3D scenes due to poor temporal compression performance and limited 6 Degrees of Freedom (6DOF) capabilities, especially when reducing the number of vertices leads to loss of texture details.
Innovation Solution
The method involves projecting 3D volumetric data onto 2D patches, generating geometry and texture images, and mapping vertices to 2D coordinates, which are signaled in a bitstream, allowing for adjustable resolution and improved compression efficiency while preserving texture details.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If the number of vertices is reduced to improve compression efficiency, then compression ratio is improved, but texture details are lost
Solution Approach 1:
The patent introduces UV coordinates (a second dimension of mapping) to decouple the relationship between vertex count and texture quality. By mapping vertices to 2D texture space using UV coordinates rather than direct 1:1 correspondence, the system can use fewer vertices while maintaining texture detail through the additional dimensional mapping information.
Solution Approach 2:
UV coordinates serve as an intermediary between the geometry mesh and texture mapping. This intermediate layer allows the system to separate geometry simplification from texture preservation, enabling compression without proportional loss of texture details.
2Manufacturing precision
If the number of vertices is increased to preserve texture details, then texture quality is improved, but compression efficiency deteriorates
Solution Approach 1:
By adding UV coordinate mapping as an additional dimensional layer, the system achieves better texture preservation with fewer vertices. The UV coordinates provide the extra information needed to maintain texture quality without requiring a proportional increase in vertex count.
Solution Approach 2:
The patent changes the parameter representation by introducing UV coordinates as an additional attribute per vertex. This parameter expansion allows each vertex to carry more information, enabling fewer vertices to represent the same level of texture detail that would otherwise require many more vertices.
3Loss of energy
If 3D surfaces are projected onto 2D planes for compression, then compression efficiency is improved, but 6DOF capabilities are limited
Solution Approach 1:
UV coordinates act as an intermediary that preserves 6DOF capability after 2D projection. The UV mapping maintains the relationship between 3D surface positions and 2D texture coordinates, enabling six-degree-of-freedom viewing capabilities to be preserved even when the geometry is compressed to 2D planes.
Solution Approach 2:
The introduction of UV coordinate space as an additional dimensional layer allows the system to maintain 6DOF capabilities despite projecting 3D surfaces onto 2D planes. The UV coordinates encode the necessary information to reconstruct and view the scene from multiple angles.
Data Source
AI summary
A method comprising: providing a 3D representation of at least one object as an input for an encoder (500); projecting the 3D representation onto at least one 2D patch (502); generating at least a geometry image and a texture image from the 2D patch (504); generating, based on the geometry image, a mesh comprising a number of vertices (506); mapping the number of vertices to two-dimensional (2D) coordinates of the texture image (508), and signalling said 2D coordinates of the texture image to be applied to the number of vertices of the mesh in or along a bitstream (510).