Point Cloud Texture Interpolation for Lower Bitrate Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image-based point cloud compression techniques face inefficiencies when projecting point clouds with complex surfaces or non-surface distributions, leading to low compression efficiency and quality issues due to the need for multiple projections and texture interpolation challenges.
Innovation Solution
Interpolate the texture image T1 from T0 using color video bitstream metadata, indicating when and how to apply texture interpolation on unrecolored points in the reconstructed point cloud, reducing the need to transmit T1 and minimizing bitrate and processing complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple texture images are transmitted for complex surface point clouds, then texture quality is improved, but bitrate consumption increases
Solution Approach 1:
The patent extracts only the necessary texture information by transmitting a single reference texture image T0 and using metadata to indicate which points require colorization. Instead of transmitting multiple complete texture images, the system extracts and transmits only the essential reference texture along with minimal metadata, thereby reducing bitrate while maintaining texture quality for complex surfaces.
Solution Approach 2:
The patent creates virtual copies of texture information through metadata indicators that point to regions in the reference texture image T0. Rather than transmitting duplicate texture data for each view or surface, the system uses metadata to reference and reuse the same texture image multiple times, effectively copying texture information without transmitting redundant data.
2Measurement precision
If multiple texture images are transmitted, then texture coverage is improved, but device complexity increases
Solution Approach 1:
The patent enables the decoder to self-serve by providing it with metadata that contains all necessary information to autonomously determine which points need colorization and how to retrieve their texture information from the reference image T0. The system does not require complex external processing or multiple transmitted texture images, as the metadata-driven approach allows the decoder to independently handle texture assignment for all points.
Solution Approach 2:
The single reference texture image T0 serves multiple functions simultaneously: it provides texture information for all unrecolored points, acts as a reference for metadata interpretation, and enables texture mapping across different viewing angles and surface complexities. This universal texture image replaces the need for multiple specialized texture images, reducing device complexity while maintaining comprehensive texture coverage.
3Productivity
If texture interpolation is applied, then compression efficiency is improved, but manufacturing precision deteriorates
Solution Approach 1:
The patent performs preliminary action by transmitting the complete reference texture image T0 before any decoding or colorization operations. This reference texture is prepared in advance and stored, allowing the decoder to accurately retrieve exact texture values for any point during colorization without needing to perform interpolation, thereby maintaining high texture accuracy while achieving compression through selective transmission.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
At least one of the embodiment provides a method and device for generating and encoding in a bitstream an interpolation texture coding mode indicating that the bitstream contains color information data representative of a texture image and that texture interpolation has to be done on point of a reconstructed point cloud that are not colorized from said color information data.