3D Point Cloud Texture Coding via SEI Message View-Dependent Parameters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D point cloud coding systems lack a mechanism to convey view-dependent texture attributes and update camera positions, leading to inaccurate texture representation when viewing states change, especially in scenarios where texture attributes vary with capturing directions or viewpoints.
Innovation Solution
A supplemental enhancement information (SEI) message is created to transmit parameters related to texture attributes for multiple viewing states, allowing decoders to correctly classify and represent texture attributes for each point in the 3D point cloud, including camera position and rotation information to account for changes over time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If view-dependent texture attributes and camera position updates are added to point cloud coding, then texture representation accuracy is improved, but data transmission complexity increases
Solution Approach 1:
The patent segments the texture attribute information into separate components: base texture attributes and view-dependent enhancement information. The SEI message structure divides data into attribute classification parameters, camera position/rotation information, and texture attribute values, allowing selective transmission of only the necessary view-dependent components rather than transmitting all possible attribute combinations.
Solution Approach 2:
The patent adds a new dimensional layer to the existing point cloud data structure by introducing view-dependent enhancement information as an additional dimension. This SEI message layer sits alongside the base point cloud data, providing extra viewing state information without fundamentally restructuring the core point cloud format, thus managing complexity through dimensional expansion rather than structural redesign.
2Measurement precision
If multiple viewing state parameters are transmitted for each point, then texture accuracy for different viewpoints is improved, but processing requirements at decoder increase
Solution Approach 1:
The encoder performs preliminary classification of texture attributes to determine which points require view-dependent enhancement information. By pre-identifying view-dependent attributes and organizing them in the SEI message with associated camera parameters, the decoder receives ready-to-process structured data rather than raw unprocessed information, reducing real-time processing burden.
Solution Approach 2:
The patent changes the parameter organization from transmitting all texture attributes for all viewpoints to transmitting only the necessary view-dependent parameters through the SEI message. The attribute classification parameters enable the decoder to dynamically adjust which texture values to apply based on current viewing state, reducing processing requirements by transmitting only essential parameters rather than complete attribute sets.
3Adaptability or versatility
If camera position and rotation information are updated over time, then adaptability to changing viewing states is improved, but information loss from transmission errors increases
Solution Approach 1:
The patent incorporates feedback mechanisms through the SEI message structure that allows the decoder to verify and correct camera position and rotation information. The attribute classification parameters provide reference data that can be used to validate transmitted camera parameters, enabling error detection and correction without requiring redundant transmission of all position data, thus maintaining adaptability while reducing information loss.
Data Source
AI summary
A method for coding view-dependent texture attributes of points in a 3D point cloud prior to transmission and decoding includes creating a supplemental enhancement information (SIE) message for the 3D point cloud prior to transmission and decoding. The SEI message includes parameters related to texture attributes of individual points in the 3D point cloud for a plurality of viewing states at an initial time, such that when the SIE message is received at a decoder, the decoder is enabled to use the message to classify the texture attributes and apply one or more texture attributes to individual points such that the texture of each individual point in the decoded 3D point cloud is a correct representation of texture of that individual point in the 3D point cloud prior to transmission and decoding for each of the viewing states.