3D Content Processing via Hierarchical LoD Bitstreams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional video coding techniques are inefficient for representing three-dimensional visual scenes, as they primarily work with two-dimensional video frames.
Innovation Solution
The proposed solution involves encoding and decoding three-dimensional content using a bitstream structured with geometry and attribute sub-bitstreams, organized according to multiple levels of detail (LoD), and including LoD information for efficient representation and reconstruction of three-dimensional scenes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional two-dimensional video coding techniques are used to represent three-dimensional visual scenes, then the encoding and decoding processes are simpler, but the representation efficiency and visual quality are insufficient
Solution Approach 1:
The patent segments the three-dimensional content into multiple levels of detail (LoD), where each level represents a different degree of geometric precision. This segmentation allows the system to transmit only the necessary level of detail based on application requirements, improving representation efficiency while controlling complexity through hierarchical organization of geometric data
Solution Approach 2:
The patent transitions from traditional two-dimensional video frame representation to a multi-level three-dimensional point cloud representation. By organizing geometric data in three-dimensional space with multiple levels of detail, the system achieves superior representation efficiency for 3D scenes while managing complexity through structured hierarchical encoding
2Measurement precision
If complete three-dimensional point cloud data is transmitted, then the reconstruction quality is high, but the bandwidth requirements and transmission time increase
Solution Approach 1:
The patent extracts and transmits only the essential geometric information at the required level of detail, rather than transmitting complete high-resolution point cloud data. By extracting only the necessary data elements for the desired reconstruction quality, the system reduces transmission volume while maintaining adequate reconstruction quality for the specific application
Solution Approach 2:
The patent changes the parameter of geometric precision by organizing data into multiple levels of detail. This allows dynamic adjustment of data transmission volume based on reconstruction quality requirements, enabling efficient bandwidth utilization where lower LoD levels transmit less data for basic quality needs, while higher LoD levels provide enhanced quality when bandwidth permits
3Measurement precision
If high-resolution three-dimensional content is decoded, then the visual quality is superior, but the decoder complexity and processing requirements increase
Solution Approach 1:
The patent implements a dynamic decoding approach where the decoder can adaptively select the appropriate level of detail based on processing capabilities and requirements. This dynamic selection allows the system to adjust decoder complexity in real-time, enabling high-resolution decoding when processing power is available while allowing lower-resolution decoding on constrained devices
Solution Approach 2:
The patent performs preliminary organization of geometric data into a hierarchical multi-level structure during encoding. This preliminary action prepares the data in advance so that decoders can efficiently access only the required level of detail without processing unnecessary high-resolution data, thereby reducing decoder complexity while preserving the option to achieve high visual quality when needed
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods, systems, and apparatus for processing of three-dimensional visual content are described. One example method of processing three-dimensional content includes parsing a level of detail (LoD) information of a bitstream containing three-dimensional (3D) content that is represented as one geometry sub-bitstream and one or more attribute sub-bitstreams; and generating, based on the LoD information, decoded information by decoding at least a portion of the geometry sub-bitstream and the one or more attribute sub-bitstreams corresponding to a desired level of detail; and reconstructing, using the decoded information, a three-dimensional scene corresponding at least to the desired level of detail. The bitstream conforms to a format organized according to multiple levels of details of the 3D content.