Point Cloud Patch Encoding with Separate Images for In-Between Samples
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently compressing dynamic point clouds while maintaining quality and reducing bit-rate consumption for distribution to end-users, especially in applications like virtual reality and autonomous vehicles.
Innovation Solution
A method of encoding and decoding 3D samples by projecting them orthogonally into 2D samples, using separate images for attribute patches and in-between samples, with hierarchical structuring at group of pictures, frame, and patch levels, and employing a two-layer-based point cloud encoding structure with a base and enhancement layer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If dynamic point clouds are compressed using traditional methods, then bit-rate consumption is reduced, but quality of experience deteriorates
Solution Approach 1:
The point cloud data is segmented into multiple patches, with different compression strategies applied to different regions. First attribute patches contain attributes of orthogonally projected 3D samples, while second attribute patches contain attributes of in-between 3D samples. This segmentation allows selective compression that maintains quality in important regions while reducing bit-rate overall.
Solution Approach 2:
Different compression quality levels are applied to different spatial regions of the point cloud. The patent encodes attributes of visible 3D samples with higher precision while using different encoding for in-between samples, creating local quality variations that optimize the balance between bit-rate and perceived quality.
2Adaptability or versatility
If separate images are used for first and second attribute patches, then encoding flexibility is improved, but device complexity increases
Solution Approach 1:
The patent introduces dynamic control mechanisms where the encoder can selectively decide whether to store first and second attribute patches in separate images or combined images based on content characteristics. Syntax elements control this behavior, allowing the system to adapt between different encoding modes without requiring fundamentally different processing architectures.
Data Source
AI summary
At least one embodiment relates to provides a method of encoding/decoding attribute of orthogonally projected 3D samples and in-between 3D samples in which an information indicates whether at least one first attribute patch of 2D samples obtained by encoding the attribute of said at least one orthogonally projected 3D samples according to a first attribute coding mode, and at least one second attribute patch of 2D samples of an image obtained by encoding the attribute of at least one in-between 3D sample, are stored in separate images.


