Point Cloud Compression With Adaptive Downsampling and Upsampling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing point cloud compression methods fail to effectively combine downsampling and upsampling processes, leading to sub-optimal performance and high bit rates, particularly for large-scale point clouds, and often result in reconstruction errors due to separate and inefficient training mechanisms.

Innovation Solution

A collaborative adaptive downsampling and upsampling method that utilizes low-frequency and high-frequency information to guide the reconstruction process, employing sparse convolution and multi-stage loss functions to train networks simultaneously, ensuring accurate and efficient compression.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional point cloud compression methods are used, then the processing is simpler, but the coding performance is insufficient and bit rates are high

Engineering Contradiction:
Improvecoding performanceVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the point cloud processing into distinct downsampling and upsampling stages. The downsampling stage extracts low-frequency information by subsampling points, while the upsampling stage reconstructs high-frequency details. This segmentation allows each stage to be optimized independently, improving overall coding performance while managing computational complexity through structured processing steps.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary downsampling before compression to reduce the number of points and lower the bit rate. By performing this action in advance, the system prepares the point cloud for more efficient encoding while preserving essential low-frequency information that can be recovered during upsampling, thus improving coding performance without requiring all original points to be processed at full resolution.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If separate downsampling and upsampling processes are used, then the processing steps are defined, but reconstruction errors occur due to inefficient training

Engineering Contradiction:
Improvereconstruction qualityVSAvoidtraining mechanism complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the training of downsampling and upsampling networks into a single unified training process. Both networks are trained simultaneously using combined loss functions that enforce consistency between the downsampled and original point clouds. This merging eliminates the reconstruction errors that occur when processes are trained separately, as the joint training ensures coherent transformation throughout the entire pipeline while maintaining defined processing steps.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements feedback mechanisms through loss functions that compare the upsampled reconstruction with the original point cloud. The combined loss functions provide continuous feedback during training to adjust both downsampling and upsampling operations, ensuring that the reconstruction quality is optimized. This feedback loop resolves reconstruction errors by iteratively improving the consistency between input and output representations.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If all point cloud data is processed at full resolution, then the reconstruction quality is maintained, but the bit rate increases significantly

Engineering Contradiction:
Improvereconstruction qualityVSAvoidbit rate
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent extracts and transmits only the essential low-frequency information through downsampling, rather than transmitting all high-frequency detail points. By taking out and encoding only the critical structural information, the system significantly reduces the bit rate requirement. The upsampling process then synthesizes the remaining high-frequency details, maintaining reconstruction quality while using far fewer bits than would be required to transmit the complete original point cloud at full resolution.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS20260046452A1Method, apparatus, and medium for point cloud processing
Publication Date: 2026.02.12 DOUYIN VISION CO LTD
  • US20260046452A1 patent drawing
  • US20260046452A1 patent drawing
  • US20260046452A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for point cloud processing. A method for point cloud processing is proposed. The method comprises: obtaining, for a conversion between a current point cloud (PC) sample of a point cloud sequence and a bitstream of the point cloud sequence, a first set of points of the current PC sample, the first set of points representing low frequency information of the current PC sample; obtaining a first feature associated with high frequency information of the current PC sample; and performing the conversion based on the first set of points and the first feature.