Scalable Point Cloud Compression Using RAHT Transform Partitions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for compressing and decompressing point cloud data lack scalability, particularly in terms of spatial location, signal-to-noise ratio, and temporal resolution, making them impractical for real-time processing and diverse computational capabilities.

Innovation Solution

The use of a region-adaptive hierarchical transform (RAHT) to encode point cloud data, allowing for separation into partitions that can be decoded based on spatial, temporal, and quality requirements, enabling scalable compression and decompression while maintaining computational efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If graph transform and arithmetic coding are used for point cloud compression, then rate-distortion performance is improved, but computational complexity increases making real-time processing infeasible

Engineering Contradiction:
Improverate-distortion performanceVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent changes the transform parameters from complex graph transforms to simpler wavelet-like transforms that can be implemented with standard filtering operations. This parameter change maintains rate-distortion performance while reducing computational complexity to levels feasible for real-time processing on consumer hardware.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the complex arithmetic coding mechanism with simpler entropy coding methods that are more efficient on standard hardware. This substitution maintains compression effectiveness while enabling real-time processing on graphics processing units and other consumer devices.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If prior compression approaches are used, then computational efficiency is improved, but scalability to different spatial resolutions and quality levels is lost

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidscalability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent segments the compressed bitstream into multiple scalability layers, allowing decoders to selectively process different portions of the data. This segmentation enables the system to maintain computational efficiency for base layer processing while adding scalability for enhanced resolution and quality layers as needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension of scalability by organizing compression layers in a hierarchical structure that supports spatial, temporal, and quality scalability. This dimensional organization allows efficient processing at lower layers while enabling extended functionality at higher layers without reprocessing entire datasets.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If prior compression approaches are used, then simplicity of processing is improved, but rate-distortion performance deteriorates in certain scenarios

Engineering Contradiction:
Improvesimplicity of processingVSAvoidrate-distortion performance
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent applies local quality enhancement by enabling different processing qualities for different spatial regions and temporal layers. The system can maintain simple processing for base layers while applying enhanced compression techniques to specific regions or layers where higher rate-distortion performance is needed, rather than uniformly across the entire dataset.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10694210B2Scalable point cloud compression with transform, and corresponding decompression
Publication Date: 2020.06.23 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10694210B2 patent drawing
  • US10694210B2 patent drawing
  • US10694210B2 patent drawing

AI summary

Innovations in scalable compression and decompression of point cloud data are described. For example, after an encoder uses a transform such as a region-adaptive hierarchical transform (“RAHT”) on attributes of occupied points in point cloud data, the encoder separates transform coefficients into partitions. The partitions can be associated with different regions of a point cloud frame (spatial location scalability), different spatial resolutions of point cloud data (spatial resolution scalability), different reconstruction quality levels (SNR scalability), different point cloud frames organized in temporal layers (temporal resolution scalability), or different combinations of the preceding types of partitions. For decoding, a decoder can select all of the partitions or a subset of the partitions. The decoder decodes encoded data for the selected partitions, applying an inverse transform such as an inverse RAHT to transform coefficients for attributes of occupied points in point cloud data.