Point Cloud Data Transmission via Viewport-Adaptive Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for transmitting and receiving point cloud data face challenges in efficiency, latency, and encoding/decoding complexity, particularly due to the large volume of data and complexity in processing for applications like virtual reality, augmented reality, and self-driving services.

Innovation Solution

A method and apparatus for efficiently transmitting and receiving point cloud data through encoding, encapsulating, and decoding, utilizing components such as point cloud video acquirers, encoders, file/segment encapsulation modules, and transmitters/receivers, which support both geometry-based and video-based compression schemes, allowing for adaptive processing based on user viewports.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If point cloud data is transmitted with high quality and completeness, then service quality improves, but data transmission volume and complexity increase

Engineering Contradiction:
Improvepoint cloud service qualityVSAvoidpoint cloud data volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The point cloud data is divided into multiple segments or slices corresponding to different spatial regions or depth ranges. Each segment can be independently encoded, transmitted, and decoded. This segmentation reduces the complexity of processing large-scale point cloud data while maintaining overall data quality, as only relevant segments need to be processed for specific viewing scenarios.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different quality levels are applied to different regions of the point cloud data based on their importance and visibility. High-priority regions (such as foreground objects or user viewport areas) are encoded with higher quality, while less important regions use lower quality encoding. This approach maintains service quality for critical areas while reducing overall data volume.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If complete point cloud data is transmitted, then processing accuracy improves, but transmission time and latency increase

Engineering Contradiction:
Improvepoint cloud processing accuracyVSAvoidtransmission latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Point cloud data is pre-processed, pre-segmented, and pre-encoded into multiple layers or resolutions before transmission. This preliminary organization allows the receiver to quickly access and decode only the necessary data portions without waiting for complete data transmission, thereby reducing latency while maintaining processing accuracy for the required regions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Only the essential or relevant portions of point cloud data are extracted and transmitted based on predicted user needs, viewport information, or application requirements. Non-critical data is either omitted or transmitted at lower fidelity, reducing transmission time while preserving sufficient accuracy for the extracted components.

Inventive Principle:
Principle #2Taking out (Extraction)

3Reliability

If high-resolution point cloud data is processed, then service quality improves, but encoding and decoding complexity increase

Engineering Contradiction:
Improvepoint cloud service qualityVSAvoidencoding and decoding complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The encoding and decoding processes are made adaptive and dynamic, adjusting processing complexity based on available resources, time constraints, and quality requirements. Multiple encoding passes or progressive refinement techniques allow the system to start with low-complexity decoding and progressively improve quality as computational resources become available, balancing service quality with processing complexity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Instead of processing the entire high-resolution point cloud data set, the system processes only the necessary portions at high resolution while using lower resolution for the rest. This partial processing approach maintains service quality for critical regions while significantly reducing overall encoding and decoding complexity.

Inventive Principle:
Principle #16Partial or excessive action

4Adaptability or versatility

If all point cloud data is transmitted for universal access, then adaptability improves, but transmission efficiency decreases

Engineering Contradiction:
Improvepoint cloud content adaptabilityVSAvoiddata transmission efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The point cloud data is encoded with multi-layer or progressive structures that provide universal adaptability across different applications and devices. The same encoded bitstream can serve multiple purposes (e.g., different viewports, resolutions, and quality requirements) without requiring separate transmissions, thereby maintaining adaptability while improving transmission efficiency through shared encoding.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Point cloud data is segmented into multiple independent but complementary components or layers that can be selectively transmitted based on specific application needs. This segmentation enables efficient transmission by allowing receivers to obtain only the segments relevant to their particular use case, improving transmission efficiency while preserving overall adaptability through the modular structure.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP4072132B1Point cloud data transmission device, point cloud data transmission method, point cloud data reception device, and point cloud data reception method
Publication Date: 2024.03.06 LG ELECTRONICS INC
  • EP4072132B1 patent drawingFigure 1
  • EP4072132B1 patent drawingFigure 2
  • EP4072132B1 patent drawingFigure 3

AI summary

Disclosed herein is a method for transmitting point cloud data. The transmission method may include encoding point cloud data, and transmitting the point cloud data. Disclosed herein is a method for receiving point cloud data. The reception method may include receiving point cloud data, decoding the point cloud data, and rendering the point cloud data.