3D Point Cloud Auxiliary Information Coding for Overlapping Patches

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current point cloud compression methods face ambiguity in block ownership during 2D mapping of 3D patches, leading to inefficiencies in encoding and decoding processes, especially when patch bounding boxes overlap.

Innovation Solution

The method involves encoding auxiliary information using a video encoder to identify the owner of each bounding box through a candidate list added to the upper bits of the occupancy map, ensuring accurate reconstruction of 3D patches from 2D information, and providing this information only when bounding boxes overlap.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If auxiliary information is encoded using entropy coding in standards, then the encoding process is simple, but encoding efficiency is reduced and block ownership ambiguity remains

Engineering Contradiction:
Improveencoding simplicityVSAvoidencoding efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent introduces an intermediary mechanism (candidate list with ownership indicators) that mediates between the simple entropy coding process and the need for efficient block ownership identification. This intermediary structure allows the system to maintain encoding simplicity while significantly improving encoding efficiency by enabling the decoder to quickly determine block ownership without complex auxiliary information processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If auxiliary information is provided for all frames, then block ownership is always clear, but transmission data volume increases

Engineering Contradiction:
Improveblock ownership clarityVSAvoidtransmission data volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies local quality by providing auxiliary information selectively rather than uniformly across all frames. The candidate list with ownership indicators is generated and transmitted only when necessary (when blocks may be ambiguous), while frames with clear ownership relationships use simpler encoding. This localized approach maintains reliability where needed while minimizing transmission data volume overall.

Inventive Principle:
Principle #3Local quality

3Reliability

If patch placement is restricted to avoid overlap, then block ownership ambiguity is eliminated, but flexibility in patch placement is reduced

Engineering Contradiction:
Improveblock ownership clarityVSAvoidpatch placement flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent uses preliminary action by pre-establishing a candidate list that contains ownership indicators for potential overlapping blocks. This preliminary structure is prepared in advance and allows the system to handle overlapping patch placements without ambiguity, as the decoder can consult the pre-prepared candidate list to determine ownership. This approach eliminates the need to restrict patch placement while maintaining clear block ownership.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10735766B2Point cloud auxiliary information coding
Publication Date: 2020.08.04 SONY GROUP CORP
  • US10735766B2 patent drawing
  • US10735766B2 patent drawing
  • US10735766B2 patent drawing

AI summary

A method for coding auxiliary information of 3D point cloud data is described herein. The coding method utilizes 3D surface patches to represent point clouds, and performs flexible mapping of 3D patch surface data into 2D canvas images. Auxiliary data is transmitted in order to correctly identify and reconstruct the 3D patches from 2D information. The auxiliary data is encoded using a video encoder.