V-PCC 3D Bounding Box Scale Parameter for AR Point Cloud Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Video Point Cloud Coding (V-PCC) systems struggle to properly integrate point clouds into video due to mismatches between the local coordinate system and the size of objects in augmented reality (AR) applications.

Innovation Solution

Incorporating a 3D bounding box scale parameter into the PCC bitstream, which transforms coded sample positions from the local coordinate system to a real-world coordinate system, allowing for correct sizing of the reconstructed point cloud for overlay onto real-world video.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a point cloud is coded based on a predefined 3D bounding box size, then the point cloud can be stored and transmitted efficiently, but the point cloud cannot be properly integrated into augmented reality video due to coordinate system mismatch

Engineering Contradiction:
Improvecoding efficiencyVSAvoidAR integration capability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent applies preliminary action by pre-defining a standard 3D bounding box size (e.g., 1 meter cube) for coding point clouds. This standardized coordinate system is established in advance during encoding, allowing efficient storage and transmission. The scale factor is pre-calculated based on the ratio between the standard bounding box and the actual object bounding box, enabling later scaling operations during AR integration without requiring re-encoding of the original point cloud data.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If the point cloud is scaled to real-world sizes, then proper integration into AR video is achieved, but additional parameters and processing are required

Engineering Contradiction:
ImproveAR integration capabilityVSAvoidparameter signaling overhead
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by introducing a scale factor parameter that transforms the point cloud from the standardized coordinate system to real-world dimensions. Instead of storing multiple versions of the point cloud or using complex coordinate transformation matrices, the solution changes the scaling parameter directly. The scale factor is signaled in the bitstream alongside existing bounding box parameters, allowing the decoder to apply uniform scaling to achieve proper AR integration while maintaining relatively simple processing requirements.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12244858B2Scaling parameters for V-PCC
Publication Date: 2025.03.04 HUAWEI TECH CO LTD

AI summary

A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a plurality of two-dimensional (2D) patches in an atlas frame and a three-dimensional (3D) bounding box scale. The 2D patches are decoded. A point cloud is reconstructed by converting the 2D patches to a 3D patch coordinate system defined by each projection plane of the 3D bounding box. The 3D bounding box scale is applied to a 3D bounding box.