V-PCC 3D Bounding Box Scale Parameter for AR Point Cloud Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Video Point Cloud Coding (V-PCC) systems struggle to properly integrate point clouds into video due to mismatches between the local coordinate system and the size of objects in augmented reality (AR) applications.
Innovation Solution
Incorporating a 3D bounding box scale parameter into the PCC bitstream, which transforms coded sample positions from the local coordinate system to a real-world coordinate system, allowing for correct sizing of the reconstructed point cloud for overlay onto real-world video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a point cloud is coded based on a predefined 3D bounding box size, then the point cloud can be stored and transmitted efficiently, but the point cloud cannot be properly integrated into augmented reality video due to coordinate system mismatch
Solution Approach 1:
The patent applies preliminary action by pre-defining a standard 3D bounding box size (e.g., 1 meter cube) for coding point clouds. This standardized coordinate system is established in advance during encoding, allowing efficient storage and transmission. The scale factor is pre-calculated based on the ratio between the standard bounding box and the actual object bounding box, enabling later scaling operations during AR integration without requiring re-encoding of the original point cloud data.
2Adaptability or versatility
If the point cloud is scaled to real-world sizes, then proper integration into AR video is achieved, but additional parameters and processing are required
Solution Approach 1:
The patent applies parameter changes by introducing a scale factor parameter that transforms the point cloud from the standardized coordinate system to real-world dimensions. Instead of storing multiple versions of the point cloud or using complex coordinate transformation matrices, the solution changes the scaling parameter directly. The scale factor is signaled in the bitstream alongside existing bounding box parameters, allowing the decoder to apply uniform scaling to achieve proper AR integration while maintaining relatively simple processing requirements.
Data Source
AI summary
A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a plurality of two-dimensional (2D) patches in an atlas frame and a three-dimensional (3D) bounding box scale. The 2D patches are decoded. A point cloud is reconstructed by converting the 2D patches to a 3D patch coordinate system defined by each projection plane of the 3D bounding box. The 3D bounding box scale is applied to a 3D bounding box.