V-PCC Decoder Frame Synchronization for Point Cloud Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video-based point cloud compression (V-PCC) technologies face challenges in synchronizing decoded frames, leading to difficulties in reconstructing dynamic 3D point clouds due to different Group of Pictures (GOP) structures across V-PCC components, which results in temporal misalignment and output delay issues.
Innovation Solution
The implementation of a V-PCC decoder that synchronizes decoded frames by delaying the release of V-PCC components from decoded picture/atlas buffers or using an external buffer to align them before transferring to the reconstruction unit, ensuring all components are temporally aligned for accurate point cloud reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If different GOP structures are used across V-PCC components for independent decoding, then decoding flexibility and efficiency are improved, but temporal alignment between components deteriorates
Solution Approach 1:
The patent introduces a synchronization buffer that performs preliminary actions by storing decoded V-PCC components and delaying their release until all components for a given time instant are available. This preliminary buffering action ensures temporal alignment is achieved before components are transferred to the reconstruction unit, resolving the contradiction between independent decoding efficiency and temporal alignment precision.
2Speed
If decoded frames are released immediately after decoding, then processing speed is improved, but synchronization between components deteriorates
Solution Approach 1:
The patent introduces a synchronization buffer as an intermediary component between the decoders and the reconstruction unit. This intermediary receives decoded frames from multiple decoders, holds them temporarily, and releases them only when all components are synchronized. This mediator resolves the contradiction by maintaining both fast processing (through efficient buffering) and reliable synchronization (through coordinated release).
Data Source
AI summary
A method and Video-Based Point Cloud Compression (V-PCC) decoder for synchronization of decoded frames before point cloud reconstruction is provided. A V-PCC bit-stream which includes encoded frames associated with a point cloud sequence is received. Sub-streams of the received V-PCC bit-stream are decoded by a group of video decoders of the V-PCC decoder to generate V-PCC components, such as an attribute component, a geometry component, an occupancy map component, and an atlas component. A release of the attribute component, the geometry component, the occupancy map component, and the atlas component to the reconstruction unit is delayed based on a first output delay, a second output delay, a third output delay, and a fourth output delay, respectively. The delayed release synchronizes the attribute component, the geometry component, the occupancy map component, and the atlas component with each other before the reconstruction unit reconstructs a point cloud based on the V-PCC components.