Point Cloud Patch Index Coding for Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The transmission of uncompressed 3D point clouds requires significant bandwidth, and existing technologies often necessitate specialized hardware for compression, which is costly and not widely available for encoding and decoding 3D video content.
Innovation Solution
Converting 3D point clouds into 2D frames by projecting clusters of points onto multiple patches, allowing for compression using existing 2D video codecs like HEVC, AVC, VP9, VP8, and JVNET, and then reconstructing the point cloud for display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 3D point clouds are transmitted uncompressed, then transmission quality is maintained, but bandwidth requirements become excessively large
Solution Approach 1:
The patent segments the 3D point cloud data into multiple 2D depth map frames by projecting point clusters onto different planes. This segmentation allows each frame to be compressed independently using standard 2D video codecs, significantly reducing the total data volume while maintaining acceptable transmission quality for immersive video applications
Solution Approach 2:
The patent transforms 3D point cloud data into 2D depth map frames by projecting point clusters onto two-dimensional planes. This dimensional reduction enables the use of efficient 2D compression algorithms while preserving the essential spatial relationships needed for reconstructing the 3D scene at the decoder
2Productivity
If specialized hardware is used for 3D point cloud compression, then compression efficiency is improved, but device complexity and cost increase
Solution Approach 1:
The patent makes the compression system universal by enabling standard 2D video codecs to compress 3D point cloud data. Instead of requiring specialized 3D compression hardware, any device capable of decoding standard video formats can now handle immersive video content, greatly improving compatibility and reducing device complexity
Solution Approach 2:
The patent replaces the need for specialized 3D compression hardware with software-based processing that runs on general-purpose processors. By converting 3D data into 2D frames, the system substitutes complex dedicated hardware with widely available standard video decoding capabilities
Data Source
AI summary
A decoding device, an encoding device and methods for point cloud encoding and decoding are disclosed. The method for decoding includes receiving a bitstream and decoding from the bit stream a first and second frame that is associated with a delta index. The first and second frames include patches that represent a 3D point cloud at different instances in time. The method additionally includes determining, based on decoding the delta index, that at least one of the patches included in the second frame matches a corresponding patch included in the first frame. The method further includes identifying a predictor index for a current patch; identifying a reference index associated with a reference patch in the first frame based on the delta index and the predictor index; and generating the 3D point cloud using the first frame, the second frame, and the reference patch.