3D Point Cloud Projection onto 2D Frames for Video Codec Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The transmission of uncompressed 3D point clouds requires significant bandwidth, and existing technologies often necessitate specialized hardware for compression, which is expensive and not widely available for encoding and decoding 3D video content.
Innovation Solution
A method for compressing point clouds by projecting them onto 2D frames using existing video codecs, segmenting the 3D point cloud into voxels, calculating normal and smoothing scores, and grouping points into projection planes to generate refined patches, which are then encoded into a bitstream for efficient transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If point clouds are compressed using specialized hardware, then compression quality and efficiency are improved, but device complexity and cost increase
Solution Approach 1:
The patent creates a virtual copy of the 3D point cloud by projecting it onto 2D frames, allowing standard video codecs to process the data. This copying approach enables compression without specialized hardware while maintaining compression efficiency through mathematical transformation of the point cloud data into a format compatible with existing video compression standards.
Solution Approach 2:
The patent replaces the mechanical/computational system of specialized point cloud compression hardware with a software-based approach using standard video codecs. By substituting dedicated hardware processing with general-purpose video compression algorithms, the system achieves comparable compression efficiency without requiring complex specialized devices.
2Reliability
If uncompressed 3D point clouds are transmitted, then data quality is preserved, but bandwidth requirements increase significantly
Solution Approach 1:
The patent transforms the 3D point cloud data into a 2D frame representation, changing the dimensional structure of the data. This dimensionality reduction allows the point cloud to be processed and transmitted using standard 2D video compression techniques, significantly reducing bandwidth requirements while preserving essential spatial information through the projection and reconstruction process.
3Device complexity
If point clouds are projected onto 2D frames using existing video codecs, then hardware requirements are reduced, but compression speed may decrease
Solution Approach 1:
The patent performs preliminary segmentation of the point cloud into voxels and calculation of normal/smoothing scores before projection. This pre-processing organizes the data in a way that optimizes the subsequent projection and compression steps, enabling faster processing by standard video codecs while maintaining compression quality and reducing the computational burden during the actual encoding phase.
Data Source
AI summary
An encoding device and a method for point cloud encoding are disclosed. The method for encoding includes segmenting an area including points representing a three-dimensional (3D) point cloud into multiple voxels. The method also includes identifying a normal score for each of the points of the 3D point cloud and a smoothing score for each of the multiple voxels that include at least one of the points of the 3D point cloud. The method further includes grouping each point of the 3D point cloud to one of multiple projection planes based on the normal score and the smoothing score to generate refined patches that represent the 3D point cloud. Additionally, the method includes generating frames that include pixels that represent the refined patches. The method also includes encoding the frames to generate a bitstream and transmitting the bitstream.