Partial Access Metadata for Video-Based Point Cloud Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video-based point cloud compression systems face inefficiencies due to large patch sizes leading to increased frame size and codec complexity, which do not significantly enhance the quality of the reconstructed point cloud, and existing technologies lack harmonization between partial access metadata and volumetric tiling information for efficient data access and rendering.
Innovation Solution
The proposed solution involves a decoding device and method for generating partial access metadata that identifies region information based on user perspective, locates corresponding tracks in the compressed bitstream, and decodes visible objects for display, leveraging existing video codecs to compress and reconstruct 3D point clouds by projecting them onto 2D frames, and harmonizing partial access technologies with volumetric tiling information for efficient data access and rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If large patch sizes are used in video-based point cloud compression, then the frame size increases and codec complexity increases, but the quality of the reconstructed point cloud does not significantly enhance
Solution Approach 1:
The patent divides the point cloud data into multiple patches and further segments each patch into sub-regions. This segmentation allows the codec to process smaller, more manageable regions independently, reducing the overall complexity while maintaining quality through focused processing of visible areas.
Solution Approach 2:
The patent implements differential processing where visible patches receive higher quality processing while non-visible patches use lower quality processing. This local quality approach optimizes resource allocation by concentrating computational efforts on regions that contribute to the final visual output, thereby reducing overall codec complexity without compromising perceived quality.
2Manufacturing precision
If large patch sizes are used in video-based point cloud compression, then the frame size increases, but the quality of the reconstructed point cloud does not significantly enhance
Solution Approach 1:
The patent segments large patches into smaller sub-regions and processes only the visible portions at high quality. This segmentation strategy reduces the effective frame size that requires high-quality processing, thereby reducing overall frame size while maintaining reconstructed quality for visible areas.
Solution Approach 2:
The patent applies partial processing by focusing computational resources only on visible patches and sub-regions rather than processing the entire frame at full quality. This partial action approach reduces the effective frame size requiring high-quality encoding while maintaining overall reconstructed quality through selective processing.
3Productivity
If partial access metadata is not harmonized with volumetric tiling information, then efficient data access and rendering cannot be achieved
Solution Approach 1:
The patent merges partial access metadata with volumetric tiling information into a unified structure that enables efficient data access. By combining these previously separate systems, the patent achieves streamlined processing and rendering while reducing the complexity of managing multiple independent metadata systems.
Solution Approach 2:
The patent creates a universal metadata system that serves multiple functions: it provides both partial access capabilities and volumetric tiling information through a single harmonized structure. This multi-functional approach improves data access efficiency while avoiding the complexity of maintaining separate specialized systems.
Data Source
AI summary
A decoding device, method, and computer readable medium for partial access metadata for video-based point cloud compression data are disclosed. The decoding device for point cloud decoding includes a communication interface and a processor operably coupled to the communication interface. The communication interface receives a compressed bitstream and metadata related to the compressed bitstream. The processor identifies, in the metadata, region information that indicates a region of a point cloud based on a user perspective; locates a track of the compressed bitstream that corresponds to the region information; identifies, in the track, objects corresponding to the region of the point cloud; and decodes for display of an object, included in the objects identified in the track, that is visible from the user perspective.