Multi-Directional 2D Snapshot Image Tracks for V3C Quick Preview
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current compression methods for volumetric contents such as point clouds and meshes result in inefficient and resource-intensive processes for quick preview or trick play, as they require decoding multiple frames to access specific frames due to misaligned random access points and differing frame rates.
Innovation Solution
The introduction of a series of two-dimensional snapshot images in a multi-directional snapshot image track, which eliminates the need for decoding and rendering volumetric contents, reducing computational costs and enabling efficient quick preview or trick play.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If conventional video compression technology is used for volumetric contents, then compression efficiency is improved and storage/delivery resources are saved, but quick preview or trick play becomes complicated and time-consuming due to misaligned random access points and differing frame rates
Solution Approach 1:
The patent segments the volumetric content into multiple independent 2D snapshot image tracks, where each track contains 2D projections from a specific viewpoint. This segmentation allows each track to be independently decoded and accessed, enabling quick preview without requiring synchronization and decoding of multiple volumetric frames across different tracks.
Solution Approach 2:
The patent creates 2D snapshot copies of the volumetric content from multiple viewpoints and stores them in separate tracks. These 2D copies serve as simplified representations that can be directly displayed without requiring full volumetric decoding, thus enabling fast preview while maintaining compression efficiency through selective storage of 2D projections.
2Productivity
If multiple video frames are decoded to access a specific frame in compressed volumetric contents, then compression efficiency is maintained, but computational cost and processing time increase significantly
Solution Approach 1:
The patent divides the volumetric content into separate 2D snapshot tracks, allowing the system to decode only the specific track needed for preview rather than multiple volumetric frames. This selective decoding approach maintains compression efficiency while significantly reducing computational cost and energy consumption for quick preview operations.
Solution Approach 2:
The patent extracts 2D snapshot images from the volumetric content and stores them in separate tracks. During quick preview, only the necessary 2D snapshot tracks are decoded and extracted, eliminating the need to decode and process multiple full volumetric frames, thus reducing computational overhead while preserving compression benefits.
3Adaptability or versatility
If random access points of components are not aligned or frame rates differ, then compression flexibility is improved, but the number of frames to be decoded increases for quick preview
Solution Approach 1:
The patent segments volumetric content into independent 2D snapshot tracks, where each track can have its own frame rate and random access points. This segmentation provides compression flexibility for each viewpoint while allowing quick preview by decoding only the relevant track without requiring alignment or synchronization of multiple frames, thus maintaining productivity.
4Ease of operation
If uncompressed volumetric contents are used, then quick preview is straightforward and easy, but storage and delivery resources are excessively consumed
Solution Approach 1:
The patent creates compressed 2D snapshot copies of volumetric content from multiple viewpoints and stores them in separate tracks. These 2D copies maintain the ease of quick preview operation similar to uncompressed content, while significantly reducing storage and delivery resource consumption through compression, thus resolving the contradiction between ease of operation and resource consumption.
Data Source
AI summary
An embodiment of an apparatus is directed to improvements to dynamic mesh coding for a multi-directional image track. The apparatus receives a track including one or more samples, wherein a respective one of the one or more samples includes a plurality of coded two-dimensional projected images of coded volumetric frame as a plurality of subsamples. The apparatus decodes at least one of the plurality of coded two-dimensional projected images to generate at least one of a plurality of two-dimensional projected images. The apparatus presents the at least one two-dimensional projected image.