Volumetric Video Tiling for Playback Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in efficiently compressing and decompressing high-resolution three-dimensional volumetric video data, leading to excessive computational resource demands and poor playback performance on consumer-grade devices, due to the large data rates and storage requirements of volumetric video content.
Innovation Solution
The implementation of texture map video tiling, mesh video tiling, and mesh+texture map video tiling techniques, which divide texture and mesh data into smaller tiles for parallel processing and view-dependent rendering, reducing resource consumption and improving utilization while maintaining fidelity and temporal consistency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If volumetric video data is compressed using conventional methods, then data transmission is possible, but computational resource demands become excessive on consumer-grade devices
Solution Approach 1:
The patent divides volumetric video data into separate mesh sequences and texture sequences, then further segments textures into tile sequences. This segmentation allows selective decoding of only visible portions during playback, reducing computational load on consumer devices while maintaining transmission efficiency.
2Manufacturing precision
If high-resolution volumetric video is stored and transmitted, then playback quality is improved, but storage and transmission bandwidth requirements become prohibitive
Solution Approach 1:
The patent extracts and separates geometry information (mesh) from appearance information (texture), encoding them independently. This extraction allows efficient compression of each component separately and enables selective transmission of only necessary data portions, reducing overall data volume while preserving playback quality.
Solution Approach 2:
The patent introduces temporal dimension by separating key frames from non-key frames, and spatial dimension by tiling textures. This multi-dimensional organization enables efficient compression through temporal prediction and selective tile decoding, significantly reducing storage and transmission requirements.
3Manufacturing precision
If complete mesh and texture data is decoded for playback, then rendering quality is maintained, but processing time and resource consumption increase
Solution Approach 1:
The patent performs preliminary organization of volumetric data into structured mesh sequences and tiled texture sequences during encoding. This preliminary action enables the playback device to quickly identify and decode only the necessary visible portions without processing complete data sets, reducing processing time while maintaining rendering quality.
Solution Approach 2:
The patent implements partial decoding by tiling textures and enabling selective decoding of only visible tiles based on camera view. This partial action approach decodes sufficient data for current view without processing excessive data for entire volumetric content, optimizing the balance between quality and processing speed.
Data Source
AI summary
A system and method for processing volumetric video is disclosed. The process includes receiving three-dimensional mesh data and texture data defining three-dimensional and textural characteristics of a physical location captured as volumetric video, dividing the three-dimensional mesh data into sub-parts defining a mesh tile, each mesh tile making up only a portion of the three-dimensional mesh data, and identifying a sub-part of the texture data defining a texture tile, the texture tile corresponding to each of the sub-parts of the mesh tiles and including only texture data relevant to an associated mesh tile. The volumetric video may be encoded by encoding each mesh tile independent of the three-dimensional mesh data as a mesh tile video and each texture tile independent of the texture data as a texture tile video.