Volumetric Video Texture Compression via Key Frame Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for compressing volumetric video data, particularly for three-dimensional scenes, are inefficient in terms of data volume and computational intensity, especially when dealing with textures and meshes.
Innovation Solution
A method for compressing volumetric video streams that involves generating a mesh and texture for each frame, grouping frames into key frames and inter-frames, and using block compression techniques like DXT, ASTC, or PVRTC to create blocks usable by conventional graphics processing units. This method reduces the volume of texture data by encoding only the composite texture of key frames and using iterative replacements to form approximate textures for inter-frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If complete texture atlases are encoded and decoded entirely for each frame using MPEG/H.264 standards, then visual quality is maintained, but computational cost and bandwidth requirements increase significantly
Solution Approach 1:
The patent divides the complete texture atlas into multiple texture regions or patches. Instead of encoding and decoding the entire texture atlas for each frame, only the modified texture regions are encoded and transmitted. This segmentation allows the system to maintain visual quality in changed areas while reducing overall computational cost and bandwidth requirements.
Solution Approach 2:
The patent extracts and encodes only the differential texture information that changes between frames, rather than encoding complete texture atlases. By separating and transmitting only the modified texture regions, the system reduces computational overhead and bandwidth usage while preserving visual quality where changes occur.
2Measurement precision
If complete texture atlases are transmitted for each frame, then visual quality is maintained, but bandwidth requirements increase
Solution Approach 1:
The patent extracts and transmits only the differential texture information that changes between frames, rather than transmitting complete texture atlases. This extraction of essential changed information maintains visual quality in modified regions while significantly reducing the data volume that needs to be transmitted over the network.
Solution Approach 2:
The patent segments the texture atlas into multiple regions and transmits only those segments that have changed between frames. This selective transmission of segmented texture data reduces bandwidth requirements while maintaining visual quality in the areas that actually changed.
3Adaptability or versatility
If conventional compression standards (MPEG, H.264) are used for texture atlases, then compatibility is maintained, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary identification and segmentation of texture regions that have changed between frames before compression. By pre-processing the texture data to identify only the modified regions, the system reduces the amount of data that needs to be processed by conventional compression standards, thereby reducing processing time while maintaining compatibility.
Solution Approach 2:
The patent segments texture atlases into smaller regions and processes only the changed segments through conventional compression standards. This segmentation approach maintains compatibility with existing standards while reducing the overall processing time and computational resources required, as fewer pixels and smaller data blocks need to be processed.
Data Source
AI summary
A method for compressing a volumetric video stream comprising a plurality of frames, each associated with a mesh and a texture, with groups of frames being defined, each comprising a key frame and inter frames having meshes defined with respect to the mesh of the corresponding key frame, the method comprising: a step of compressing information representative of the textures, including, for each frame group, steps of block compressing the information representative of the textures of each of the frames, thus defining blocks of pixels; determining first blocks which can form a composite texture of the key frame and second blocks which can modify this composite texture through iterative substitutions so as to form approximate inter-frame textures; and encoding the inter-frame textures on the basis of the composite texture of the key frame and the second blocks.