3D Mesh Compression via Selective Sub-mesh Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing technologies face challenges in efficiently compressing and decompressing large three-dimensional meshes with associated textures or attributes, leading to high storage and transmission costs.

Innovation Solution

A decoder system that receives a bitstream representing a compressed mesh, comprising a base mesh sub-bitstream and an atlas sub-bitstream. The atlas sub-bitstream includes displacement values and sub-mesh identifiers to reconstruct specific sub-meshes while omitting others.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If all sub-meshes are reconstructed from the compressed bitstream, then complete mesh quality is achieved, but computational resources and processing time increase significantly

Engineering Contradiction:
Improvemesh reconstruction qualityVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The mesh is divided into multiple sub-meshes that can be independently identified and reconstructed. The bitstream contains sub-mesh identifiers that allow the decoder to selectively process only the required sub-meshes rather than reconstructing the entire mesh, thus improving processing speed while maintaining quality for selected portions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system enables partial reconstruction of only the necessary sub-meshes based on the application requirements. Instead of reconstructing all sub-meshes in the complete mesh, the decoder can selectively reconstruct only those sub-meshes that are needed for the current viewing angle or application, reducing computational resources while maintaining adequate quality.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If displacement values for all vertices are stored in the bitstream, then complete mesh detail is preserved, but storage and transmission costs increase

Engineering Contradiction:
Improvemesh detail preservationVSAvoiddata volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The displacement data is segmented by sub-mesh identifiers, allowing the system to store and transmit displacement values only for the sub-meshes that need to be reconstructed. This segmentation enables selective data transmission, reducing the overall data volume while preserving complete detail for the selected sub-meshes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts and transmits only the necessary displacement values for specific sub-meshes rather than including all displacement data for the complete mesh. By taking out only the required portions of displacement data corresponding to selected sub-meshes, the system reduces storage and transmission costs while maintaining complete detail for those specific regions.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If the entire mesh is reconstructed, then complete visual content is achieved, but rendering time and computational resources increase

Engineering Contradiction:
Improvevisual content completenessVSAvoidrendering time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The mesh is segmented into multiple sub-meshes with unique identifiers in the bitstream. This segmentation enables the rendering system to reconstruct and render only the specific sub-meshes that are currently visible or required, rather than processing the entire mesh, thus significantly reducing rendering time while maintaining visual completeness for the selected regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements partial reconstruction and rendering of only the necessary sub-meshes based on application needs, such as viewing angle or importance. This partial action approach reduces rendering time and computational resource consumption while maintaining adequate visual quality for the selected portions of the mesh.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP4539462A1Mesh compression with base mesh information signaled in a first sub-bitstream and sub-mesh information signaled with displacement information in an additional sub-bitstream
Publication Date: 2025.04.16 APPLE INC
  • EP4539462A1 patent drawingFigure 1
  • EP4539462A1 patent drawingFigure 2
  • EP4539462A1 patent drawingFigure 3

AI summary

A system comprises an encoder configured to compress and encode data for a three-dimensional dynamic mesh. The three-dimensional dynamic mesh is compressed and signaled using a base-mesh sub-bitstream and an atlas sub-bitstream (e.g., displacement and/or attribute sub-bitstream). The atlas sub-bitstream comprises displacement information to be applied at sub-division points of the base mesh to recreate the three-dimensional dynamic mesh at a given moment in time and may also include attribute values, such as colors, textures, etc. to be applied to the reconstructed mesh. Sub-mesh identifiers are included in tile headers of an atlas sub-bitstream that enable selective reconstruction of sub-meshes. A complimentary decoder decodes a compressed bitstream for the three-dimensional dynamic mesh, encoded such as by the encoder.