3D Geometry Motion Compensation via 2D Projection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for motion compensation of 3D geometry data are computationally heavy and prone to errors due to topology changes and fast motion, with existing solutions either requiring mesh tracking or relying on unreliable 2D projections for patch correspondence.

Innovation Solution

A method that identifies corresponding 3D surfaces in the time domain, projects them onto a 2D canvas, and performs 2D motion compensation, eliminating the need for prior geometry tracking and improving reliability by adjusting patch depth for better correspondence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If mesh tracking is used for motion compensation, then motion modeling can be performed, but computational complexity increases and errors occur due to topology changes and fast motion

Engineering Contradiction:
Improvemotion compensation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the 3D mesh into multiple patches, where each patch can be independently tracked and compensated. This segmentation allows the system to handle topology changes and fast motion more effectively by focusing on local regions rather than the entire mesh, reducing computational complexity while maintaining or improving accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent projects 3D patches onto 2D planes and performs motion compensation in both 3D and 2D domains. This dimensional transformation enables the use of efficient 2D motion compensation algorithms while preserving 3D geometric information, thereby reducing computational burden without sacrificing accuracy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of manufacture

If 2D projected surfaces are used for patch correspondence, then coding can be simplified, but reliability decreases due to inaccurate correspondence information

Engineering Contradiction:
Improvecoding simplicityVSAvoidpatch correspondence accuracy
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent merges 3D patch correspondence information with 2D projected patch information. By combining both approaches, the system maintains the coding simplicity of 2D methods while incorporating the accuracy of 3D correspondence, achieving a balance between ease of implementation and reliability.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses 3D patch normals and depth information as intermediary data to enhance 2D projected patch correspondence. These intermediary elements bridge the gap between simple 2D projection and accurate 3D correspondence, allowing the system to maintain coding simplicity while improving reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11501507B2Motion compensation of geometry information
Publication Date: 2022.11.15 SONY GROUP CORP
  • US11501507B2 patent drawing
  • US11501507B2 patent drawing
  • US11501507B2 patent drawing

AI summary

A method of motion compensation for geometry representation of 3D data is described herein. The method performs motion compensation by first identifying correspondent 3D surfaces in time domain, then followed by a 3D to 2D projection of motion compensated 3D surface patches, and then finally performing 2D motion compensation on the projected 3D surface patches.