Object Model Vertices as Joints for Deformation Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for modeling object models in computer vision and extended reality applications face challenges in accurately representing and simulating the deformation of objects in a physical environment over time, particularly in generating temporally variable point clouds and assigning joint labels to vertices for realistic interaction with virtual forces.

Innovation Solution

A method is developed to generate object models by obtaining point clouds with temporally varying coordinates, spatially disambiguating them into clusters, and assigning characterization vectors with joint labels to vertices, allowing for accurate representation and simulation of object deformation in response to external forces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional point cloud modeling methods are used, then the modeling process is simple, but the accuracy of representing object deformation over time is insufficient

Engineering Contradiction:
Improveaccuracy of object deformation representationVSAvoidcomplexity of modeling system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the point cloud data into multiple temporal frames and identifies corresponding points across frames to track deformation. By dividing the modeling process into temporal segments and assigning joint labels to specific vertices, the system achieves accurate deformation representation while managing complexity through structured organization of tracking data and joint characterizations across multiple time points

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes parameters by assigning joint labels (e.g., hinge, pivot, spring) to vertices and storing temporal coordinate variations for each point. This parameter enrichment transforms static point cloud data into dynamic models with deformation capabilities, enabling accurate representation of object behavior under virtual forces while maintaining computational tractability through standardized joint types

Inventive Principle:
Principle #35Parameter changes

2Reliability

If joint labels are assigned to vertices for deformation simulation, then the realism of object interaction is improved, but the complexity of data processing increases

Engineering Contradiction:
Improverealism of object interactionVSAvoidcomplexity of data processing
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by pre-processing point cloud data to identify corresponding points across temporal frames before deformation simulation. Joint labels are assigned to vertices in advance based on tracked motion patterns, and characterization vectors are computed beforehand. This preliminary processing organizes the data structure to facilitate efficient and realistic deformation simulation when virtual forces are applied, reducing runtime complexity while improving interaction realism

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12045941B1Modeling object model vertices as joints based on temporally variable point clouds
Publication Date: 2024.07.23 APPLE INC
  • US12045941B1 patent drawing
  • US12045941B1 patent drawing
  • US12045941B1 patent drawing

AI summary

In one implementation, a method of generating an object model is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a point cloud including a plurality of points, wherein each of the plurality of points is associated with a plurality of sets of coordinates in a three-dimensional space at a respective plurality of time periods. The method includes generating an object model including a plurality of vertices corresponding to the plurality of points and a plurality of edges between respective pairs of the plurality of vertices. The method includes generating, based on the sets of coordinates of a particular point, a characterization vector of a particular vertex corresponding to the particular point, wherein the characterization vector includes a joint label and joint data with respect to one or more of the plurality of edges of the particular vertex.