3D Mesh UV Parameterization Using Neural Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for UV parameterization of 3D objects face scalability issues with high-resolution meshes, are prone to local minima, and struggle with noisy inputs and non-manifold meshes, while neural-based approaches require large training datasets and are limited to bounded surfaces, leading to poor generalization and excessive patch generation.

Innovation Solution

A processor-implemented method using machine learning models to automatically determine 2D patches for 3D objects, involving a first model for patch extraction and a second model for surface parameterization, incorporating cosine similarity and geodesic distance constraints, and utilizing forward and backward mapping networks to improve texture mapping processes on both bounded and unbounded surfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional surface parameterization methods are used, then UV mapping can be achieved, but scalability to high-resolution meshes is poor and processing time increases significantly

Engineering Contradiction:
Improveprocessing speedVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces conventional iterative optimization methods with a neural network-based approach. The neural network directly predicts UV coordinates from 3D mesh vertices, eliminating the need for complex iterative energy minimization processes. This substitution of mechanical/computational systems with an AI-based system achieves fast inference while maintaining mapping quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses a neural network model trained on learned representations of 3D surfaces to copy and reproduce UV parameterization results. Instead of computing UV maps from scratch for each new mesh, the system uses the trained model to quickly generate parameterizations by copying the learned geometric relationships, enabling scalable processing of high-resolution meshes.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If iterative optimization methods are used for UV mapping, then mapping quality can be improved, but the methods are prone to local minima and require large computational resources

Engineering Contradiction:
Improvemapping qualityVSAvoidcomputational resources
Core Design Contradiction:
Manufacturing precisionVSUse of energy by stationary object

Solution Approach 1:

The patent replaces iterative optimization algorithms with a neural network inference system. The neural network has learned optimal parameterization patterns during training and can directly output high-quality UV maps without requiring iterative energy minimization, thus avoiding local minima issues while reducing computational resource requirements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent performs preliminary learning during the training phase, where the neural network is pre-trained on diverse 3D meshes to learn optimal UV parameterization patterns. This preliminary action encapsulates the computational heavy lifting in the training phase, allowing fast and resource-efficient inference when processing new meshes without requiring significant computational resources.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If neural-based surface parameterization is used, then processing speed improves, but large training datasets are required and generalization to unseen surfaces is poor

Engineering Contradiction:
Improveprocessing speedVSAvoidgeneralization capability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent employs parameter changes in the neural network architecture and training approach. By using a flexible neural network with adaptive parameters that can be fine-tuned or updated with new data, the system maintains fast processing speeds while improving generalization capability to unseen surfaces through parameter adaptation rather than requiring entirely new models for each surface type.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent designs a universal neural network model that can handle diverse 3D surface geometries and topologies. The model is trained to be multi-functional, capable of parameterizing various types of surfaces (bounded and unbounded, manifold and non-manifold) with a single unified architecture, thereby achieving both fast processing and broad generalization without requiring separate specialized models.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Adaptability or versatility

If existing neural network approaches are used, then parameterization can be achieved, but they are restricted to bounded surfaces only

Engineering Contradiction:
Improvesurface type coverageVSAvoidmodel complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extends the neural network model to achieve universality by enabling it to handle both bounded and unbounded surfaces, as well as manifold and non-manifold geometries. The model is designed with sufficient flexibility and adaptive capabilities to parameterize any surface type without requiring separate specialized models, thereby increasing surface type coverage while managing model complexity through a unified architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses parameter changes in the neural network's learned representations and transformation parameters to adapt the same model to different surface types. By dynamically adjusting parameters based on the input surface characteristics, the model can flexibly parameterize bounded and unbounded surfaces alike, expanding versatility without proportionally increasing model complexity.

Inventive Principle:
Principle #35Parameter changes

5Productivity

If surface parameterization is performed on noisy inputs or non-manifold meshes, then processing can continue, but the results become unreliable and processing time increases

Engineering Contradiction:
Improveprocessing continuityVSAvoidparameterization reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent replaces conventional iterative parameterization methods with a neural network approach that is inherently more robust to noisy inputs and non-manifold geometries. The neural network has learned to handle variations and inconsistencies in surface data during training, allowing it to continue processing noisy or complex meshes without failing, while maintaining reliable parameterization results through its adaptive nature.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent performs beforehand cushioning by pre-training the neural network on diverse datasets that include noisy and non-manifold surfaces. This training phase builds robustness and tolerance into the model, cushioning it against the effects of poor input quality. As a result, the model can handle noisy inputs and non-manifold meshes during inference without requiring additional preprocessing or correction steps.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS20240193328A1System and method for determining two-dimensional patches of three-dimensional object using machine learning models
Publication Date: 2024.06.13 INT INST OF INFORMATION THCHNOLOGY HYDERABAD
  • US20240193328A1 patent drawing
  • US20240193328A1 patent drawing
  • US20240193328A1 patent drawing

AI summary

A method for determining two-dimensional (2D) patches corresponding to a three-dimensional (3D) object using machine learning models for enabling an improved texture mapping process on the 3D object. The method includes (i) receiving mesh of the 3D object, (ii) training first machine learning model by providing correlation between historic vertices with (a) historic faces, and (b) historic vertex normals of historic meshes based on an objective function of patch extraction, (iii) determining, using the first machine learning model, 2D patches by partitioning the mesh until distortion of the mesh reaches threshold distortion, (iv) training second machine learning model using (i) shape-related features of historic 2D patches associated with historic meshes and (ii) an objective function of surface parameterization of the historic 2D patches associated with the historic meshes, and (v) automatically parameterizing each vertex in the 2D patches to 2D points on 2D plane to enable the texture mapping process.