3D Textured Mesh Material Segmentation for Accurate Material Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional material map generation techniques struggle to accurately identify virtual materials on textured meshes with complex three-dimensional features, leading to visual inaccuracies and computational inefficiencies in editing virtual environments.

Innovation Solution

A material segmentation system that uses a k-nearest neighbors matting algorithm to compare three-dimensional positions, color values, and normal properties of pixels to identify and segment regions of textured meshes, generating a material map that accurately segments virtual materials.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional material map generation techniques are used, then the process is simple, but the accuracy of identifying virtual materials on textured meshes with complex three-dimensional features deteriorates

Engineering Contradiction:
Improveaccuracy of identifying virtual materialsVSAvoidcomplexity of material map generation process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The algorithm segments the textured mesh by dividing it into multiple regions based on material type. It processes the mesh in segments, comparing pixel properties within each segment to identify and categorize different virtual materials, thereby improving measurement precision without requiring a complete overhaul of the generation process

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent incorporates three-dimensional position information as an additional dimension for material identification. By comparing the three-dimensional positions of pixels along with color and normal properties, the algorithm achieves more accurate material segmentation on complex textured meshes, resolving the contradiction between accuracy and complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If conventional material map generation techniques are used, then the computational process is fast, but visual inaccuracies increase

Engineering Contradiction:
Improvevisual accuracy of material identificationVSAvoidcomputational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The algorithm changes the parameters used for material identification by incorporating three-dimensional position data alongside traditional color and normal properties. This parameter expansion improves visual accuracy by providing more discriminative features for material classification, while the efficient algorithmic implementation maintains computational productivity

Inventive Principle:
Principle #35Parameter changes

3Productivity

If conventional material map generation techniques are used, then the processing is quick, but power consumption increases due to inefficiencies

Engineering Contradiction:
Improveprocessing speedVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The algorithm optimizes processing by having each pixel comparison serve multiple purposes - determining material type, establishing segment boundaries, and validating consistency with adjacent regions. This self-service approach improves processing speed while reducing redundant computations, thereby lowering power consumption

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20260024218A1Segmenting regions of virtual materials
Publication Date: 2026.01.22 ADOBE INC
  • US20260024218A1 patent drawing
  • US20260024218A1 patent drawing
  • US20260024218A1 patent drawing

AI summary

In implementation of techniques for segmenting regions of virtual materials, a computing device implements a material segmentation system to receive a textured mesh representing multiple virtual materials. The material segmentation system also receives an input including a marker identifying one or more regions of the textured mesh corresponding to a material type. Using an algorithm, the material segmentation system generates a material map that segments the material type from other material types of the multiple virtual materials by identifying an additional region of the textured mesh corresponding to the material type by comparing three-dimensional positions of pixels of the textured mesh and categorizing pixels of the one or more regions of the textured mesh together with pixels of the additional region of the textured mesh. The material segmentation system then presents the material map in a user interface.