Neural Network Material Map Generation for Realistic Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating material maps in digital graphical environments fail to produce highly realistic appearances of graphical objects, as they rely on naive reduction methods that do not preserve visual features and are not responsive to the texture's appearance, leading to suboptimal rendering quality.

Innovation Solution

An appearance-responsive material map generation system utilizing a neural network that identifies features contributing to a realistic appearance, generating a set of material maps with varying resolutions, sizes, and data characteristics, arranged as an inconsistent pyramid, to create a more realistic and efficient rendering of graphical objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If precalculated material maps are generated using naive reduction methods, then computing resources are reduced, but visual features and rendering quality are not preserved

Engineering Contradiction:
Improvecomputing resourcesVSAvoidrendering quality
Core Design Contradiction:
Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The patent changes the parameters of material map generation by using a neural network to learn and preserve appearance characteristics at different resolutions. Instead of uniform naive reduction, the system adapts the material map generation process based on appearance importance, transforming how material maps are created across different scales while maintaining visual fidelity where it matters most

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies preliminary action by precalculating appearance-responsive material maps at multiple resolutions before runtime. The neural network is trained offline to learn the relationship between high-resolution and low-resolution material maps, enabling fast rendering during gameplay without sacrificing appearance quality. This preliminary preparation resolves the contradiction between computing resources and rendering quality

Inventive Principle:
Principle #10Preliminary action

2Speed

If material maps are reduced in size and detail sequentially, then rendering speed is improved, but visual features of source material data are not preserved

Engineering Contradiction:
Improverendering speedVSAvoidvisual features
Core Design Contradiction:
SpeedVSLoss of information

Solution Approach 1:

The patent transforms the material map reduction process by changing how resolution parameters are handled. Instead of uniform sequential reduction that loses visual features, the system uses appearance-responsive parameters that adaptively preserve important visual characteristics. The neural network learns which visual features are critical and maintains them across different resolution levels, enabling fast rendering without information loss

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies local quality by making different regions of material maps have different levels of detail based on appearance importance. Critical visual features receive higher preservation priority while less important areas can be more aggressively downsampled. This localized approach to quality preservation enables rendering speed improvement without losing essential visual information

Inventive Principle:
Principle #3Local quality

3Loss of time

If precalculated material maps are generated using contemporary techniques, then processing time is reduced, but appearance responsiveness and realism are compromised

Engineering Contradiction:
Improveprocessing timeVSAvoidappearance realism
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent resolves this contradiction by performing preliminary action during an offline training phase. The neural network is trained in advance on pairs of high-resolution and low-resolution material maps to learn appearance preservation. This preliminary training enables the system to quickly generate appearance-responsive material maps at runtime without compromising realism, as the complex processing has already been optimized beforehand

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent substitutes the traditional mechanical approach of uniform downsampling with a neural network-based system. Instead of relying on conventional resizing algorithms that sacrifice appearance quality, the system uses learned transformations that preserve visual realism. This substitution replaces rigid mechanical reduction with adaptive intelligent processing that maintains appearance responsiveness

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11961188B2Neural networks to generate appearance-responsive material map sets in digital graphical environments
Publication Date: 2024.04.16 ADOBE INC
  • US11961188B2 patent drawing
  • US11961188B2 patent drawing
  • US11961188B2 patent drawing

AI summary

An appearance-responsive material map generation system generates a set of material maps based on the appearance of a material depicted in the source material data. A neural network included in the appearance-responsive material map generation system is trained to identify features of particular source material data, such as features that contribute to a highly realistic appearance of a graphical object rendered with the material depicted in the source material data. In some cases, the trained neural network receives source material data that includes at least one source material map. Based on the features that are identified for the particular source material data, the appearance-responsive material map generation system creates a respective set of appearance-responsive material maps for the particular source material data. In some cases, the appearance-responsive rendering map set is arranged as an inconsistent pyramid of material maps.