Multi-Spectral Rendering via Material Translation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current high-quality rendering engines are constrained to three colors (RGB) and are resource-intensive to expand for multi-spectral rendering, which hampers the ability to render assets across the electromagnetic spectrum, including infrared and ultraviolet bands, due to their inability to handle additional color and spectral bands effectively.

Innovation Solution

The solution involves reusing color channels for additional spectral bands by assigning material spectral band data sets to 3D mesh assets, using a material translator to abstract material properties and manage asset material information efficiently, allowing for multi-spectral rendering by leveraging legacy rendering technology and creating datasets for sensors that capture signals from different electromagnetic bands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a new rendering engine is created to handle additional spectral bands (IR, UV), then multi-spectral rendering capability is improved, but resource consumption and development cost increase significantly

Engineering Contradiction:
Improvespectral band coverageVSAvoidcomputational resources
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent makes the existing RGB rendering engine universal by enabling it to handle multiple spectral bands (RGB, IR, UV) through a material translation layer. The same rendering engine processes different spectral bands by translating material properties to appropriate spectral representations, eliminating the need for separate specialized engines for each band while maintaining multi-spectral capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a material translator as an intermediary component between the asset pipeline and the rendering engine. This translator converts material definitions into spectral band-specific data sets that the existing renderer can process. The intermediary layer enables multi-spectral rendering without modifying the core rendering engine, thus avoiding resource-intensive re-engineering.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If artists create assets using traditional mesh and texture mapping, then asset creation workflow is maintained, but multi-spectral rendering capability is lost

Engineering Contradiction:
Improveasset creation workflowVSAvoidspectral band support
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system enables artists to continue using traditional mesh and texture workflows while the material translator automatically handles the conversion to multi-spectral formats. The translator serves itself by reading standard material definitions and generating appropriate spectral band data sets without requiring artist intervention or retraining, thus maintaining ease of operation while gaining spectral versatility.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent transforms material properties from traditional RGB color space parameters to spectral band-specific parameters through the material translator. This parameter transformation allows the same asset creation workflow to produce materials that work across multiple spectral bands by changing how material properties are represented and interpreted during rendering.

Inventive Principle:
Principle #35Parameter changes

3Ease of manufacture

If legacy rendering technology is reused for multi-spectral rendering, then resource investment is reduced, but direct spectral band support is limited

Engineering Contradiction:
Improveimplementation costVSAvoidspectral band handling
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The material translator acts as an intermediary that bridges legacy rendering technology and multi-spectral requirements. It translates material properties into formats that legacy engines can process, enabling IR and UV band rendering through the same rendering pipeline used for RGB, thus reducing implementation costs while extending spectral capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent makes the legacy rendering engine universal by enabling it to handle multiple spectral bands through a unified material translation approach. The same rendering code processes RGB, IR, and UV bands by interpreting translated material properties appropriately for each band, eliminating the need for band-specific rendering paths and reducing overall implementation complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11315300B2Multi-spectral rendering for synthetics
Publication Date: 2022.04.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11315300B2 patent drawing
  • US11315300B2 patent drawing
  • US11315300B2 patent drawing

AI summary

Systems and methods are disclosed for leveraging rendering engines to perform multi-spectral rendering by reusing the color channels for additional spectral bands. A digital asset represented by a three dimensional (3D) mesh and a material reference pointer may be rendered using a first material spectral band data set and additionally rendered using a second material spectral band data set, and the results combined to create a multi-spectral rendering. The multi-spectral rendering may then be used as part of a synthetics service or operation. By abstracting the material properties, a material translator is able to return a banded material data set from among a plurality of spectral band sets, and asset material information may advantageously be managed apart from managing each asset individually.