3D Entity Lighting Data Generation via Mesh Simplification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Generating realistic lighting data for three-dimensional computer-generated characters in real-time is computationally expensive, especially when considering self-shadowing and sub-surface scattering, which existing methods often approximate or ignore, leading to inaccuracies.

Innovation Solution

A method that simplifies a mesh representation by removing translucent vertices and defines cone-shaped regions for each vertex using non-intersecting rays, allowing for efficient interpolation of lighting parameters, which are then used to calculate lighting contributions, incorporating self-shadowing and sub-surface scattering effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If ray-tracing is used to generate shadows and lighting data for three-dimensional characters, then lighting accuracy and visual fidelity are improved, but computational cost and processing time increase significantly

Engineering Contradiction:
Improvelighting accuracyVSAvoidcomputational cost
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent segments the complex ray-tracing problem into two distinct phases: an offline preprocessing phase where accurate lighting data is pre-calculated and stored in a simplified mesh structure, and a real-time rendering phase where this pre-computed data is efficiently applied. This segmentation allows the computationally intensive accuracy work to be done once offline, while real-time performance requirements are met through efficient data retrieval and application.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by pre-calculating all lighting data, shadow information, and angular parameters offline before the actual real-time rendering occurs. The offline phase computes cone-shaped regions, angular parameters, and lighting contributions for each vertex, storing them in an optimized data structure that enables rapid access during real-time character animation and rendering.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If full mesh processing is performed for lighting calculation, then lighting accuracy is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvelighting accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts only the essential lighting and shadow information needed for realistic rendering, storing it in a simplified mesh structure with pre-computed angular parameters and cone-shaped regions. By extracting and pre-storing only the critical lighting data rather than performing complete mesh processing during real-time rendering, the system achieves accurate lighting effects with minimal real-time computational overhead.

Inventive Principle:
Principle #2Taking out (Extraction)

3Speed

If real-time lighting generation is implemented for moving characters, then interactivity and responsiveness are improved, but lighting accuracy and visual fidelity deteriorate due to computational limitations

Engineering Contradiction:
Improvereal-time processing speedVSAvoidlighting accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent performs preliminary action by pre-calculating all lighting data, shadow information, and angular parameters offline before the actual real-time rendering occurs. The offline phase computes cone-shaped regions, angular parameters, and lighting contributions for each vertex, storing them in an optimized data structure that enables rapid access during real-time character animation and rendering.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a simplified copy of the mesh structure that contains pre-computed lighting data, angular parameters, and cone-shaped region information. This simplified mesh copy serves as a lookup table during real-time rendering, allowing the system to achieve realistic lighting effects by efficiently querying pre-stored data rather than performing complex calculations on the full original mesh during real-time operation.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10388061B2Generation of lighting data for a three-dimensional entity
Publication Date: 2019.08.20 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10388061B2 patent drawing
  • US10388061B2 patent drawing
  • US10388061B2 patent drawing

AI summary

A method of automatically generating lighting data for a three-dimensional computer generated entity is described. A mesh representation of at least a part of the entity is received and simplified by removing vertices from the mesh. For each vertex in the simplified mesh, a plurality of rays are propagated from the vertex and a cone-shaped region is then defined for the vertex using those of the plurality of rays that do not intersect with the simplified mesh, wherein the cone-shaped region is defined in terms of a vector and an angular parameter. An angular parameter and a vector for each vertex in the received mesh is then calculated by interpolating the angular parameters and vectors for each vertex in the simplified mesh and lighting data is output, the lighting data comprising the angular parameter and vector for each vertex in the received mesh.