Photometric Image Processing for Seamless 3D Texture Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating texture maps in computer-generated visual content, such as interactive video games, face challenges in producing high-quality, seamless images of three-dimensional objects under varying lighting and polarization conditions, leading to issues with detail preservation and blurring.

Innovation Solution

A lighting assembly with adjustable light sources and polarization filters, synchronized with cameras, captures a series of images using different illumination and polarization patterns, which are then processed to generate blended UV maps, reflectance, photometric normal, and albedo maps, ensuring even lighting and precise texture representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple images are captured under varying lighting and polarization conditions, then texture detail and image quality are improved, but processing complexity and time increase

Engineering Contradiction:
Improvetexture map qualityVSAvoidlighting assembly complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The lighting assembly is divided into multiple independent light sources, each capable of emitting light with different polarization states. This segmentation allows the system to capture multiple images under varying lighting and polarization conditions, improving texture map quality while managing complexity through modular design

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The lighting assembly incorporates adjustable polarization filters that can dynamically change polarization states. This dynamic capability enables the system to capture images under different polarization conditions, enhancing texture detail preservation without requiring multiple fixed lighting setups

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If multiple images are captured under varying lighting and polarization conditions, then texture detail and image quality are improved, but processing time increases

Engineering Contradiction:
Improvetexture map qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary capture of multiple images under different lighting and polarization conditions in a single coordinated session. By pre-capturing all necessary images with synchronized lighting and camera settings, the system reduces subsequent processing time while maintaining high texture map quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The lighting assembly and cameras operate in continuous coordinated cycles, capturing images under different polarization conditions without interruption. This continuous operation minimizes processing time by eliminating repeated setup and capture cycles, while still acquiring all necessary data for high-quality texture maps

Inventive Principle:
Principle #20Continuity of useful action

3Reliability

If synchronized light and camera settings are used, then image integrity is maintained, but device complexity increases

Engineering Contradiction:
Improveimage integrityVSAvoidsynchronization system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The lighting assembly integrates multiple light sources and polarization filters into a unified synchronized system controlled by a single controller. This merging of components ensures that all light sources and camera settings are coordinated, maintaining image integrity while reducing overall system complexity through centralized control

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables the creation of high-quality texture maps that preserve details and maintain image integrity, suitable for use in interactive video games, by synchronizing light and camera settings and advanced image processing techniques.

Implementation Method 1

A lighting assembly with adjustable light sources and polarization filters, synchronized with cameras, captures a series of images using different illumination and polarization patterns

Methodology Applied
Scientific EffectPolarization: Polarisation

Data Source

PatentUS11210839B2Photometric image processing
Publication Date: 2021.12.28 ELECTRONIC ARTS INC
  • US11210839B2 patent drawing
  • US11210839B2 patent drawing
  • US11210839B2 patent drawing

AI summary

An example method of photometric image processing may comprise: receiving a plurality of images of a three-dimensional object, wherein the plurality of images has been acquired by a plurality of cameras using a plurality of illumination and polarization patterns; performing color calibration of the plurality of images to produce a plurality of color-calibrated images; generating, using the plurality of color-calibrated images, a polygonal mesh simulating geometry of the three-dimensional object; producing a plurality of partial UV maps by projecting the plurality of color-calibrated images onto the polygonal mesh; generating a plurality of masks, wherein each mask of the plurality of masks is associated with a camera of the plurality of cameras, wherein the mask defines a UV space region that is covered by a field of view of the camera; blending, using the plurality of masks, the plurality of partial UV maps; and generating one or more texture maps representing the three-dimensional object.