3D Image Lighting Correction via Depth Map Standardization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods lack standardized techniques for enhancing three-dimensional (3-D) images captured under sub-optimal lighting conditions, such as glare or dim lighting, which hinders effective lighting adjustments and depth-based lighting corrections in 3-D images.

Innovation Solution

The approach involves extracting depth and texture information from 3-D images, generating a standardized depth map format, and using vector analysis to determine original light source positions and colors, allowing for adjustments and additions of new lighting effects through standard computer graphics methods like OpenGL or DirectX.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If standard computer graphics methods are used to enhance 3D images, then lighting effects can be changed, but there are no suitable standardized methods to change 3-D lighting or remove effects of sub-optimal lighting conditions

Engineering Contradiction:
Improvelighting adjustment capabilityVSAvoidmethod standardization
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal standardized method that works across different 3D imaging systems and platforms. By defining a common depth map format and standardized processing pipeline, the solution enables lighting enhancement capabilities to be applied universally to various 3D images regardless of source, resolving the contradiction between adaptability and standardization complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent transforms sub-optimal lighting conditions by changing key parameters: it extracts depth information to create standardized depth maps, analyzes light source characteristics (position, color, intensity), and applies corrected lighting parameters to generate enhanced images. This systematic parameter transformation approach enables consistent lighting correction across different scenarios

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If depth information is extracted and processed to produce point cloud or depth map, then 3D polygonal mesh can be generated, but lack of standardized depth map format prevents effective lighting adjustments

Engineering Contradiction:
Improvedepth map standardizationVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The patent performs preliminary standardization of depth maps before lighting enhancement is needed. By defining the standardized depth map format upfront and pre-processing depth information into this format, the system eliminates the need for repeated standardization efforts, making subsequent lighting adjustments easier and more consistent

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The standardized depth map serves as an intermediary between raw depth information and lighting enhancement processes. This intermediate representation format enables seamless integration between depth extraction from various sources and lighting correction algorithms, bridging the gap between different system components

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If vector analysis is used to determine light source positions and colors, then precise lighting adjustments can be made, but requires standardized depth map format and texture information

Engineering Contradiction:
Improvelight source detection accuracyVSAvoiddata format standardization
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality analysis by examining specific regions in the 3D image to determine light source characteristics. By analyzing texture sections and corresponding surface mesh sections with different color intensities locally, the system accurately identifies light source positions and properties without requiring complex global analysis

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP2939216B1Apparatus for enhancement of 3-d images using depth mapping and light source synthesis
Publication Date: 2018.01.31 INTEL CORP
  • EP2939216B1 patent drawingFigure 1
  • EP2939216B1 patent drawingFigure 2
  • EP2939216B1 patent drawingFigure 3

AI summary

An apparatus for enhancing a 3-D image illuminated by a light source and having associated depth and texture information includes generating from the depth information a surface mesh having surface mesh sections. Texture sections corresponding to the surface mesh sections are determined from the texture information. The texture sections are ranked based upon their color intensity, and the characteristics of one or more light sources are adjusted to alter the color intensity of the ranked texture sections to thereby produce an enhanced image.