Remote Image Correction via 3D Illumination Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image capture systems face challenges with non-uniform illumination of objects at a distance, leading to issues like unwanted reflections and insufficient contrast due to the spatial distribution of light sources and varying object positions, which complicates image processing, especially in biometric and document recognition applications.

Innovation Solution

A method involving a 3D modeling system to estimate the object's position and simulate the illumination, allowing for correction of image intensity based on a 3D model, lighting distribution, and reflection characteristics to achieve uniform illumination representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the object is presented at a distance from the imager and light source, then the system has greater flexibility in object positioning, but the illumination becomes non-uniform leading to unwanted reflections and insufficient contrast

Engineering Contradiction:
Improveobject positioning flexibilityVSAvoidillumination uniformity
Core Design Contradiction:
Adaptability or versatilityVSIllumination intensity

Solution Approach 1:

The patent applies parameter changes by using a 3D model of the object to calculate and adjust illumination parameters for each pixel. The system computes expected light intensity based on object geometry, material properties, and light source characteristics, then uses these calculated parameters to correct the captured image and achieve uniform illumination representation

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent transitions from 2D image capture to 3D modeling and calculation. By creating and utilizing a 3D model of the object, the system can compute illumination characteristics from multiple dimensions and perspectives, allowing for accurate correction of non-uniform illumination effects in the final 2D image

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Length of stationary object

If the light source illuminates the object from a distance, then the spatial distribution of light causes non-uniform illumination, but moving the light source closer would create other illumination issues

Engineering Contradiction:
Improvedistance between light source and objectVSAvoidillumination uniformity
Core Design Contradiction:
Length of stationary objectVSManufacturing precision

Solution Approach 1:

The patent introduces a computational intermediary - a processing unit that calculates the expected illumination based on 3D models and light source characteristics. This computational mediator allows the system to maintain the beneficial distance between light source and object while correcting for the non-uniform illumination through image processing

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a computational copy or model of the object in 3D space, which is then used to simulate and calculate the illumination pattern. This virtual model allows the system to predict and correct illumination effects without physically moving the light source or object

Inventive Principle:
Principle #26Copying

3Duration of action of moving object

If the object position changes from one image capture to another, then the system can capture dynamic scenes, but the non-uniform illumination varies with position making consistent image processing difficult

Engineering Contradiction:
Improvedynamic scene capture capabilityVSAvoidimage processing consistency
Core Design Contradiction:
Duration of action of moving objectVSReliability

Solution Approach 1:

The patent implements dynamics by using real-time 3D modeling and illumination calculation that adapts to the object's current position and orientation. The system dynamically updates the illumination model based on the captured image and object geometry, allowing consistent image processing despite changing object positions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent employs feedback by using the captured image and 3D model to calculate the actual illumination pattern, then applying this information to correct the image. This closed-loop approach ensures that each image is processed according to its specific illumination conditions, maintaining consistency across dynamic scenes

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances image quality by simulating and correcting non-uniform illumination, improving contrast and reliability for further image processing tasks such as character recognition, by representing the image as if it were taken under uniform lighting conditions.

Implementation Method 1

a simulation unit (36) designed to simulate an image IS of the object 40 as it is at time T0, on the basis of said 3D model, a model of the illumination of the object 40 by the lighting system (20), a reflection model of the object 40 or each part of the object 40 that can be captured by the imager (10), and a model of the imager (10)

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP3073441B1Method for correcting an image of at least one object presented remotely to an imager and illuminated by an illumination system and camera system for carrying out said method
Publication Date: 2019.07.10 IDEMIA IDENTITY & SECURITY FRANCE SAS
  • EP3073441B1 patent drawingFigure 1
  • EP3073441B1 patent drawingFigure 2
  • EP3073441B1 patent drawingFigure 3

AI summary

The present invention relates to a method for correcting an image of an object presented at a distance taken by an imager, said object being illuminated by means of a lighting system.It is characterized in that it comprises the following steps: - a step (E10) of estimating a 3D model of the object as it is at the time of image acquisition by said imager, - a step (E20) of image simulation consisting of simulating the image acquired by said imager, using said 3D model thus estimated, a model of the lighting of the object by said lighting system, a model of reflection on the surface of an object and a model of said imager, in order to obtain a simulated image of said object, and - a step (E30) of correcting the image acquired by said imager consisting of modifying the light intensity of each point of the image or of at least one area of ​​interest of the image actually acquired by the imager as a function of the light intensity of the corresponding point in the simulated image or the respective light intensities of points near said corresponding point in the simulated image.The present invention also relates to a camera system for implementing said method.