Non-uniform Correction Illumination Pattern for Mixed Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In mixed reality systems, uniform illumination patterns projected by projectors result in non-uniform light reflection patterns received by cameras due to irregularities, leading to suboptimal image capture quality, especially when capturing objects on uneven or angled surfaces.

Innovation Solution

A calibration process is implemented to compute and apply a non-uniform correction illumination pattern, where a uniform illumination pattern is captured by the camera, inverted, and then projected during image acquisition to ensure uniform light reflection, using a projector that acts as a flash source for the camera.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a uniform illumination pattern is projected by the projector, then the lighting appears even across the work surface, but the light reflection pattern received by the camera becomes non-uniform due to lens non-uniformity and geometric non-uniformities

Engineering Contradiction:
Improveuniformity of illumination patternVSAvoiduniformity of light reflection pattern received by camera
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

The patent inverts the conventional approach by projecting a non-uniform illumination pattern that is specifically designed to compensate for the camera's non-uniform response. Instead of trying to correct the camera's lens characteristics in software, the system pre-compensates by projecting an inverted non-uniform pattern that cancels out the lens non-uniformity, resulting in uniform light reflection patterns captured by the camera.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The system changes the illumination pattern parameters from uniform to non-uniform by calculating a correction factor based on the camera's lens characteristics and geometric configuration. This correction factor is applied to adjust the illumination intensity at different positions and angles, transforming the projection from a simple uniform pattern to a compensated non-uniform pattern that ensures uniform captured images.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If the projector acts as a flash source for the camera, then image capture can be performed, but the resulting photograph may have non-uniform lighting due to the projector's inherent non-uniformity

Engineering Contradiction:
Improveimage capture capabilityVSAvoiduniformity of lighting in captured photograph
Core Design Contradiction:
ProductivityVSIllumination intensity

Solution Approach 1:

The system performs preliminary calibration to characterize the camera's lens non-uniformity and geometric properties before actual image capture. During calibration, the system captures images of a known pattern and computes correction factors that describe the non-uniform response. These pre-computed correction factors are then applied during normal operation to generate the compensated non-uniform illumination pattern, ensuring uniform lighting in captured photographs without requiring real-time complex calculations.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If calibration is performed to compute the non-uniform correction illumination pattern, then image capture quality improves, but the system complexity increases

Engineering Contradiction:
Improveimage capture qualityVSAvoidcalibration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The calibration process is designed to be self-service by having the system automatically characterize its own non-uniformities without requiring external measurement equipment or complex manual procedures. The system captures images of a known reference pattern, processes these images to extract lens distortion and non-uniformity parameters, and generates the correction illumination pattern autonomously. This self-calibration approach significantly reduces the complexity compared to manual calibration methods while maintaining high image capture quality.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances image capture quality by ensuring consistent lighting across the work surface, improving the uniformity of light reflection and resulting image quality, regardless of object placement.

Implementation Method 1

the projector's mode of operation changes from displaying an image to illuminating the work surface so as to use the projector as a lighting source for the camera

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

the light pattern received by the camera after the uniform illumination pattern reflects off of the work surface

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS9148573B2Non-uniform correction illumination pattern
Publication Date: 2015.09.29 PERIDOT PRINT LLC
  • US9148573B2 patent drawing
  • US9148573B2 patent drawing
  • US9148573B2 patent drawing

AI summary

An example system in accordance with aspects of the present disclosure includes a controller and a camera communicatively coupled to the controller to capture an image of a work surface. A projector is also provided and is coupled to the controller to project an illumination pattern onto the work surface during image capture by the camera.