3D Sensing Reference Image Speckle Reduction via Dynamic Motion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Three-dimensional mapping systems using reference images face challenges with secondary speckles caused by non-specularity or roughness in calibration objects, which degrade the quality of reference images and make it difficult to remove these effects digitally.

Innovation Solution

The method involves projecting a pattern of coherent radiation onto a reference surface and applying relative motion between the device and the surface or the surface itself to average out the effects of secondary speckles, while capturing and registering multiple images to generate an enhanced reference image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a reference image is captured using coherent radiation projected onto a calibration surface, then the reference image quality should be high, but secondary speckles are generated due to non-specularity or roughness in the calibration surface which degrade the image quality

Engineering Contradiction:
Improvereference image qualityVSAvoidsecondary speckles
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent applies dynamic motion between the imaging device and the calibration surface during reference image capture. By moving either the device or the surface relative to each other while capturing the reference image, the system averages out the secondary speckle effects that would otherwise degrade image quality. This dynamic approach transforms a static speckle problem into a solvable motion-averaging process.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements periodic motion of the imaging device or calibration surface during reference image acquisition. By oscillating or moving the components in a periodic manner and capturing multiple images at different positions, the system systematically averages out the speckle patterns over time, eliminating their harmful effects while preserving the reference image quality needed for accurate 3D mapping.

Inventive Principle:
Principle #19Periodic action

2Illumination intensity

If coherent radiation is used for projection, then the pattern visibility is improved, but secondary speckles are generated that are difficult to remove digitally

Engineering Contradiction:
Improvepattern visibilityVSAvoidsecondary speckles
Core Design Contradiction:
Illumination intensityVSObject-generated harmful factors

Solution Approach 1:

The patent maintains the benefits of coherent radiation for pattern visibility while eliminating secondary speckles through dynamic motion during capture. By moving the imaging device or calibration surface relative to each other during the exposure period, the system averages out the speckle effects that would otherwise be difficult to remove digitally, thus preserving both pattern visibility and image quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent converts the harmful secondary speckle effect into a beneficial averaging process. By intentionally introducing motion during reference image capture, the system transforms the problematic speckle patterns into a useful mechanism for eliminating speckle artifacts, thereby converting a harmful effect into a solution that enhances reference image quality.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Adaptability or versatility

If the calibration surface is made non-specular or rough, then the pattern projection is improved, but secondary speckles are generated that degrade reference image quality

Engineering Contradiction:
Improvepattern projection capabilityVSAvoidreference image quality
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent enables the use of non-specular or rough calibration surfaces for improved pattern projection by introducing dynamic motion during reference image capture. The relative motion between the imaging device and calibration surface averages out the secondary speckles generated by the surface properties, allowing the system to maintain both projection capability and reference image quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent converts the secondary speckle problem into a solution by using motion averaging. The harmful speckle effects generated by non-specular or rough surfaces are transformed into a beneficial averaging process through intentional motion during capture, allowing the system to leverage surface properties for better pattern projection while eliminating the associated speckle degradation.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the quality of the reference image by reducing the impact of secondary speckles, allowing for more accurate three-dimensional mapping by measuring local transverse shifts in test images relative to the improved reference image.

Implementation Method 1

capturing a reference image of the pattern using an image sensor

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS9386299B2Reference image techniques for three-dimensional sensing
Publication Date: 2016.07.05 APPLE INC
  • US9386299B2 patent drawing
  • US9386299B2 patent drawing
  • US9386299B2 patent drawing

AI summary

A method including providing a device that projects a pattern of coherent radiation. The method further includes capturing a reference image of the pattern using an image sensor by projecting the pattern of the coherent radiation onto a reference surface and engendering a relative motion between the reference surface and the image sensor while capturing the reference image. The method also includes storing the reference image in a memory associated with the device.