3D Mapping Using Projected Spot Patterns

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing optical 3D mapping methods are inefficient and inaccurate due to the need for complex setups and moving parts, particularly when attempting to reconstruct 3D maps quickly and accurately using laser speckle patterns or other projection methods.

Innovation Solution

A system that projects a pattern of spots onto an object using a single, stationary transparency and a stationary image capture assembly, with a processor to reconstruct a 3D map from images captured at a fixed location, utilizing uncorrelated patterns such as pseudo-random or quasi-periodic patterns to enhance accuracy and speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If laser speckle patterns are used for 3D mapping, then measurement precision can be improved, but device complexity and the need for moving parts increases

Engineering Contradiction:
Improve3D mapping accuracyVSAvoidsystem setup complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the essential function of pattern projection by using a simple transparency with fixed spots instead of complex laser speckle generation systems. The transparency contains a predetermined arrangement of spots that can be projected using ordinary light sources, eliminating the need for coherent light sources and diffusers while maintaining the ability to measure depth through pattern displacement.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The invention replaces expensive, complex laser speckle patterns with a simple, inexpensive transparency containing fixed spots. This transparency can be easily manufactured and replaced if needed, providing a cost-effective solution that maintains functional equivalence for 3D mapping purposes without requiring sophisticated optical components.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

2Measurement precision

If complex projection patterns are used for 3D reconstruction, then measurement precision improves, but productivity decreases due to complex setup and processing

Engineering Contradiction:
Improve3D reconstruction accuracyVSAvoidreconstruction speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the projection pattern into discrete, fixed spots arranged in a predetermined pattern on the transparency. This segmentation allows for simpler projection and image capture compared to continuous laser speckle patterns, reducing the computational complexity of processing while maintaining sufficient precision for 3D reconstruction through spot displacement analysis.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The transparency is pre-configured with a fixed pattern of spots before use. This preliminary arrangement eliminates the need for real-time pattern generation or complex setup during the 3D mapping process, allowing for rapid acquisition of depth information through simple image capture and processing of the projected spot pattern.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If stationary transparency with fixed pattern is used, then device complexity is reduced, but adaptability to different objects may be limited

Engineering Contradiction:
Improvesetup simplicityVSAvoidobject mapping flexibility
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The transparency with its fixed spot pattern serves multiple functions: it can project patterns onto various types of objects (flat surfaces, curved surfaces, three-dimensional objects), and the same basic setup can be used for different applications including 3D mapping, object recognition, and motion analysis. The universal applicability stems from the ability to capture and process spot displacement patterns on any object surface.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables fast and accurate 3D reconstruction of objects using a simple, cost-effective setup, capable of capturing object movement and gestures, with improved signal-to-noise ratio and reduced computational complexity.

Implementation Method 1

a light source, which is configured to transilluminate the single transparency with optical radiation so as to project the pattern onto the object

Methodology Applied
Scientific EffectOptical radiation transmission: Light

Implementation Method 2

an image capture assembly, which is configured to capture an image of the pattern that is projected onto the object using the single transparency

Methodology Applied
Scientific EffectOptical image capture: Photography

Data Source

PatentUS8150142B2Depth mapping using projected patterns
Publication Date: 2012.04.03 APPLE INC
  • US8150142B2 patent drawing
  • US8150142B2 patent drawing
  • US8150142B2 patent drawing

AI summary

Apparatus for mapping an object includes an illumination assembly, which includes a single transparency containing a fixed pattern of spots. A light source transilluminates the single transparency with optical radiation so as to project the pattern onto the object. An image capture assembly captures an image of the pattern that is projected onto the object using the single transparency. A processor processes the image captured by the image capture assembly so as to reconstruct a three-dimensional (3D) map of the object.