Non-Rectangular Scan Pattern for Time-of-Flight Depth Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D mapping technologies face challenges with low scanning speed, limited resolution, and difficulty in accurately segmenting objects of interest from cluttered backgrounds, often requiring unnecessary 3D map data.

Innovation Solution

The use of a scanning beam system with an image sensor, optical transmitter, and receiver to generate a non-rectangular scan pattern over a defined area containing the object of interest, allowing for efficient 3D mapping by processing the times of flight of optical pulses and enabling user interaction for object selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a conventional rectangular scan pattern is used to cover the entire scene, then complete scene coverage is achieved, but scanning speed decreases and unnecessary data is collected

Engineering Contradiction:
Improvescanning speedVSAvoidscan area
Core Design Contradiction:
ProductivityVSArea of stationary object

Solution Approach 1:

The patent segments the scan area into a non-rectangular pattern that specifically covers regions containing objects of interest while excluding unnecessary areas. The scan pattern is divided into multiple scan lines with varying lengths that conform to the boundary of the region of interest, thereby increasing scanning speed by avoiding unnecessary areas while maintaining complete coverage of relevant objects.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by adapting the scan pattern to the specific geometry of the object or region of interest. Different portions of the scene receive different scan attention - areas containing objects of interest are scanned with appropriate resolution while areas without objects are excluded. This localized approach optimizes scanning speed without sacrificing data quality where needed.

Inventive Principle:
Principle #3Local quality

2Productivity

If the scan pattern is reduced to only cover objects of interest, then scanning speed increases, but complete scene coverage is lost

Engineering Contradiction:
Improvescanning speedVSAvoidscene coverage
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent performs preliminary action by first identifying objects of interest in the scene using image processing or user input before generating the scan pattern. This preliminary identification allows the system to pre-calculate the optimal non-rectangular scan pattern that covers all relevant objects while excluding unnecessary areas, thereby achieving both complete coverage of objects of interest and improved scanning speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent incorporates feedback mechanisms where the system continuously monitors the scene for objects of interest and dynamically adjusts the scan pattern accordingly. This feedback loop ensures that the scan pattern always covers all relevant objects while maintaining optimal scanning speed, adapting to changes in the scene without requiring complete re-scanning.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If high resolution 3D mapping is performed across the entire scene, then measurement precision improves, but processing time increases

Engineering Contradiction:
Improve3D mapping resolutionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the 3D mapping process by applying high resolution scanning only to regions containing objects of interest while using lower resolution or no scanning in areas without objects. This segmentation of the measurement process maintains high measurement precision for relevant objects while significantly reducing the total processing time by excluding unnecessary areas from high-resolution scanning.

Inventive Principle:
Principle #1Segmentation

4Adaptability or versatility

If a fixed rectangular scan pattern is used, then device complexity is reduced, but adaptability to different objects and scenes decreases

Engineering Contradiction:
Improvescan pattern flexibilityVSAvoidscan control system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamics by making the scan pattern adaptive and variable rather than fixed. The scan pattern dynamically adjusts its shape and boundaries based on the detected or user-selected objects of interest. This dynamic approach uses programmable control logic to generate different non-rectangular scan patterns as needed, providing high adaptability while maintaining manageable device complexity through software-based control.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances scanning speed and resolution, focusing resources on objects of interest while reducing unnecessary data, providing precise 3D maps with user-designated object selection capabilities.

Implementation Method 1

an optical receiver, which is configured to receive the optical pulses reflected from the scene and to generate an output indicative of respective times of flight of the pulses

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

The scanning optics include first and second scanning mirrors, which are configured to rotate in accordance with the scan pattern, wherein the first scanning mirror directs the sequence of optical pulses toward the scene along a transmit path, while the second scanning mirror directs the pulses reflected from the scene along a return path

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS9525863B2Time-of-flight depth mapping with flexible scan pattern
Publication Date: 2016.12.20 APPLE INC
  • US9525863B2 patent drawing
  • US9525863B2 patent drawing
  • US9525863B2 patent drawing

AI summary

Imaging apparatus includes an image sensor, which acquires an image of a scene, and a scanner, which includes an optical transmitter, which emits a sequence of optical pulses toward the scene, and an optical receiver, which receives the optical pulses reflected from the scene and generates an output indicative of respective times of flight of the pulses. Scanning optics are configured to scan the optical pulses over the scene in a scan pattern that covers and is contained within a non-rectangular area within the scene. A processor identifies an object in the image of the scene, defines the non-rectangular area so as to contain the identified object, and processes the output of the optical receiver so as to extract a three-dimensional (3D) map of the object.