3D Object Localization Lookup Table for Time-of-Flight Imaging

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Smart home cameras struggle to operate effectively in low ambient light conditions and are not suitable for all regions of interest, necessitating a compact, accurate, and cost-efficient imaging solution that can provide reliable image information to other smart devices.

Innovation Solution

The implementation of a time-of-flight (TOF) imaging device with signal emitters and detectors that illuminate a field of view using a modulation signal, analyzing response signals to determine voxel occupancy and derive three-dimensional imaging information, such as object locations and movements, for controlling other smart devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional 2D image sensors are used to capture detailed image information, then object detection accuracy is improved, but device complexity and power consumption increase

Engineering Contradiction:

Improveobject detection accuracyVSAvoiddevice complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The field of view is divided into multiple discrete depth ranges or zones. Instead of capturing complete 2D images, the sensor only measures depth information for specific segmented regions, reducing data complexity while maintaining detection accuracy for objects in those zones.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent extracts only the essential depth information from the optical field, discarding redundant 2D image data. By using time-of-flight measurement, only the distance to objects is captured, which is sufficient for detection purposes without requiring full image resolution.

Inventive Principle:

Principle #2Taking out (Extraction)

2Measurement precision

If traditional 2D image sensors are used to capture detailed image information, then object detection accuracy is improved, but power consumption increases

Engineering Contradiction:

Improveobject detection accuracyVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of continuously capturing full 2D images, the system performs partial measurements by only activating the depth sensor when motion is detected or when objects are expected in specific zones, reducing overall power consumption while maintaining detection capability.

Inventive Principle:

Principle #16Partial or excessive action

3Volume of moving object

If compact imaging devices are used to reduce device size, then ease of integration is improved, but measurement precision deteriorates

Engineering Contradiction:

Improvedevice sizeVSAvoiddepth measurement accuracy

Core Design Contradiction:

Volume of moving objectVSMeasurement precision

Solution Approach 1:

The patent replaces complex mechanical lens systems with a simpler time-of-flight measurement approach. By using modulated light sources and photodetectors to measure the time for light to travel to and from objects, accurate depth measurement is achieved without requiring large optical components or complex lens assemblies.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the measurement parameter from 2D spatial resolution to 1D depth measurement. This parameter change allows for compact device design while maintaining sufficient measurement precision for object detection and tracking applications.

Inventive Principle:

Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables accurate, low-power, and cost-efficient 3D imaging in smart home environments, allowing for effective object detection and gesture recognition without the need for full 2D image sensor arrays, and can be integrated into devices like smoke detectors, enhancing their functionality.

Implementation Method 1

The imaging device uses time of flight (TOF) to identify the locations of objects

Methodology Applied

Scientific EffectTime of flight: Time of Flight

Implementation Method 2

the signal detectors obtain from the field of view a response signal that reflects phase shifts of the modulation signal caused by objects in the field of view

Methodology Applied

Scientific EffectPhase shift:

Data Source

PatentUS10298912B2Generating a three-dimensional object localization lookup table

Publication Date: 2019.05.21 GOOGLE LLC

AI summary

A process executes at an electronic system. The process identifies device characteristics of an imaging device. The imaging device has signal emitters and signal detectors. The process determines a modulation signal for controlling the signal emitters to illuminate a field of view. The process partitions the field of view into a 3-dimensional plurality of voxels. According to the modulation signal and the device characteristics, the process generates unit response signals. Each unit response signal is associated with one of the voxels, and each unit response signal represents reflection from the voxel when the voxel is filled and reflects illumination generated by one of the signal emitters according to the modulation signal. The process samples the unit response signals to form unit response vectors. Each unit response vector corresponds to one of the plurality of voxels. The process then combines the unit response vectors to form the lookup table.