3D Object Localization Using Lookup Table for Smart Home Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Smart home cameras struggle to operate effectively in low ambient light conditions and are not suitable for all regions of interest, necessitating a compact, accurate, and cost-efficient imaging solution that can provide reliable image information to other smart devices.

Innovation Solution

The implementation of a time-of-flight (TOF) imaging device with signal emitters and detectors that illuminate a field of view using a modulation signal, analyzing response signals to determine voxel occupancy and derive three-dimensional imaging information, such as object locations and movements, for controlling other smart devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional 2D image sensors are used to provide detailed image information, then object location and motion detection accuracy is improved, but the device becomes more complex, consumes more power, and cannot operate effectively in low ambient light conditions

Engineering Contradiction:
Improveobject location detection accuracyVSAvoidimaging device complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the field of view into multiple discrete regions or zones, allowing the system to focus measurement resources on specific areas of interest rather than processing entire high-resolution images. This reduces computational complexity while maintaining detection accuracy for objects in targeted regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the essential depth and motion information needed for object detection using time-of-flight measurements, rather than capturing and processing complete 2D image data. This extraction approach provides sufficient accuracy for location detection while dramatically reducing device complexity and power consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

2Loss of information

If traditional 2D image sensors are used to capture detailed images, then image information quality is improved, but energy consumption increases and the device cannot operate in low light conditions

Engineering Contradiction:
Improveimage information qualityVSAvoidimaging device power consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The patent replaces traditional optical imaging mechanisms (lenses, mirrors, 2D sensor arrays) with a time-of-flight based ranging system that uses light travel time measurements. This substitution maintains the ability to detect object locations and motions while dramatically reducing power consumption and enabling operation in low ambient light conditions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the measurement parameter from intensity-based 2D image capture to time-based depth measurement. By measuring the time of flight of light signals, the system obtains accurate object location information without requiring high ambient light levels, thus reducing power consumption while maintaining information quality.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If traditional cameras are deployed in all regions of interest, then comprehensive monitoring coverage is improved, but device cost and system complexity increase

Engineering Contradiction:
Improvemonitoring coverageVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal time-of-flight imaging device that can be deployed in various regions of interest throughout the smart home environment. The same basic device architecture provides comprehensive monitoring coverage across different locations, reducing overall system complexity compared to deploying specialized cameras in each area.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables accurate, low-power, and cost-efficient 3D imaging in smart home environments, allowing for effective object tracking and gesture recognition without the need for full 2D image sensors, and can be integrated into devices like smoke detectors, enhancing their functionality.

Implementation Method 1

an imaging device uses time of flight (TOF) to identify the locations of objects

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

the signal detectors obtain from the field of view a response signal that reflects phase shifts of the modulation signal caused by objects in the field of view

Methodology Applied
Scientific EffectPhase shift:

Data Source

PatentUS10991123B2Three-dimensional object localization using a lookup table
Publication Date: 2021.04.27 GOOGLE LLC
  • US10991123B2 patent drawing
  • US10991123B2 patent drawing
  • US10991123B2 patent drawing

AI summary

A process executes at an electronic system. The process identifies device characteristics of an imaging device that includes signal emitters and signal detectors. The process illuminates a field of view by signals from the signal emitters according to a modulation signal generated by the imaging device. At each of the signal detectors, the process obtains a response signal, and samples the response signals to form a response vector. The process obtains a lookup table corresponding to the modulation signal and the device characteristics. The field of view is partitioned into a 3-dimensional plurality of voxels, and the lookup table specifies, for each voxel, expected signals received by the signal detectors when the voxel is filled and the signal emitters illuminate the field of view according to the modulation signal. The process compares the response vector to the lookup table to determine which voxels are filled.