Image Sensor Segmentation for Low-Power Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile device camera systems face challenges in minimizing power consumption while enabling both image capture and gesture recognition, as existing systems often require significant power for image array operation and lack efficient methods for low-power gesture detection.

Innovation Solution

The integration of additional sensing regions on the same integrated circuit as the imaging array, which operate only during gesture recognition or proximity detection, using low-power circuitry for reading and employing light-absorbing materials with electrical contacts for signal conveyance, allowing for reduced power consumption by isolating power usage between image capture and gesture recognition modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the image sensor array operates continuously to enable gesture recognition, then gesture detection capability is improved, but power consumption increases significantly

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The sensor array is divided into multiple independently controllable regions (first light sensing region and second light sensing region), allowing selective operation of only the necessary region for gesture recognition while keeping the imaging region inactive, thus reducing overall power consumption

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically switches between different operational modes: full array operation for imaging, selective region operation for gesture recognition, and complete shutdown for power saving. The control circuitry adjusts which regions are active based on the current functional requirement

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the entire image sensor array is used for gesture recognition, then gesture detection precision is improved, but image capture capability deteriorates due to power management requirements

Engineering Contradiction:
Improvegesture detection precisionVSAvoidimage capture capability
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The sensor array is segmented into distinct functional regions that can operate independently. The first light sensing region can be activated for gesture recognition while the second region remains available for imaging, allowing both functions to coexist without interfering with each other's performance

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple regions of the sensor array are designed to perform multiple functions. Each region can contribute to both imaging and gesture recognition depending on activation, providing universal functionality that maintains both image capture and gesture detection capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If additional sensing regions are integrated on the same circuit, then device complexity is reduced, but manufacturing precision requirements increase

Engineering Contradiction:
Improvesystem integration levelVSAvoidcircuit integration precision
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

Multiple functional regions (imaging and gesture sensing) are merged onto a single integrated circuit substrate. This consolidation reduces the overall system complexity by eliminating separate components and interconnections, though it requires precise manufacturing to ensure proper isolation and independent control of each region

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables low-power operation during gesture recognition, extending battery life by minimizing power consumption during non-image capture periods while maintaining effective image sensing capabilities.

Implementation Method 1

a light-absorbing material disposed over a portion of the integrated circuit... wherein the light-absorbing material absorbs light incident thereon

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS10924703B2Sensors and systems for the capture of scenes and events in space and time
Publication Date: 2021.02.16 INVISAGE TECHNOLOGIES INC
  • US10924703B2 patent drawing
  • US10924703B2 patent drawing
  • US10924703B2 patent drawing

AI summary

Various embodiments comprise apparatuses and methods including a light sensor. In one embodiment, an integrated circuit includes an image sensing array region, a first photosensor having a light-sensitive region outside of the image sensing array region, and control circuitry. The control circuitry is arranged in a first mode to read out image data from the image sensing array region, where the data provide information indicative of an image incident on the image sensing array region of the integrated circuit. The control circuitry is arranged in a second mode to read out a signal from the first photosensor indicative of intensity of light incident on the light-sensitive region of the first photosensor. Electrical power consumed by the integrated circuit during the second mode is at least ten times lower than electrical power consumed by the integrated circuit during the first mode. Additional methods and apparatuses are described.