Event-Based Vision Sensor Standby Power Management

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Mobile devices face challenges in consuming minimal power in standby mode while performing smart functions, as existing solutions are limited to simple acceleration sensors due to power constraints, restricting the use of power-intensive components like cameras and displays.

Innovation Solution

An event-based vision sensor system that operates in two modes: a low power mode for sub-sampling and a normal power mode for full-sampling, allowing for efficient object recognition by controlling pixel sampling and outputting event signals only when necessary, thereby reducing power consumption and enabling face recognition for device unlocking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a camera module or display is used in standby mode to perform smart functions, then the functionality and intelligence of the device is improved, but the power consumption increases significantly

Engineering Contradiction:

Improvesmart function capabilityVSAvoidpower consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The pixel array is divided into multiple blocks, with only one block actively performing sampling at a time while other blocks remain inactive. This segmentation allows the sensor to maintain the capability of full-resolution imaging while consuming minimal power during standby mode, as only a small portion of the total pixels are active at any given moment

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system dynamically switches between different operating modes: in standby mode, only a subset of pixels in one block performs sampling to conserve power, while in active mode, all pixels across all blocks are activated for full functionality. This dynamic adaptation allows the device to optimize power consumption based on the current operational requirements

Inventive Principle:

Principle #15Dynamics

2Measurement precision

If an event-based vision sensor operates in full-sampling mode to ensure high image quality, then the measurement precision is improved, but the power consumption increases

Engineering Contradiction:

Improveimage qualityVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

During standby mode, the system performs partial sampling by activating only a subset of pixels in one block rather than all pixels across the entire array. This partial action is sufficient to detect significant events or changes in the environment, maintaining adequate measurement precision for standby operations while dramatically reducing power consumption compared to full-sampling mode

Inventive Principle:

Principle #16Partial or excessive action

3Use of energy by moving object

If the event-based vision sensor blocks pixels from sampling to reduce power consumption, then the power usage is reduced, but the object recognition capability may be degraded

Engineering Contradiction:

Improvepower consumptionVSAvoidobject recognition accuracy

Core Design Contradiction:

Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The system continuously monitors event signals from the active pixel block and uses this feedback to determine when to switch between standby and active modes. When the number of detected events exceeds a threshold or when specific recognition conditions are met, the system activates additional blocks to maintain recognition accuracy, thus adapting the sampling capacity based on actual environmental demands rather than operating at fixed capacity

Inventive Principle:

Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables effective object recognition with minimal power consumption, allowing mobile devices to perform face recognition and unlock functions efficiently in standby mode without excessive power usage, enhancing their functionality and battery life.

Implementation Method 1

The event-based vision sensor may include a plurality of pixels and output an event signal corresponding to a pixel detecting a change in light or a movement of an object among the plurality of pixels

Methodology Applied

Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS9875390B2Method and apparatus for recognizing object

Publication Date: 2018.01.23 SAMSUNG ELECTRONICS CO LTD

AI summary

A method of recognizing an object includes controlling an event-based vision sensor to perform sampling in a first mode and to output first event signals based on the sampling in the first mode, determining whether object recognition is to be performed based on the first event signals, controlling the event-based vision sensor to perform sampling in a second mode and to output second event signals based on the sampling in the second mode in response to the determining indicating that the object recognition is to be performed, and performing the object recognition based on the second event signals.