Event Sensor Pixel Array Dynamic Power State Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Event-driven sensors continue to consume power and bandwidth even when processing less than a full set of image data, leading to inefficiencies in computational resources and power consumption, especially when cropping image data for specific regions of interest.

Innovation Solution

Implementing a hardware architecture that supports active, standby, and inactive operational states for pixels within the sensor, where feedback information from an image pipeline dynamically adjusts the operational state of each pixel based on the region of interest, allowing for reduced power consumption and bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If image data is cropped to process only regions of interest, then computational efficiency is improved, but pixels outside the cropped region continue to consume power

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The sensor array is divided into multiple independently controllable blocks or regions. Each region can be independently activated or deactivated based on whether it corresponds to the region of interest. This segmentation allows the system to process only relevant portions of the scene while powering down unnecessary pixels, directly resolving the contradiction between computational efficiency and power consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the operational state of pixel regions based on feedback from the image processing pipeline. When a region is determined to be outside the region of interest, the system transitions those pixels to a low-power state. This dynamic adaptation allows the sensor to optimize power consumption in real-time based on actual processing needs, maintaining computational efficiency while reducing unnecessary power consumption.

Inventive Principle:
Principle #15Dynamics

2Reliability

If all pixels operate continuously to capture full image data, then complete scene coverage is maintained, but power consumption increases

Engineering Contradiction:
Improvescene coverageVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by stationary object

Solution Approach 1:

A feedback mechanism is implemented where the image processing pipeline communicates with the sensor control to inform which regions are currently of interest. Based on this feedback, the system adjusts the operational state of pixel regions accordingly. This feedback loop ensures that scene coverage is maintained for relevant areas while reducing power consumption by deactivating irrelevant regions, thus resolving the contradiction between reliability and energy usage.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes the operational parameter (power state) of pixel regions based on their relevance to the current region of interest. Pixels in regions of interest operate at full power to maintain scene coverage and detection accuracy, while pixels outside these regions transition to low-power states. This parameter change strategy maintains reliability for critical areas while reducing overall power consumption.

Inventive Principle:
Principle #35Parameter changes

3Use of energy by moving object

If feedback loop is implemented to dynamically adjust pixel states, then power efficiency is improved, but system complexity increases

Engineering Contradiction:
Improvepower efficiencyVSAvoidsystem complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The sensor is segmented into independently controllable blocks that can be managed separately. This segmentation simplifies the feedback control mechanism, as the system only needs to track and control which blocks are active rather than managing individual pixels. The segmentation approach reduces system complexity while maintaining the power efficiency benefits of dynamic region adjustment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system is designed to automatically adjust pixel power states based on region of interest information without requiring complex external control. The sensor and processing pipeline work together in a coordinated manner where the processing pipeline provides region information and the sensor automatically configures its active regions. This self-service approach reduces the need for complex external control systems while maintaining power efficiency.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3949381B1Sensor system architecture with feedback loop and multiple power states
Publication Date: 2024.07.24 APPLE INC
  • EP3949381B1 patent drawingFigure 1
  • EP3949381B1 patent drawingFigure 2~3
  • EP3949381B1 patent drawingFigure 4~5

AI summary

In one implementation, a system includes an event sensor with a pixel array and an image pipeline. The pixel array is configured to operate a first subset of pixels in an active state and a second subset of pixels in an inactive state. The event sensor is configured to output pixel events. Each respective pixel event is generated in response to a specific pixel within the first subset of pixels detecting a change in light intensity that exceeds a comparator threshold. The image pipeline is configured to consume image data derived from the pixel events and communicate feedback information to the event sensor based on the image data. The feedback information causes a pixel within the first subset of pixels to transition from the active state to another state