Event Sensor Pixel Power State Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Event-driven sensors consume power and bandwidth even when processing less than a full set of image data, leading to inefficiency in image processing operations.

Innovation Solution

Implementing a hardware architecture that supports active, standby, and inactive operational states for pixels, where the operational state of each pixel is modified based on feedback information from an image pipeline, allowing for dynamic power management and reduced bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If image processing operations utilize less than a full set of image data by cropping, then computational efficiency is improved, but pixels corresponding to external image data continue to operate and consume power

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by differentiating the operational state of different pixel regions based on their relevance to the cropped image data. Pixels within the cropped region maintain full operational capability while pixels outside the cropped region transition to lower power states, creating spatially varying operational characteristics that match the actual processing needs

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamics by enabling pixels to dynamically transition between multiple operational states (full power, reduced power, sleep) based on real-time feedback about whether their output data is being consumed by the image processing pipeline. This dynamic state adjustment allows the system to adapt power consumption to actual computational requirements

Inventive Principle:
Principle #15Dynamics

2Speed

If pixels continue to operate to maintain readiness for future image data, then response time is improved, but unnecessary data is generated increasing bandwidth usage

Engineering Contradiction:
Improveresponse timeVSAvoidbandwidth usage
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The patent applies periodic action by implementing a feedback loop that periodically assesses whether pixel data is being consumed and adjusts operational states accordingly. The system oscillates between different power states based on periodic feedback signals from the image processing pipeline, enabling pixels to enter low-power modes when not needed and activate when data is required

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent implements feedback mechanisms where the image processing pipeline signals back to the sensor which pixels should remain active and which can enter low-power states. This feedback loop allows the system to maintain optimal response time for relevant pixels while reducing bandwidth usage by keeping unrelated pixels in inactive states

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces power consumption and bandwidth usage by transitioning pixels to inactive or standby states when not needed, improving computational efficiency and reducing unnecessary data processing.

Implementation Method 1

The photodetector circuit is configured to generate pixel data indicative of an intensity of incident illumination. The event circuit is configured to generate event data when the pixel data indicates that the photodetector circuit has detected a change in light intensity that exceeds a comparator threshold.

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11856305B2Hardware implementation of sensor architecture with multiple power states
Publication Date: 2023.12.26 APPLE INC
  • US11856305B2 patent drawing
  • US11856305B2 patent drawing
  • US11856305B2 patent drawing

AI summary

In one implementation, an event sensor includes a plurality of pixels and an event compiler. The plurality of pixels are positioned to receive light from a scene disposed within a field of view of the event sensor. Each pixel is configured to have an operational state that is modified by control signals generated by a respective state circuit. The event compiler is configured to output a stream of pixel events. Each respective pixel event corresponds to a breach of a comparator threshold related to an intensity of incident illumination. Each control signal is generated based on feedback information that is received from an image pipeline configured to consume image data derived from the stream of pixel events.