Hybrid Image and Event Sensor Switching for Low-Power Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The use of multiple sensors with different scenes in image processing systems leads to wasteful power consumption and increased power consumption due to unnecessary activation of unused sensors, and the challenge of coordinating different sensor coordinate systems hampers processing speed improvements.
Innovation Solution
A hybrid sensor incorporating both an image sensor and an Event Vision Sensor (EVS) on a single chip, with a signal processing unit that selectively activates sensors based on need, and a processor that switches between luminance and event signals to optimize power usage and processing speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple sensors (image sensor and EVS) are provided for different processing scenes, then processing versatility and reliability are improved, but power consumption increases due to unnecessary activation of unused sensors
Solution Approach 1:
The patent integrates both image sensor and EVS into a single hybrid sensor chip that can perform multiple functions. The sensor can switch between capturing full image data and event-based data depending on the processing needs, thereby achieving versatility without requiring separate physical sensors for each function.
Solution Approach 2:
The patent implements dynamic control of sensor activation states. The hybrid sensor can dynamically switch between different operating modes (full image capture vs. event-based capture) based on real-time processing requirements, ensuring that only the necessary sensing function is active at any given moment, thus reducing power consumption while maintaining versatility.
2Reliability
If multiple sensors are always turned on to ensure availability, then reliability is improved, but power consumption increases due to wasteful continuous operation
Solution Approach 1:
The patent employs periodic or on-demand activation of the hybrid sensor rather than continuous operation. The sensor is activated only when processing is required and deactivated when not needed, eliminating wasteful continuous power consumption while ensuring reliability through timely activation when required.
Solution Approach 2:
The system includes control logic that automatically manages sensor activation based on processing requirements. The hybrid sensor and associated controller work together to self-regulate operation, activating only when needed and deactivating when not needed, thereby eliminating wasteful power consumption while maintaining sensor availability for processing.
3Adaptability or versatility
If separate image sensor and EVS are used, then functional versatility is improved, but device complexity increases due to coordinate system coordination requirements
Solution Approach 1:
The patent merges the image sensor and EVS into a single hybrid sensor chip with unified coordinate system. This integration eliminates the complexity of coordinating between separate sensors while maintaining the functional versatility of both sensing modalities operating from a common reference frame.
Solution Approach 2:
The hybrid sensor chip provides universal functionality by integrating both image capture and event-based sensing capabilities within a single device that shares a common coordinate system. This multi-functionality is achieved without the coordination complexity of separate sensors, as the unified design inherently aligns the reference frames.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces power consumption and enhances processing speed by intelligently activating sensors only when necessary, while facilitating seamless coordination of sensor data without the need for complex system matching.
Implementation Method 1
a plurality of photoelectric conversion units configured to photoelectrically convert incident light
Data Source
AI summary
Information processing that suppresses increased power consumption is disclosed. In one example, an information processing apparatus includes a hybrid sensor with photoelectric conversion units (PDs) that convert incident light, and a processor that acquires, based on outputs of the PDs, a luminance signal or an event signal based on a luminance change. The processor performs predetermined processing based on the luminance signal or the event signal. A request to read the luminance signal is made when the predetermined processing based on the event signal fails, and the predetermined processing based on the luminance signal following the request is then performed.