EBS-ToF Camera Triggering for Low-Power Intruder Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera systems combining event-based sensors (EBS) and regular frame-based imaging face inefficiencies in data transmission and power consumption, particularly in scenarios requiring high-speed object detection and range determination, as they often activate the entire imaging sensor without validating object presence or distance, leading to unnecessary power usage and inefficient processing.
Innovation Solution
A camera system integrating EBS, ToF, and RGB sensors, where EBS triggers ToF and RGB activation only when an object is detected within a selected range, allowing selective activation of image sensor pixels based on object category and region of interest, with power-saving modes for sensors when not in use.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the entire imaging sensor is activated in response to EBS event detection, then object detection coverage is improved, but power consumption and data transmission efficiency deteriorate
Solution Approach 1:
The imaging sensor is divided into multiple regions or blocks, and only the specific region containing the detected object is activated. This segmentation allows the system to maintain comprehensive object detection coverage while significantly reducing the number of active pixels, thereby lowering power consumption and data transmission requirements.
Solution Approach 2:
The system applies different operational states to different regions of the imaging sensor based on local needs. The region containing the detected object is activated with high sensitivity, while other regions remain inactive or in a low-power state. This local quality approach ensures reliable object detection at the critical location without wasting energy on unnecessary areas.
2Reliability
If the entire imaging sensor is activated in response to EBS event detection, then object detection coverage is improved, but data transmission efficiency deteriorates
Solution Approach 1:
The imaging sensor is divided into multiple regions or blocks, and only the specific region containing the detected object is activated. This segmentation allows the system to maintain comprehensive object detection coverage while significantly reducing the number of active pixels, thereby lowering power consumption and data transmission requirements.
Solution Approach 2:
The system extracts and processes only the relevant portion of the image data corresponding to the detected object rather than transmitting entire frame data. By taking out only the necessary data from the activated region, the system improves data transmission efficiency while maintaining reliable object detection.
3Measurement precision
If ToF sensor operates continuously to determine object range, then range determination accuracy is improved, but power consumption deteriorates
Solution Approach 1:
The ToF sensor operates periodically or on-demand rather than continuously. It is activated at specific intervals or triggered by EBS events to perform range measurements, then enters a low-power state. This periodic operation maintains adequate range determination accuracy for surveillance applications while dramatically reducing average power consumption.
Solution Approach 2:
The system uses EBS sensor detections to trigger ToF sensor activation only when objects are present and range measurement is needed. The EBS sensor essentially services the ToF sensor by providing intelligent triggering, ensuring the ToF sensor operates only when necessary for accurate range determination, thereby optimizing power efficiency.
4Reliability
If image sensor operates at high frame rate to capture fast moving objects, then object capture accuracy is improved, but readout time and processing load deteriorate
Solution Approach 1:
The imaging sensor is divided into multiple regions or blocks, and only the specific region containing the detected object is activated. This segmentation allows the system to maintain comprehensive object detection coverage while significantly reducing the number of active pixels, thereby lowering power consumption and data transmission requirements.
Solution Approach 2:
The system activates only a partial region of the imaging sensor rather than the entire sensor array. This partial action provides sufficient data to capture fast-moving objects with adequate accuracy while reducing readout time and processing load by a factor proportional to the fraction of activated pixels.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This integration enhances power efficiency, data transmission, and processing by activating sensors only when necessary, improving object detection and range determination while conserving power and reducing unnecessary operations.
Implementation Method 1
a detection circuit is provided for every pixel to detect a situation in which a change of a light-reception amount exceeds a threshold value as an address event
Implementation Method 2
The time required for the light output from the light source, reflect off of an object within a field of view of the camera, and return to the sensor, can be used to calculate the range to the object
Data Source
AI summary
A sensor system with a plurality of sensors or sensor functions is provided. The sensors can include an event detection sensor, a time of flight sensor, and imaging sensor. The different sensors can be implemented on the same or different substrates. Accordingly, sensors with pixels having different or shared functions can be included in the sensor system. In operation, an event detection signal from an event detection sensor causes the operation of a time of flight sensor to be initiated. In response to the detection of an object within a critical range by the time of flight sensor, the imaging sensor is activated. The image sensing and event detection pixels can be provided as part of different arrays of pixels, or can be included within a common array of pixels.