Event Imaging Readout With Motion-Predicted Pixel Regions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Event-based sensors face challenges in accurately detecting changes in a pixel array due to delays in object detection processing, which can cause missed events when the object moves out of the set region, leading to reduced temporal resolution and inaccurate event detection.
Innovation Solution
The proposed solution involves an event-based imaging device that includes a pixel portion, event readout portion, motion prediction, and determination portions to predict regions of interest, allowing for continuous event detection on moving subjects by determining predicted regions based on motion information, thereby reducing delays and improving accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If object detection processing is used to set a specific region for reading out event signals, then power consumption is reduced and operation speed is improved, but temporal resolution is lowered and event detection accuracy is reduced due to processing delays
Solution Approach 1:
The system performs preliminary object detection to identify a subject, then uses motion prediction to proactively determine a predicted region where the subject will be located in the future. This preliminary action allows the event readout portion to focus on the correct region before the subject moves, preventing event loss while maintaining low power consumption.
Solution Approach 2:
The system dynamically adjusts the region of interest by continuously updating the predicted region based on real-time motion information. Instead of using a fixed region, the readout region adapts to the subject's movement, ensuring accurate event detection while maintaining the benefits of region-based readout for power efficiency.
2Speed
If a specific region is set based on object detection results to read out event signals, then reading out speed is improved, but event signals may be missed when the object moves out of the specific region
Solution Approach 1:
Motion prediction is performed in advance to determine where the subject will be located, allowing the system to set the predicted region before the subject actually moves there. This ensures that event signals are not missed while maintaining fast readout speed by focusing only on the predicted region.
Solution Approach 2:
The system uses feedback from motion information to continuously update the predicted region. By monitoring the subject's movement and adjusting the readout region accordingly, the system ensures that event signals are captured reliably while maintaining efficient readout speed.
3Device complexity
If object detection processing is performed with lower temporal resolution, then processing load is reduced, but delays occur in reading out event signals from moving objects
Solution Approach 1:
The system performs preliminary motion prediction using relatively simple processing to forecast the subject's future position. This preliminary action with lower computational complexity prevents time loss by ensuring the readout region is correctly positioned before the subject moves, without requiring complex real-time tracking.
Solution Approach 2:
The system dynamically updates the predicted region based on motion information at appropriate intervals. This dynamic adjustment maintains low processing load by not requiring continuous complex calculations, while still reducing time delays by keeping the readout region aligned with the moving subject.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances the accuracy of event detection on moving subjects by reducing processing delays and time stamp errors, minimizing event loss, and optimizing power consumption through adaptive event rate control.
Implementation Method 1
a pixel portion (101) that includes a plurality of unit pixels and is configured to detect as an event signal a change in a light intensity of each of the unit pixels
Data Source
AI summary
An imaging device includes a pixel portion that includes a plurality of unit pixels and is configured to detect as an event signal a change in a light intensity of each of the unit pixels, an event readout portion configured to read out the event signal from the pixel portion, an output portion configured to output, regarding at least one region relating to the event signal of the pixel portion, motion information relating to motion of the at least one region, and a determination portion configured to determine a predicted region after a change in the at least one region, the predicted region being predicted based on the motion information. The event readout portion is configured to read out the event signal from a unit pixel included in the determined predicted region.