Dual-Modality Neuromorphic Vision Sensor for High-Speed Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current neuromorphic vision sensors are limited by their single-modal perception, which restricts their ability to simultaneously achieve high image quality, dynamic range, and shooting speed, making them unsuitable for diverse applications such as industrial control and robotics.
Innovation Solution
A dual-modality neuromorphic vision sensor is developed, incorporating both current-mode and voltage-mode APS circuits to mimic the functionalities of rod and cone cells, allowing for simultaneous perception of light intensity gradient and absolute light intensity information, with adjustable control switches to optimize dynamic range and shooting speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If a single-modal neuromorphic vision sensor is used to increase shooting speed, then the shooting speed is improved, but the dynamic range is reduced
Solution Approach 1:
The sensor is segmented into two independent perception modes: current-mode APS circuit for light intensity gradient information and voltage-mode APS circuit for absolute light intensity information. Each mode operates independently with its own photosensitive devices and signal processing paths, allowing simultaneous operation without interference, thus achieving both high shooting speed and large dynamic range
Solution Approach 2:
The dual-modality sensor integrates multiple functions into a single device: it can perceive both light intensity gradient changes (rod cell function) and absolute light intensity information (cone cell function). This multi-functional design allows the sensor to adapt to various application scenarios including industrial control, entertainment electronics, and robotics, expanding its versatility while maintaining high performance in both speed and dynamic range
2Measurement precision
If a single-modal neuromorphic vision sensor is used to improve image quality, then the image quality is improved, but the shooting speed is reduced
Solution Approach 1:
The sensor separates image quality optimization and shooting speed optimization into two distinct perception modes. The voltage-mode APS circuit with color filter array is dedicated to high-quality color image capture, while the current-mode APS circuit is dedicated to high-speed gradient detection. This segmentation allows each mode to be optimized for its specific function without compromising the other
Solution Approach 2:
The sensor dynamically switches between or combines the outputs of two perception modes based on application requirements. The system can adaptively select whether to prioritize image quality (voltage-mode) or shooting speed (current-mode), or use both simultaneously, providing dynamic performance adjustment without physical reconfiguration
3Device complexity
If a single perception mode is used in neuromorphic vision sensor, then the device complexity is reduced, but the reliability is reduced
Solution Approach 1:
Different regions of the sensor array are assigned different perception mode characteristics. The sensor incorporates both current-mode photosensitive devices and voltage-mode photosensitive devices within the same array, with each region optimized for its specific function. This local differentiation allows the system to maintain simplicity in individual circuits while achieving high reliability through functional diversity
Solution Approach 2:
The dual-modality design provides built-in redundancy and failover capability. If one perception mode fails or performs poorly under certain conditions, the other mode can compensate or take over, ensuring continuous operation. This beforehand cushioning against failure modes significantly improves system reliability without adding complex external redundancy systems
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The dual-modality sensor enhances image quality and dynamic range while improving shooting speed, achieving a higher signal-noise ratio and reconfigurable performance, thereby addressing the limitations of single-modal sensors.
Implementation Method 1
the target first-type photosensitive device is configured to obtain a target light signal, and convert the target light signal into a first-type current signal
Data Source
AI summary
Embodiments of the present disclosure provide a dual-modality neuromorphic vision sensor. A first-type current-mode active pixel sensor (APS) circuit can mimic excitatory rod cells, to perceive light intensity gradient information in a target light signal, thereby improving a dynamic arrange of an image sensed by a neuromorphic, vision sensor and its shooting speed. In addition, a first-type control switch is introduced for each of non-target first-type photosensitive devices, to control the obtained light intensity gradient information, and adjust the dynamic arrange of the image sensed by the neuromorphic vision sensor, thereby adjusting the shooting speed, and realizing a reconfigurable effect A voltage-mode APS can mimic cone cells, to output a target voltage signal representing light intensity information in the target light signal, and perceive the light intensity information in the target light signal. In this way, the obtained light intensity information represented by the target voltage signal has a higher precision, thereby ensuring the image quality.