Neuromorphic Camera Tracking with IR Laser for Low-Light Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image recognition systems for object tracking are sensitive to lighting conditions and ineffective in diverse environments, particularly when tracking small objects.
Innovation Solution
A device combining a motorized yoke with a neuro-morphic camera and an IR laser module, along with an RGB laser module, for object localization, identification, and tracking, using directional information from radar or operator input, and deep learning pattern recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional image recognition systems are used for object tracking, then the system is simple to implement, but it is sensitive to lighting conditions and ineffective in diverse environments
Solution Approach 1:
The patent combines multiple sensing modalities (radar, infrared laser, neuromorphic camera) into a unified tracking system. The radar provides directional information about objects entering the area of interest, the infrared laser illuminates objects for visibility, and the neuromorphic camera captures event-based images. This merging of complementary sensors overcomes the lighting sensitivity limitation of conventional vision systems while maintaining robustness across diverse environments.
Solution Approach 2:
The system integrates multiple functions into a single platform: detection (radar and camera), illumination (infrared and visible laser), tracking (motorized yoke with 3 axes), and identification (image processing with deep learning). This multi-functional design enables reliable object tracking under various conditions without requiring separate specialized systems for each function.
2Measurement precision
If conventional vision methods are used, then the device is simple, but it cannot adequately perceive small objects in highly diverse environments
Solution Approach 1:
The system segments the detection task across multiple sensors with specialized capabilities: radar for detecting objects entering the area and providing directional information, infrared laser for illuminating and enhancing visibility of small objects, and neuromorphic camera for capturing high-precision event-based images. Each sensor handles specific aspects of detection, enabling precise measurement of small objects in diverse environments through divided functional responsibilities.
Solution Approach 2:
The infrared laser acts as an intermediary between the radar-detected objects and the camera. By illuminating objects with infrared light, it enhances the contrast and visibility of small objects in diverse environments, allowing the neuromorphic camera to capture precise event-based images that would otherwise be undetectable. This intermediary illumination system bridges the gap between radar detection and optical imaging.
3Illumination intensity
If infrared laser illumination is added to the system, then object visibility in dark conditions improves, but device complexity increases
Solution Approach 1:
The infrared laser module operates in a pulsed manner rather than continuously. The pulsed infrared laser source illuminates objects periodically, providing sufficient illumination for the neuromorphic camera to capture events while reducing overall energy consumption and thermal load. This periodic action maintains effective infrared illumination intensity for dark condition visibility while managing system complexity through efficient operational mode.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables precise object localization, identification, and tracking in various lighting conditions, with the ability to illuminate, blind, or destroy objects as needed, using a neuromorphic camera's event-based sensor array and pulsed infrared laser.
Implementation Method 1
an IR laser module including a pulsed infrared laser source to illuminate the object to be identified
Implementation Method 2
a neuro-morphic camera... to obtain from an IR image received by the neuro-morphic camera event images of objects
Implementation Method 3
the pulsed infrared laser source is configured to deliver through a focusing lens a pulsed IR light beam
Implementation Method 4
whose output, after passing through a collimating lens, is directed to a sighting collimator
Implementation Method 5
a dichroic mirror separating and directing the image collected through the common objective, on the one hand into a visible image towards the color or black and white camera and on the other hand into an IR image towards the neuro-morphic camera
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
Disclosed is a device for detecting and tracking objects in a zone of interest, comprising: - a control terminal receiving direction information relating to objects penetrating the zone of interest from a radar or a direct operator input; - a motorized gimbal (30) having three axes of rotation with direct axial drive for supporting and omnidirectionally moving an assembly comprising: ▫ a neuromorphic camera (36); ▫ an IR laser module (32) comprising a pulsed infrared laser source for illuminating the object to be identified; and - an image processing module (14) for obtaining an IR image received by the neuromorphic camera of the event-dependent images of each of the objects present in the zone of interest, so as to locate and identify those objects and to control the orientation of the motorized gimbal in order to track the respective movement thereof within the zone of interest on a display screen of the control terminal.