Object Recognition Using Visible and Near-Infrared Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional object recognition systems face challenges in accurately distinguishing between plants and obstacles in a road scene, particularly due to the limitations of visible light-based camera images in providing precise recognition, which can impact autonomous driving operations.
Innovation Solution
An object recognition apparatus utilizing both an external view camera and a distance measuring sensor, which acquires and processes image information from visible light and near-infrared light to differentiate between plant and obstacle intensities, enhancing recognition accuracy by considering spectral characteristics in both visible and near-infrared regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If only visible light camera images are used for object recognition, then the device complexity is low, but the measurement precision of plant recognition is insufficient
Solution Approach 1:
The patent combines a visible light camera and a near-infrared distance measuring sensor into a single object recognition system. The camera acquires visible light images while the distance measuring sensor acquires near-infrared images, and both data streams are integrated in the object recognition unit to achieve accurate plant recognition by leveraging the complementary spectral characteristics of plants in both visible and near-infrared regions.
Solution Approach 2:
The patent extends the recognition dimension from single visible light spectrum to dual spectrum (visible light + near-infrared). By acquiring images in two different spectral dimensions and analyzing the intensity differences across these dimensions, the system achieves superior plant recognition capability compared to single-spectrum systems.
2Measurement precision
If multiple sensors are used to improve recognition accuracy, then the measurement precision increases, but the device complexity increases
Solution Approach 1:
The object recognition unit is designed to perform multiple functions: it processes both visible light image data from the camera and near-infrared image data from the distance measuring sensor, integrates these different data types, and performs comprehensive object recognition. This multi-functional design consolidates what could be separate processing systems into a single integrated unit.
Solution Approach 2:
The system utilizes changes in light intensity parameters across different spectral regions (visible and near-infrared) to distinguish plants from other objects. By analyzing how plant materials reflect or absorb light at different wavelengths, the system achieves accurate recognition without requiring complex structural modifications.
3Reliability
If spectral characteristics in near-infrared region are utilized, then the reliability of plant recognition improves, but the use of energy increases
Solution Approach 1:
The distance measuring sensor emits near-infrared light in periodic pulses rather than continuously. This pulsed operation mode allows the sensor to accumulate sufficient reflected light signals during each pulse interval while minimizing overall energy consumption compared to continuous emission, thereby achieving reliable plant recognition with reduced energy usage.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables high-accuracy recognition of plants and obstacles, reducing misclassification and improving the reliability of object recognition for autonomous driving systems by leveraging the distinct spectral characteristics in visible and near-infrared light.
Implementation Method 1
acquire, from the external view camera, image information of a camera image, which is generated by sensing incident visible light
Implementation Method 2
generating, as the sensor image, at least one of (i) a reflected light image by emitting near-infrared light and sensing reflected near-infrared light from the object
Implementation Method 3
generating, as the sensor image, at least one of (i) a reflected light image by emitting near-infrared light and sensing reflected near-infrared light from the object or (ii) a background light image by sensing near-infrared background light with respect to the reflected near-infrared light
Data Source
AI summary
An object recognition apparatus recognizes an object existing around a vehicle using an external view camera and a distance measuring sensor. The object recognition apparatus is configured to: acquire, from the external view camera, image information of a camera image, which is generated by sensing incident visible light; acquire, from the distance measuring sensor, image information of a sensor image, the distance measuring sensor generating, as the sensor image, at least one of (i) a reflected light image by emitting near-infrared light and sensing reflected near-infrared light from the object or (ii) a background light image by sensing near-infrared background light with respect to the reflected near-infrared light; and recognize a plant existing around the vehicle with consideration of an intensity difference between an intensity of the camera image and an intensity of the sensor image.