Identification system based on laser and multi-source heterogeneous visual sensor
By using LiDAR and multi-source vision sensor systems, the problem of low recognition rate of traditional vehicle recognition systems in complex environments has been solved, achieving efficient and accurate vehicle feature acquisition and recognition.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- ZHONGCHU HENGKE INTERNET OF THINGS SYST CO LTD
- Filing Date
- 2025-01-23
- Publication Date
- 2026-04-14
AI Technical Summary
Traditional vehicle recognition systems have low recognition rates and are easily affected by the environment, especially in complex environments where they struggle to accurately identify vehicle features.
A multi-source heterogeneous vision sensor system, consisting of a lidar module and multiple vision recognition modules (including a color camera, an infrared camera, and a supplementary light), acquires three-dimensional point cloud images and feature information of the vehicle from different angles, and performs data fusion and processing through a local processor.
Under various environmental conditions, it significantly improves the accuracy and efficiency of vehicle recognition, ensures the acquisition of complete vehicle feature information, and reduces misjudgments.
Smart Images
Figure CN224122993U_ABST
Abstract
Description
Technical Field
[0001] This utility model relates to the field of vehicle recognition, specifically to a recognition system based on laser and multi-source heterogeneous vision sensors. Background Technology
[0002] With the acceleration of urbanization and the rapid increase in the number of vehicles, the demand for traffic management is growing. Traditional vehicle identification and monitoring mainly rely on manual visual inspection or data collection from a single sensor. This method is not only inefficient but also prone to misjudgment. A single radar or camera cannot provide comprehensive information, especially in complex environments, where it is difficult to capture all the necessary features; and in extreme environments, identification is impossible.
[0003] Therefore, a recognition system based on lasers and multi-source heterogeneous vision sensors has shortcomings and challenges. By addressing these shortcomings and making innovations, the accuracy of vehicle recognition can be further improved. Utility Model Content
[0004] Given the shortcomings of existing technologies, traditional vehicle recognition systems have low recognition rates and are easily affected by the environment. This utility model discloses a recognition system based on laser and multi-source heterogeneous vision sensors, which solves the shortcomings of existing technologies by fusing laser and multiple vision sensors.
[0005] To achieve the above objectives, this utility model provides the following technical solution:
[0006] A recognition system based on laser and multi-source heterogeneous vision sensors for vehicle model recognition, comprising:
[0007] A lidar module is installed on a pole beside the road; the lidar module is used to acquire three-dimensional point cloud images of vehicles.
[0008] The first visual recognition module is installed on a pole beside the road, facing the direction of oncoming traffic; the first visual recognition module is used to collect feature information of the front of the vehicle;
[0009] The second visual recognition module is installed on a pole beside the road, facing the direction in which the vehicle is leaving; the second visual recognition module is used to collect feature information of the rear of the vehicle.
[0010] The third visual recognition module is installed on a pole beside the road, facing the lane; the third visual recognition module is used to collect feature information of the vehicle body;
[0011] A local processor is installed inside a pole beside the road. The local processor is communicatively connected to the lidar module, the first vision recognition module, the second vision recognition module, and the third vision recognition module. It is used to receive data information from the lidar module, the first vision recognition module, the second vision recognition module, and the third vision recognition module, perform data preprocessing, and transmit the processed data information to the vehicle recognition module.
[0012] The vehicle recognition module is installed in the control room; the vehicle recognition module is used to receive data information from the local processor and perform vehicle matching and recognition with the vehicle model database.
[0013] The display module is installed in the control room; the display module is used to receive the vehicle recognition result from the vehicle recognition module and display the vehicle model recognition result.
[0014] The lidar module, the first vision recognition module, the second vision recognition module, and the third vision recognition module transmit data to the local processor via wired communication. The local processor transmits data to the vehicle recognition module via wireless communication. The vehicle recognition module transmits data to the display module via wired communication.
[0015] Preferably, the first visual recognition module includes a first camera unit and a first supplementary lighting unit; the first camera unit includes a first color camera, a first infrared camera, and a first wide-angle lens; the first supplementary lighting unit includes a first LED supplementary light and a first infrared supplementary light; the first LED supplementary light is used for daytime light intensity less than 100 lux; the first infrared supplementary light is used for nighttime or completely dark environments.
[0016] Preferably, the second visual recognition module includes a second camera unit and a second supplementary lighting unit; the second camera unit includes a second color camera, a second infrared camera, and a second wide-angle lens; the second supplementary lighting unit includes a second LED supplementary light and a second infrared supplementary light; the second LED supplementary light is used for daytime light intensity less than 100 lux; the second infrared supplementary light is used for nighttime or completely dark environments.
[0017] Preferably, the third visual recognition module includes a third camera unit and a third supplementary lighting unit; the third camera unit includes a third color camera, a third infrared camera, and a fixed focal length lens; the third supplementary lighting unit includes a third LED supplementary light and a third infrared supplementary light; the third LED supplementary light is used for daytime light intensity less than 100 lux; the third infrared supplementary light is used for nighttime or completely dark environments.
[0018] Preferably, the first visual recognition module, the second visual recognition module, and the third visual recognition module are each equipped with a protective cover.
[0019] Preferably, the lidar module includes a laser transmitter and a laser receiver.
[0020] Preferably, the local processor is a Jetson Nano B01.
[0021] Preferably, the wireless communication includes Zigbee, LoRa, NB-IoT, or 4G / 5G cellular network communication.
[0022] Preferably, the display module transmits data with the vehicle recognition module via Ethernet.
[0023] Preferably, the lidar module, the first visual recognition module, the second visual recognition module, and the third visual recognition module transmit data with the local processor via the IIC bus.
[0024] Positive and beneficial effects
[0025] A recognition system based on laser and multi-source heterogeneous vision sensors collects data from different locations of a vehicle using a lidar module and multiple vision recognition modules to ensure the acquisition of complete vehicle feature information. Furthermore, each vision recognition module is equipped with a supplementary light to ensure accurate recognition even under extreme weather conditions, significantly improving the accuracy of vehicle model recognition. Attached Figure Description
[0026] Figure 1 This is a schematic diagram of a recognition system based on laser and multi-source heterogeneous vision sensors according to the present invention.
[0027] Figure 2 This is a schematic diagram of the overall structure of a recognition system based on laser and multi-source heterogeneous vision sensors according to this utility model;
[0028] In the diagram: 1. LiDAR module; 2. First visual recognition module; 211. First color camera; 212. First infrared camera; 213. First wide-angle lens; 3. Second visual recognition module; 311. Second color camera; 312. Second infrared camera; 313. Second wide-angle lens; 4. Third visual recognition module; 411. Third color camera; 412. Third infrared camera; 413. Fixed focal length lens; 5. Local processing; 6. Vehicle recognition module; 7. Display module. Detailed Implementation
[0029] The technical solutions of the present utility model will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of the present utility model, and not all embodiments. Based on the embodiments of the present utility model, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the protection scope of the present utility model.
[0030] In the description of this utility model, it should be noted that the terms "upper", "lower", "left", "right", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this utility model and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this utility model. In addition, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.
[0031] In the description of this utility model, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "joining" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this utility model based on the specific circumstances.
[0032] A recognition system based on laser and multi-source heterogeneous vision sensors includes a laser radar module 1, a first vision recognition module 2, a second vision recognition module 3, a third vision recognition module 4, a local processor 5, a vehicle recognition module 6, and a display module 7.
[0033] In this invention, the first visual recognition module 2 includes a first camera unit 210 and a first supplementary lighting unit 220; the first camera unit 210 includes a first color camera 211, a first infrared camera 212 and a first wide-angle lens 213; the first supplementary lighting unit 220 includes a first LED supplementary light 221 and a first infrared supplementary light 222; the first LED supplementary light 221 is used for daytime light intensity less than 100 lux; the first infrared supplementary light 222 is used for nighttime or completely dark environments.
[0034] In a specific embodiment, the first color camera 211 is used to capture high-resolution color images of the front of the vehicle under normal lighting conditions, providing rich color information; the first infrared camera 212 acquires images in low light, nighttime, or adverse weather conditions, and forms images by detecting infrared radiation emitted by objects; the first wide-angle lens 213 is used to provide a field of view, covering the road area at once, reducing blind spots, and improving monitoring efficiency.
[0035] In this invention, the second visual recognition module 3 includes a second camera unit 310 and a second supplementary lighting unit 320; the second camera unit 310 includes a second color camera 311, a second infrared camera 312, and a second wide-angle lens 313; the second supplementary lighting unit 320 includes a second LED supplementary light 321 and a second infrared supplementary light 322; the second LED supplementary light 321 is used for daytime light intensity less than 100 lux; the second infrared supplementary light 322 is used for nighttime or completely dark environments.
[0036] In a specific embodiment, the second color camera 311 is used to capture high-resolution color images of the front of the vehicle under normal lighting conditions, providing rich color information; the second infrared camera 312 acquires images in low light, nighttime, or adverse weather conditions, and forms images by detecting infrared radiation emitted by objects; the second infrared camera 312 is used to provide a field of view, covering the road area at once, reducing blind spots, and improving monitoring efficiency.
[0037] In this invention, the third visual recognition module 4 includes a third camera unit 410 and a third supplementary lighting unit 420; the third camera unit 410 includes a third color camera 411, a third infrared camera 412, and a fixed-focus lens 413; the third supplementary lighting unit 420 includes a third LED supplementary light 421 and a third infrared supplementary light 422; the third LED supplementary light 421 is used for daytime light intensity less than 100 lux; the third infrared supplementary light 422 is used for nighttime or completely dark environments.
[0038] In a specific embodiment, there are two third vision recognition modules 4, which respectively collect data information from the left and right sides of the vehicle; the third color camera 411 is used to capture high-resolution color images of the vehicle's front under normal lighting conditions, providing rich color information; the third infrared camera 412 acquires images in low light, nighttime, or inclement weather conditions, and forms images by detecting infrared radiation emitted by objects; the fixed-focus lens 413 is used to provide clear images within a specific distance range, capturing details of distant targets, such as subtle markings and features on the vehicle body; the fixed-focus lens reduces image distortion during zooming and improves image quality.
[0039] In this invention, the first visual recognition module 2, the second visual recognition module 3, and the third visual recognition module 4 are each equipped with a protective cover.
[0040] In a specific embodiment, the lidar module includes a laser transmitter 110 and a laser receiver 120.
[0041] In this invention, the local processor 5 is a Jetson Nano B01.
[0042] In this invention, the wireless communication includes Zigbee, LoRa, NB-IoT, or 4G / 5G cellular network communication.
[0043] In this invention, the display module 7 transmits data with the vehicle identification module 6 via Ethernet.
[0044] In this invention, the lidar module 1, the first visual recognition module 2, the second visual recognition module 3, and the third visual recognition module 4 transmit data with the local processor 5 via the IIC bus.
[0045] The present invention has been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the embodiments above are merely for the purpose of helping to understand the method and core ideas of the present invention. It should be noted that those skilled in the art can make various improvements and modifications to the present invention without departing from its principles, and these improvements and modifications also fall within the protection scope of the claims of the present invention.
Claims
1. A recognition system based on laser and multi-source heterogeneous vision sensors for vehicle model recognition, characterized in that, include: A lidar module is installed on a pole beside the road; the lidar module is used to acquire three-dimensional point cloud images of vehicles. The first visual recognition module is installed on a pole beside the road, facing the direction of oncoming traffic; the first visual recognition module is used to collect feature information of the front of the vehicle; The second visual recognition module is installed on a pole beside the road, facing the direction in which the vehicle is leaving; the second visual recognition module is used to collect feature information of the rear of the vehicle. The third visual recognition module is installed on a pole beside the road, facing the lane; the third visual recognition module is used to collect feature information of the vehicle body; A local processor is installed inside a pole beside the road. The local processor is communicatively connected to the lidar module, the first vision recognition module, the second vision recognition module, and the third vision recognition module. It is used to receive data information from the lidar module, the first vision recognition module, the second vision recognition module, and the third vision recognition module, perform data preprocessing, and transmit the processed data information to the vehicle recognition module. The vehicle identification module is installed in the control room; The vehicle recognition module is used to receive data information from the local processor and perform vehicle matching and recognition with the vehicle model database. The display module is installed in the control room; the display module is used to receive the vehicle recognition result from the vehicle recognition module and display the vehicle model recognition result. The lidar module, the first vision recognition module, the second vision recognition module, and the third vision recognition module transmit data to the local processor via wired communication. The local processor transmits data to the vehicle recognition module via wireless communication. The vehicle recognition module transmits data to the display module via wired communication.
2. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 1, characterized in that, The first visual recognition module includes a first camera unit and a first supplementary lighting unit; the first camera unit includes a first color camera, a first infrared camera, and a first wide-angle lens; the first supplementary lighting unit includes a first LED supplementary light and a first infrared supplementary light; the first LED supplementary light is used for daytime light intensity less than 100 lux; the first infrared supplementary light is used for nighttime or completely dark environments.
3. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 1, characterized in that, The second visual recognition module includes a second camera unit and a second supplementary lighting unit; the second camera unit includes a second color camera, a second infrared camera, and a second wide-angle lens; the second supplementary lighting unit includes a second LED supplementary light and a second infrared supplementary light; the second LED supplementary light is used for daytime light intensity less than 100 lux; the second infrared supplementary light is used for nighttime or completely dark environments.
4. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 1, characterized in that, The third visual recognition module includes a third camera unit and a third supplementary lighting unit; the third camera unit includes a third color camera, a third infrared camera, and a fixed-focus lens; the third supplementary lighting unit includes a third LED supplementary light and a third infrared supplementary light; the third LED supplementary light is used when the daytime light intensity is less than 100 lux; the third infrared supplementary light is used at night or in completely dark environments.
5. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 3, characterized in that, The first visual recognition module, the second visual recognition module, and the third visual recognition module are each equipped with a protective cover.
6. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 1, characterized in that, The lidar module includes a laser transmitter and a laser receiver.
7. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 1, characterized in that, The local processor is a Jetson Nano B01.
8. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 1, characterized in that, The wireless communication includes Zigbee, LoRa, NB-IoT, or 4G / 5G cellular network communication.
9. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 1, characterized in that, The display module transmits data with the vehicle recognition module via Ethernet.
10. The recognition system based on laser and multi-source heterogeneous vision sensors according to claim 1, characterized in that, The lidar module, the first visual recognition module, the second visual recognition module, and the third visual recognition module transmit data with the local processor via the IIC bus.