Multi-solid-state laser radar external parameter calibration system
By installing multiple solid-state lidar sensors on mining trucks and calibrating their external parameters, the blind spot problem was solved, improving the safety and perception capabilities of the mining trucks.
Patent Information
- Application Number
- CN202323578239.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-26
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2033-12-26
AI Technical Summary
The solid-state lidar of mining trucks has a limited field of view when scanning left and right, resulting in blind spots on both sides and affecting vehicle safety.
Multiple solid-state lidars are installed at the center, left, and right sides of the front of the mining truck, and the point cloud data of each lidar is converted to a unified coordinate system through an external parameter calibration module to fill in the blind spots.
By using multiple solid-state lidars in combination and extrinsic parameter calibration, the perception module of the mining truck has been improved, increasing the vehicle's safety and perception capabilities.
Smart Images

Figure CN222070827U_ABST
Abstract
Description
Technical Field
[0001] The utility model belongs to the technical field of external parameter calibration, and in particular relates to an external parameter calibration system for multiple solid-state laser radars. Background Art
[0002] Due to the large size of mining trucks, the perception module in autonomous driving must obtain as much information as possible about the surrounding scene to ensure safety. However, the installation location of the solid-state LiDAR may limit its left and right scanning field of view, resulting in blind spots on the left and right sides of the mining truck. This can affect the perception module and further impact the safety of the mining truck. Utility Model Content
[0003] In order to solve the above problems existing in the prior art, the utility model provides a multi-solid-state laser radar external parameter calibration system.
[0004] According to a first aspect of an embodiment of the present utility model, a multi-solid-state laser radar extrinsic parameter calibration system is provided, which is applied to a mining truck. The system includes: multiple solid-state laser radars and an extrinsic parameter calibration module; the multiple solid-state laser radars include: a first solid-state laser radar installed at the center position directly in front of the mining truck, a second solid-state laser radar installed at the left position directly in front of the mining truck, and a third solid-state laser radar installed at the right position directly in front of the mining truck; the second solid-state laser radar and the third solid-state laser radar are symmetrically distributed with respect to the first solid-state laser radar;
[0005] The first solid-state laser radar is used to obtain first point cloud data directly in front of the mining truck;
[0006] The second solid-state laser radar is used to obtain second point cloud data on the left side directly in front of the mining truck;
[0007] The third solid-state laser radar is used to obtain third point cloud data on the right side in front of the mining truck;
[0008] The external parameter calibration module is used to perform external parameter calibration based on the first point cloud data, the second point cloud data and the third point cloud data.
[0009] Optionally, the bottom of each of the multiple solid-state laser radars is provided with at least three mounting holes and at least one positioning hole for fixed connection to the mining truck.
[0010] Optionally, the multiple solid-state laser radars are fixedly connected to the mining truck through at least three hexagonal cup head combination screws, spring washers and flat washers corresponding to the at least three mounting holes.
[0011] Optionally, the multiple solid-state laser radars are installed at a distance of 90 to 100 centimeters from the ground.
[0012] Optionally, the multiple solid-state laser radars scan a horizontal viewing angle of 120 degrees through mirror rotation.
[0013] Optionally, the multiple solid-state laser radars optimize the scanned point cloud data through galvanometer rotation.
[0014] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:
[0015] In the above technical solution, multiple solid-state laser radars and external parameter calibration modules are installed on the mining truck, including a first solid-state laser radar installed at the center position directly in front of the mining truck, a second solid-state laser radar installed at the left position directly in front of the mining truck, and a third solid-state laser radar installed at the right position directly in front of the mining truck; the second solid-state laser radar and the third solid-state laser radar are symmetrically distributed with respect to the first solid-state laser radar. The first solid-state laser radar is used to obtain first point cloud data directly in front of the mining truck; the second solid-state laser radar is used to obtain second point cloud data directly in front of the mining truck on the left side; the third solid-state laser radar is used to obtain third point cloud data directly in front of the mining truck on the right side; the external parameter calibration module is used to perform external parameter calibration based on the first point cloud data, the second point cloud data, and the third point cloud data. Through the above technical solution, solid-state laser radars are installed at multiple locations on the mining truck, thereby filling in the blind spots of the mining truck, and then improving the perception module of the mining truck, thereby increasing the safety of the mining truck. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 Schematic diagram of a multi-solid-state lidar extrinsic parameter calibration system according to an exemplary embodiment. DETAILED DESCRIPTION
[0017] In order to facilitate the understanding of the present invention, the related prior art and the concept of the present invention are briefly described first.
[0018] Solid-state LiDAR uses a fiber laser as its light source, with a detection range of up to 500 meters. It can effectively identify different target attributes such as people, animals, vehicles, tires, and fallen objects, and output information such as distance and 3D profile. This radar is suitable for embedding in front of or on both sides of the vehicle, which is more in line with the aesthetic requirements of passenger car exterior design. It can be used for unmanned mining truck driving in open-pit mines. Compared with traditional mechanical LiDAR, it has high scanning accuracy, low loss, and low cost.
[0019] Solid-state LiDAR (Light Detection and Ranging) plays a key role in autonomous mining trucks. Solid-state LiDAR captures point cloud data of the surrounding environment, creating a high-precision three-dimensional map. Solid-state LiDAR can sense the surrounding environment, scanning it in real time and accurately identifying obstacles, road features, and terrain changes. This ensures the safe operation of unmanned mining trucks in harsh and complex mining environments. Solid-state LiDAR uses point cloud data collected by the LiDAR and external parameter calibration to acquire and understand the surrounding scene information. The external parameter calibration capability of solid-state LiDAR directly impacts downstream control chains such as positioning, route planning, and decision-making. Because solid-state LiDAR has a limited left-right scanning field of view, there may be blind spots on the left and right sides of mining vehicles. Therefore, multiple solid-state LiDARs can be used to collect point cloud data of the mining vehicle's surroundings. However, each solid-state LiDAR has its own coordinate system. The corona data generated by each solid-state LiDAR is based on its own coordinate system, necessitating the conversion of the point cloud data from each solid-state LiDAR to a unified coordinate system. Therefore, the utility model proposes a multi-solid-state laser radar external parameter calibration system to solve this technical problem.
[0020] Figure 1 FIG. 1 is a schematic diagram of a multi-solid-state laser radar extrinsic parameter calibration system according to an exemplary embodiment. Figure 1 As shown, the multi-solid-state laser radar extrinsic parameter calibration system 10 is applied to an unmanned mining truck. The system 10 includes: multiple solid-state laser radars and an extrinsic parameter calibration module; the multiple solid-state laser radars include: a first solid-state laser radar 101 installed at the center position in front of the mining truck, a second solid-state laser radar 102 installed at the left position in front of the mining truck, and a third solid-state laser radar 103 installed at the right position in front of the mining truck; the second solid-state laser radar 102 and the third solid-state laser radar 103 are symmetrically distributed with respect to the first solid-state laser radar 101;
[0021] The first solid-state laser radar 101 is used to obtain first point cloud data directly in front of the mining truck;
[0022] The second solid-state laser radar 102 is used to obtain second point cloud data on the left side in front of the mining truck;
[0023] The third solid-state laser radar 103 is used to obtain third point cloud data on the right side in front of the mining truck;
[0024] The extrinsic parameter calibration module is used to perform extrinsic parameter calibration based on the first point cloud data, the second point cloud data and the third point cloud data.
[0025] It is understandable that in order to avoid blind spots when the solid-state laser radar acquires point cloud data, solid-state laser radars are respectively set in front of the mining vehicle, on the left side of the front, and on the right side of the front, namely, the first solid-state laser radar 101, the second solid-state laser radar 102, and the third solid-state laser radar 103. It is worth mentioning that the number of solid-state laser radars set in each position can also be increased according to the actual situation of the solid-state laser radars. Each solid-state laser radar is installed around the mining truck to acquire point cloud data of the environment around the mining truck. However, the point cloud data acquired by each solid-state laser radar is in its own coordinate system. Therefore, after acquiring the point cloud data of each solid-state laser radar, it is necessary to perform coordinate conversion on the point cloud data of each solid-state laser radar so that the point cloud data acquired by each solid-state laser radar is in the same reference coordinate system. The reference coordinate system can be the coordinate system of the first solid-state laser radar.
[0026] It is worth mentioning that when mining trucks obtain information about the surrounding environment, the solid-state LiDARs commonly used are solid-state LiDAR and mechanical LiDAR. Solid-state LiDARs usually adopt a compact structural design and are composed of solid-state lasers, photodetectors, optical elements, and signal processing circuits. They are usually small in size and weight and do not require complex mechanical components. Solid-state LiDARs use solid-state lasers as light sources, usually through semiconductor laser diodes or solid-state laser arrays to emit laser beams. The electronic devices of solid-state lasers are used to directly generate laser pulses without the need for rotation or vibration of mechanical components. Therefore, solid-state LiDARs have high reliability and stability, are not easily affected by vibration, shock, or mechanical wear, have a short measurement range and high measurement accuracy, and can provide high-density point cloud data. Mechanical LiDARs use mechanical rotating components (such as rotating mirrors or rotating prisms) to scan the laser beam. The rotating components rotate or vibrate to make the laser beam scan the surrounding environment in the horizontal and vertical directions. Mechanical LiDARs usually have large size and weight because they need to contain rotating or vibrating mechanical components. In summary, the movement of mechanical components in mechanical LiDARs can cause wear and vibration noise, impacting measurement accuracy and reliability. Furthermore, they are bulky and heavy. Solid-state LiDARs, with their greater reliability, stability, and compactness, are more suitable for unmanned mining trucks.
[0027] For example, when the extrinsic parameter calibration module performs extrinsic parameter calibration based on the first point cloud data, the second point cloud data, and the third point cloud data, it can usually be implemented by the following steps: the second point cloud data and the third point cloud data are converted to the reference coordinate system using the coordinate system of the first point cloud data (first solid-state laser type) as the reference coordinate system, so that the first point cloud data, the second point cloud data, and the third point cloud data are in a unified coordinate system. For example, the first point cloud data is scanned and acquired by the first solid-state laser radar, and at the same time, the second solid-state laser radar also scans and acquires the second point cloud data. Since there are repeated areas in the point cloud data scanned by the first solid-state laser radar and the second solid-state laser radar and the first solid-state laser radar and the third solid-state laser radar, that is, some points are scanned simultaneously by multiple solid-state laser radars; according to the rotation matrix and the translation matrix, the transformation parameters for converting the coordinates in the second point cloud data scanned by the second solid-state laser radar to the reference coordinate system where the first point cloud data is located can be obtained. According to the pairwise verification and registration between the first solid-state laser radar, the second solid-state laser radar, and the third solid-state laser radar, and combined with the geometric consistency assumption, the calibration matrix representing the extrinsic parameter is obtained through iteration.
[0028] Optionally, the bottom of each of the multiple solid-state laser radars is provided with at least three mounting holes and at least one positioning hole for fixed connection to a mining truck.
[0029] Optionally, multiple solid-state laser radars are fixedly connected to the mining truck through at least three hexagonal cup head combination screws, spring washers and flat washers corresponding to at least three mounting holes.
[0030] For example, in one embodiment, fixing devices are provided at the center position in front and at both sides of the front of the unmanned mining truck. There are 4 mounting holes and 2 positioning holes at the bottom of each solid-state laser radar, which are fastened by 4 hexagonal cup head combination screws, and are equipped with spring washers and flat washers for fixing each solid-state laser radar.
[0031] Optionally, multiple solid-state lidars are installed at a distance of 90 to 100 centimeters from the ground.
[0032] It is worth mentioning that since the chassis of unmanned mining trucks is usually 70-80 cm from the ground, in order to make the field of view of each solid-state laser radar clear enough, it is necessary to adjust the installation position of the solid-state laser radar according to the distance between the vehicle chassis and the ground.
[0033] Optionally, multiple solid-state lidars scan a horizontal viewing angle of 120 degrees through mirror rotation.
[0034] Optionally, multiple solid-state laser radars optimize the scanned point cloud data through galvanometer rotation.
[0035] It is worth mentioning that since multiple solid-state laser radars scan a horizontal viewing angle of 120 degrees through mirror rotation, the first solid-state laser radar, the second solid-state laser radar, and the third solid-state laser radar each have a part of the repeated scanning area. According to the repeated scanning area, the point cloud data of each solid-state laser radar can be positioned and the external parameters can be calibrated.
[0036] The rotation of the galvanometer mirrors of multiple solid-state LiDARs is one of the scanning methods used in solid-state LiDAR systems. In some solid-state LiDAR systems, a rotating galvanometer mirror is used to scan the surrounding environment. The galvanometer mirror is typically made of a special material and rotated by a drive device such as a motor. As it rotates, the galvanometer mirror continuously changes the direction of the reflected light beam, allowing it to scan the entire surrounding environment. By controlling the galvanometer mirror's rotation speed and angle, distance and angle information in different directions can be obtained, enabling the perception and measurement of surrounding objects. Galvanometer mirror rotation is a common scanning method in solid-state LiDARs, along with fixed (non-rotating) and linear (linear scanning) scanning methods. Each scanning method has its advantages and disadvantages, and the choice depends on the specific application scenario and requirements. Through galvanometer mirror rotation, solid-state LiDARs can achieve omnidirectional, high-resolution environmental perception, providing rich target detection and distance measurement data, providing important data support for applications in areas such as autonomous driving, intelligent transportation, and robotics.
[0037] In the above technical solution, multiple solid-state laser radars are fixedly connected to multiple positions of the mining truck, and the installation positions of the multiple solid-state laser radars are adjusted according to the vehicle undercarriage height of the mining truck, and the scanned point cloud data is optimized by using the galvanometer rotation. Through the above technical solution, the solid-state laser radars are installed at multiple positions of the mining truck, and the installation positions of the solid-state laser radars are adjusted according to actual needs. While filling the blind spots of the mining truck and then improving the perception module of the mining truck, thereby increasing the safety of the mining truck, the flexibility of using multiple solid-state laser radars for external parameter calibration is also improved.
[0038] It is understood that in the present invention, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects are in an "or" relationship. The singular forms "a", "the", and "the" are also intended to include the plural forms, unless the context clearly indicates otherwise.
[0039] It should be further understood that the terms "first," "second," and the like are used to describe various types of information, but such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another and do not imply a particular order or level of importance. In fact, the terms "first," "second," and the like are fully interchangeable.
[0040] It is further understood that, although operations are described in a particular order in the accompanying drawings in the embodiments of the present invention, this should not be construed as requiring that these operations be performed in the particular order shown or in a serial order, or that all of the operations shown be performed to obtain the desired result. In certain circumstances, multitasking and parallel processing may be advantageous.
[0041] It should be noted that all actions of acquiring signals, information or data in this application are carried out in compliance with the relevant data protection laws and policies of the country where they are located and with the authorization given by the owner of the corresponding device.
Claims
1. A multi-solid-state laser radar external parameter calibration system, characterized in that: Applied to unmanned mining trucks, the system includes: a plurality of solid-state laser radars and an external parameter calibration module; the plurality of solid-state laser radars include: a first solid-state laser radar installed at the center position directly in front of the mining truck, a second solid-state laser radar installed at the left position directly in front of the mining truck, and a third solid-state laser radar installed at the right position directly in front of the mining truck; the second solid-state laser radar and the third solid-state laser radar are symmetrically distributed with respect to the first solid-state laser radar; The first solid-state laser radar is used to obtain first point cloud data directly in front of the mining truck; The second solid-state laser radar is used to obtain second point cloud data on the left side directly in front of the mining truck; The third solid-state laser radar is used to obtain third point cloud data on the right side directly in front of the mining truck; The external parameter calibration module is used to perform external parameter calibration according to the first point cloud data, the second point cloud data and the third point cloud data.
2. The multi-solid-state laser radar extrinsic calibration system according to claim 1, characterized in that: The bottoms of the multiple solid-state laser radars are each provided with at least three mounting holes and at least one positioning hole so as to be fixedly connected to the mining truck.
3. The multi-solid-state laser radar extrinsic calibration system according to claim 2, characterized in that: The multiple solid-state laser radars are fixedly connected to the mining truck by at least three hexagon socket head combination screws, spring washers and flat washers corresponding to the at least three mounting holes.
4. The multi-solid-state laser radar extrinsic calibration system according to claim 1, characterized in that: The multiple solid-state laser radars are installed at a distance of 90 to 100 centimeters from the ground.
5. The multi-solid-state laser radar extrinsic calibration system according to claim 1, characterized in that: The multiple solid-state laser radars scan a horizontal viewing angle of 120 degrees through mirror rotation.
6. The multi-solid-state laser radar extrinsic calibration system according to claim 1, characterized in that: The multiple solid-state laser radars optimize the scanned point cloud data through galvanometer rotation.
