Laser radar calibration method and device, electronic equipment and computer storage medium

Through point cloud data conversion and plane fitting technology, the external parameters of lidar and rotary motor are calculated, which solves the problem of low calibration accuracy of foreign parameters in the existing technology, and realizes high-precision calibration of lidar and motors, improving positioning and construction The accuracy of the graph.

CN119064904APending Publication Date: 2024-12-03ZG TECH CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411344090.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-25
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The external parameter calibration of existing lidars and rotary motors requires customized tools, which are poor in versatility and have low calibration accuracy, which affects positioning and mapping accuracy.

Method used

By obtaining point cloud data at different angles of the rotating motor, converting it to the motor zero-degree coordinate system, dividing voxels, fitting plane equations, and calculating the external parameters of the lidar based on plane feature matching, optimizing the external parameters to improve accuracy.

Benefits of technology

No special tools are required to reduce random errors, improve external parameter calibration accuracy, and enhance positioning and mapping accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119064904A_ABST
    Figure CN119064904A_ABST
Patent Text Reader

Abstract

The invention relates to a laser radar calibration method and device, electronic equipment and a computer storage medium, and belongs to the technical field of laser radars, in the laser radar calibration method, a to-be-calibrated laser radar is arranged on a rotating motor, and the method comprises the steps of obtaining point cloud data collected by the to-be-calibrated laser radar when the rotating motor is at different rotating angles; converting the point cloud data into a motor zero-degree coordinate system by adopting a preset initial external parameter and a motor rotation angle corresponding to the point cloud data; determining plane voxels based on the point cloud coordinates of the point cloud data in preset voxels, and fitting plane equations corresponding to the plane voxels; and matching the plane equations according to a preset matching criterion, and calculating external parameters of the to-be-calibrated laser radar based on a conversion relation between successfully matched planes. The method does not need a special calibration tool, is less affected by random errors, and is higher in external parameter calibration precision.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of laser radar technology, and in particular to a laser radar calibration method, device, electronic equipment and computer storage medium. Background Art

[0002] LiDAR has the advantages of high measurement accuracy, long scanning distance and strong anti-interference ability. As the production cost of LiDAR gradually decreases, LiDAR-based positioning and mapping technology has been widely used in fields such as autonomous driving.

[0003] The existing laser radar scanning horizontal scanning field of view is 360 degrees, but the vertical scanning field of view is generally only 30 degrees, and the vertical point cloud is very sparse. The most cost-effective way to solve this problem is to combine the laser radar with a rotating motor to form a rotating laser radar with a larger field of view, so as to improve the scanning point cloud density and scanning efficiency. However, due to processing and assembly errors, vibration, wear and other factors, there is inevitably an error between the relative position relationship between the laser radar and the motor and the design value. If the design value is taken as the true value for point cloud coordinate system conversion, the point cloud after the unified coordinate system will be layered and thickened, which will greatly affect the positioning and mapping accuracy. Therefore, it is necessary to calibrate the external parameters of the lidar and motor. The existing lidar and motor external parameter calibration methods usually extract plane features by scanning special calibration tools or regular scenes, and then establish and minimize point-to-point or point-to-surface error functions. This calibration method has the problem that special calibration tools are difficult to process and have poor versatility. In addition, the point cloud coordinates obtained by the lidar have certain errors, which makes it difficult to establish point-to-point correspondence and the point-to-surface distance error is also inaccurate, which ultimately affects the technical problem of calibration accuracy.

[0004] It can be seen that the existing technology has technical problems such as the need to customize calibration tools when performing external parameter calibration of lidar and motor, poor versatility, and inaccurate external parameter calibration. Summary of the invention

[0005] In view of this, it is necessary to provide a laser radar calibration method, device, electronic device and computer storage medium to solve the technical problems in the prior art that when calibrating the external parameters of the laser radar and the motor, customized calibration tools are required, the versatility is poor, and the external parameter calibration is inaccurate.

[0006] In order to solve the above problems, the present invention provides a laser radar calibration method, wherein the laser radar to be calibrated is arranged on a rotating motor, comprising: Acquire point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles; The point cloud data are converted into a motor zero-degree coordinate system by using a preset initial external parameter and a motor rotation angle corresponding to the point cloud data; Determine the plane voxel based on the point cloud coordinates of each point cloud data in the preset voxel, and fit the plane equation corresponding to each of the plane voxels; The plane equations are matched according to a preset matching criterion, and the external parameters of the laser radar to be calibrated are calculated based on the conversion relationship between the successfully matched plane pairs.

[0007] In a possible implementation manner, the step of obtaining the point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles includes: When the rotating motor rotates from zero degree at each preset interval angle, point cloud data collected by the laser radar to be calibrated is obtained until the rotating motor rotates one circle.

[0008] In a possible implementation, each of the point cloud data is converted into a motor zero-degree coordinate system using a preset initial external parameter and a motor rotation angle corresponding to the point cloud data, including: Obtain the laser radar three-dimensional coordinates of each point cloud in the laser radar coordinate system in the point cloud data; In combination with the preset initial external parameters and the camera rotation angle corresponding to the point cloud data, the laser radar three-dimensional coordinates are transformed to obtain the motor zero-degree three-dimensional coordinates of each point cloud in the point cloud data in the motor zero-degree coordinate system.

[0009] In a possible implementation, determining the plane voxel based on the point cloud coordinates of each point cloud data in a preset voxel includes: Divide the space corresponding to the point cloud data into voxels to obtain a plurality of voxels, and obtain the motor zero-degree three-dimensional coordinates of the point cloud located in each voxel in each frame of the point cloud data; For each voxel, performing a centroiding operation on the point cloud in the voxel based on the motor zero-degree three-dimensional coordinates of the point cloud in the voxel, and calculating a covariance matrix of the point cloud based on the motor zero-degree three-dimensional coordinates of the point cloud after the centroiding operation; The covariance matrix is ​​subjected to eigendecomposition to obtain a plane eigenvalue, and when the plane eigenvalue meets a preset plane identification criterion, the voxel is determined to be a plane voxel.

[0010] In a possible implementation, the fitting of the plane equations corresponding to the plane voxels includes: Performing plane fitting on the point cloud in the plane voxels using a random sampling consistency algorithm to determine the inner points of the plane corresponding to the plane voxels in the point cloud; The plane equation corresponding to the plane voxel is obtained by performing least square fitting on the motor zero-degree three-dimensional coordinates of the interior point.

[0011] In a possible implementation, matching the plane equations according to a preset matching criterion, and calculating the external parameters of the laser radar to be calibrated based on the conversion relationship between the successfully matched plane equations, includes: The plane equations obtained by fitting point cloud data of different frames in the same plane voxel are matched according to a preset matching criterion to determine the successfully matched plane pairs; According to a preset plane conversion formula, the plane equations of each plane in the plane pair are converted from the motor zero-degree three-dimensional coordinate system to the laser radar coordinate system to obtain the laser radar three-dimensional coordinate equations corresponding to each plane in the plane pair; Based on the rotation angle and initial external parameters of the motor when collecting the point cloud data corresponding to the plane pair, the three-dimensional coordinate equation of the laser radar corresponding to each plane in the plane pair is converted into a zero-degree three-dimensional coordinate system to obtain the zero-degree three-dimensional coordinate equation of the motor corresponding to each plane in the plane pair; Based on the motor zero-degree three-dimensional coordinate equations corresponding to each plane in the plane pair, a nonlinear iterative method is used to minimize the error between planes to obtain the external parameters of the laser radar to be calibrated.

[0012] In a possible implementation, the preset matching criteria include: The inner product of the normal vectors of the two planes is greater than a preset inner product threshold; and The difference between the distances of the two planes and the origin is less than a preset distance difference threshold; and The average value of the distances between the corresponding inner points of the two planes is less than a preset average value threshold.

[0013] The present invention also provides a laser radar calibration device, wherein the laser radar to be calibrated is arranged on a rotating motor, and comprises: A point cloud data acquisition module, used to acquire point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles; A coordinate conversion module, used to convert each of the point cloud data into a motor zero-degree coordinate system by using a preset initial external parameter and a motor rotation angle corresponding to the point cloud data; A plane fitting module, used for determining plane voxels based on the point cloud coordinates of each point cloud data in a preset voxel in the motor zero-degree coordinate system, and performing plane fitting based on the point cloud in each plane voxel to obtain a plane equation corresponding to each plane voxel; The external parameter calculation module is used to match the plane equations according to a preset matching criterion, and calculate the external parameters of the laser radar to be calibrated based on the conversion relationship between the successfully matched plane pairs.

[0014] The present invention also provides an electronic device, comprising a memory and a processor, wherein: The memory is used to store programs; The processor is coupled to the memory and is used to execute the program stored in the memory to implement the steps in the laser radar calibration method described in any of the above embodiments.

[0015] The present invention also provides a computer-readable storage medium, characterized in that it is used to store computer-readable programs or instructions, and when the program or instructions are executed by a processor, the steps in the laser radar calibration method described in any of the above embodiments can be implemented.

[0016] The beneficial effects of the present invention are as follows: the embodiment of the present invention obtains point cloud data collected by the laser radar when the rotating motor is at different optional angles, and converts the point cloud data into the motor zero-degree coordinate system for plane fitting, and calculates the external parameters of the laser radar to be calibrated according to the relationship between the fitted planes, and eliminates random errors by plane fitting of the laser radar point cloud, and optimizes the external parameters through plane feature matching and the relationship between planes. No special calibration tools are required, and the system is less affected by random errors and has higher accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 A schematic diagram of a flow chart of a laser radar calibration method provided by an embodiment of the present invention; Figure 2 A schematic diagram of a kinematic model provided by an embodiment of the present invention; Figure 3 A schematic diagram of a flow chart of a coordinate conversion method provided by an embodiment of the present invention; Figure 4 A schematic diagram of a flow chart of a method for determining a plane voxel provided by an embodiment of the present invention; Figure 5 A schematic diagram of a flow chart of a plane equation fitting method provided by an embodiment of the present invention; Figure 6 A schematic diagram of a flow chart of an external parameter optimization method provided by an embodiment of the present invention; Figure 7 A schematic diagram of the structure of a laser radar calibration device provided by an embodiment of the present invention; Figure 8 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0019] The preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of the present invention and are used together with the embodiments of the present invention to illustrate the principles of the present invention, but are not used to limit the scope of the present invention.

[0020] The descriptions of "first", "second", etc. involved in the embodiments of the present invention are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the technical features defined as "first" and "second" may explicitly or implicitly include at least one of the features.

[0021] Reference to an "embodiment" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0022] A specific embodiment of the present invention, as Figure 1 As shown, a laser radar calibration method is disclosed, in which the laser radar to be calibrated is set on a rotating motor, including: S101, obtaining point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles; S102, converting each point cloud data into a motor zero-degree coordinate system using a preset initial external parameter and a motor rotation angle corresponding to the point cloud data; S103, determining a plane voxel based on the point cloud coordinates of each point cloud data in a preset voxel, and fitting a plane equation corresponding to each plane voxel; S104, matching each plane equation according to a preset matching criterion, and calculating the external parameters of the laser radar to be calibrated based on the conversion relationship between the successfully matched plane pairs.

[0023] In an embodiment of the present invention, in order to increase the field of view of the laser radar, the laser radar is fixedly mounted on the rotating shaft of the rotating motor, and the rotation of the motor rotating shaft drives the laser radar to rotate, so that the laser radar can achieve a 720-degree acquisition viewing angle. When calibrating the external parameters of the laser radar and the motor, the error of the laser radar collecting point cloud when the motor rotates is mainly calibrated. Optionally, the laser radar driven by the motor can be placed in a scene with rich planar features, such as an empty room, by controlling the rotation of the motor and controlling the laser radar to scan the scene at different rotation angles, and obtaining point cloud data corresponding to different rotation angles.

[0024] Further, for the convenience of explanation, Figure 2 As shown in the figure, a kinematic model diagram is provided. During the rotation of the motor, the laser radar coordinate system rotates rigidly around the motor shaft. The origin of the motor coordinate system is the intersection of the plane where the laser radar coordinate system origin rotates and the motor shaft. When the motor is at 0°, the motor coordinate system x The axis points to the origin of the LiDAR coordinate system. y The axis is the radial direction of the motor shaft, and the motor zero degree coordinate system xyz The external parameters of the laser radar and the motor include the rotation matrix R required for the axis of the laser radar coordinate system to rotate parallel to the motor zero-degree coordinate system, and the translation vector t between the laser radar coordinate system and the motor coordinate system after the rotation is parallel. For example, for the laser radar coordinate system when the motor is at the first rotation angle, The radar coordinate system when the motor is at the second rotation angle Can be converted to the motor zero degree coordinate system based on external parameters R, t and motor rotation angle xyz Based on this, each point cloud data can be converted to the motor zero-degree coordinate system using formula (1) based on the preset initial external parameters and the motor rotation angle corresponding to the point cloud data: (1) in, is the three-dimensional coordinate of the point cloud data in the motor zero-degree coordinate system, For rotating motor y The rotation matrix for axis rotations, is the three-dimensional coordinate of the point cloud data in the laser radar coordinate system, R is the rotation matrix, t is the translation vector, I is the identity matrix.

[0025] Furthermore, by expanding formula (1), we can obtain formula (2): (2) Representing formula (2) in a matrix gives formula (3): (3) Where T is the transformation matrix .

[0026] Furthermore, assuming that for the same point cloud data, it is represented by and , then the following relationship exists: (4) Where superscript T represents matrix transpose, the following relationship exists: (5) Then, the transformation relationship between the two coordinate systems can be obtained: (6) Based on the conversion relationship of formula (6), the coordinates of the point cloud in the laser radar in each point cloud data can be converted into the coordinates in the motor zero-degree coordinate system.

[0027] Furthermore, the preset voxel is the smallest spatial unit obtained by spatially segmenting the scene where the laser radar is located. Based on the coordinates of the point cloud in each voxel, it can be determined whether the voxel is a plane voxel. For a plane voxel, the coordinates of each point cloud in the plane voxel need to be assembled to fit the plane equation. The specific determination method of the plane voxel and the specific fitting method of the plane equation are described in detail later in the present invention.

[0028] Furthermore, the plane equations corresponding to the point cloud data in different frames in each plane voxel are matched. For the successfully matched plane pairs, the external parameters of the laser radar to be calibrated are optimized based on the transformation relationship between the planes and the minimization of the distance between the planes to obtain the accurate external parameters of the laser radar to be calibrated.

[0029] The embodiment of the present invention obtains point cloud data collected by a laser radar when a rotating motor is at different optional angles, converts the point cloud data into a motor zero-degree coordinate system for plane fitting, and calculates the external parameters of the laser radar to be calibrated based on the relationship between the fitted planes. By performing plane fitting on the laser radar point cloud to eliminate random errors, the external parameters are optimized through plane feature matching and the relationship between planes. No special calibration tools are required, and the system is less affected by random errors and has higher accuracy.

[0030] As a possible implementation manner of the present invention, in this implementation manner, obtaining point cloud data collected by a laser radar to be calibrated when the rotating motor is at different rotation angles includes: When the rotating motor rotates from zero degree at each preset interval angle, the point cloud data collected by the laser radar to be calibrated is obtained until the rotating motor rotates one circle.

[0031] In an embodiment of the present invention, the preset interval angle can be set according to actual conditions, such as 10°. Starting from when the motor shaft is at 0°, point cloud data obtained by scanning the laser radar calibration scene is acquired every 10°. A total of 36 acquisitions are made to obtain 36 point cloud data when the motor is at different angles.

[0032] Further, such as Figure 3 As shown, each point cloud data is converted to the motor zero-degree coordinate system using the preset initial external parameters and the motor rotation angle corresponding to the point cloud data, including: S301, obtaining the laser radar three-dimensional coordinates of each point cloud in the laser radar coordinate system in the point cloud data; S302, combining the preset initial external parameters and the camera rotation angle corresponding to the point cloud data, transforming the laser radar three-dimensional coordinates to obtain the motor zero-degree three-dimensional coordinates of each point cloud in the point cloud data in the motor zero-degree coordinate system.

[0033] In the embodiment of the present invention, for the point cloud data collected by the laser radar when the motor is at different rotation angles, the laser radar three-dimensional coordinates of each point cloud in each frame of point cloud data in the laser radar coordinate system are obtained, and the external parameter initial values ​​R and t are used to convert the laser radar three-dimensional coordinates into the motor zero-degree three-dimensional coordinates in the motor zero-degree coordinate system. Specifically, formula (6) can be used for conversion.

[0034] Further, such as Figure 4 As shown, the plane voxel is determined based on the point cloud coordinates of each point cloud data in the preset voxel, including: S401, dividing the space corresponding to the point cloud data into voxels to obtain a plurality of voxels, and obtaining the motor zero-degree three-dimensional coordinates of the point cloud located in each voxel in each frame of the point cloud data; S402, for each voxel, performing a centroid removal operation on the point cloud in the voxel based on the motor zero-degree three-dimensional coordinates of the point cloud in the voxel, and calculating a covariance matrix of the point cloud based on the motor zero-degree three-dimensional coordinates of the point cloud after the centroid removal operation; S403, performing eigendecomposition on the covariance matrix to obtain plane eigenvalues, and when the plane eigenvalues ​​meet a preset plane identification criterion, determining that the voxel is a plane voxel.

[0035] In an embodiment of the present invention, the scene where the laser radar is located can be divided into voxels in advance, such as dividing the space where the converted point cloud is located into voxels according to a preset size (such as 20 cm) to obtain multiple voxels, and obtaining the motor zero-degree three-dimensional coordinates of the point cloud located in each voxel in each frame of point cloud data.

[0036] Furthermore, for each voxel, the number of point clouds in a certain frame of point cloud data in the voxel is n, and the n point clouds need to be de-centred first. Specifically, the centroid of the n point clouds can be calculated using formula (7): (7) in, is the centroid coordinate of the voxel, is the motor zero-degree three-dimensional coordinate of the i-th point cloud.

[0037] Then, the centroid of each point cloud in the voxel is removed using formula (8): (8) in, is the zero-degree three-dimensional coordinate of the motor after removing the centroid of the i-th point cloud.

[0038] Then, the covariance matrix of the point cloud after removing the centroid in the voxel is calculated using formula (9): (9) in, cov is the covariance matrix of the point cloud after removing the centroid in this voxel.

[0039] Performing eigenvalue decomposition on the covariance matrix can obtain three eigenvalues ​​sorted from small to large: , , If the three eigenvalues ​​satisfy the following plane identification criteria, the voxel is determined to be a planar voxel: (10) in, , ratio is the preset judgment threshold, which is generally 0.7.

[0040] The embodiment of the present invention removes the centroid of the coordinates of the point cloud in the voxel, and determines whether the voxel is a planar voxel based on the coordination difference matrix of the point cloud after removing the centroid, so as to facilitate the subsequent determination of the plane.

[0041] As a possible implementation mode of the present invention, in this implementation mode, Figure 5 As shown, the plane equations corresponding to each plane voxel are fitted, including: S501, performing plane fitting on the point cloud in the plane voxel using a random sampling consistency algorithm to determine the inner point of the plane corresponding to the plane voxel in the point cloud; S502, performing least square fitting on the motor zero-degree three-dimensional coordinates of the inner point to obtain the plane equation corresponding to the plane voxel.

[0042] In the embodiment of the present invention, the point cloud in the plane voxel is fitted with a random sampling consistency algorithm, the point cloud regarded as out-of-plane points is removed, and the plane equation is obtained by least square fitting of all the inner points. Optionally, the point cloud is fitted with a random sampling consistency algorithm. If the fitting is successful, the plane parameters can be obtained through the coordinates of all the inner points. The plane equation is in the form of: (11) Furthermore, the equation can be obtained based on the motor zero-degree coordinates of all interior points: (12) in, a , b , c , d are the parameters of the plane equation, For then The motor zero-degree coordinates of the point cloud, for the matrix A Singular value decomposition can be used to solve the parameters of the plane, based on which the plane equation corresponding to the plane voxel can be calculated.

[0043] Further, such as Figure 6 As shown, each plane equation is matched according to a preset matching criterion, and the external parameters of the laser radar to be calibrated are calculated based on the conversion relationship between the successfully matched plane equations, including: S601, matching the plane equations obtained by fitting point cloud data of different frames in the same plane voxel according to a preset matching criterion to determine a successfully matched plane pair; S602, converting the plane equations of each plane in the plane pair from the motor zero-degree three-dimensional coordinate system to the laser radar coordinate system according to a preset plane conversion formula, to obtain the laser radar three-dimensional coordinate equations corresponding to each plane in the plane pair; S603, based on the rotation angle and initial external parameters of the motor when collecting the point cloud data corresponding to the plane pair, convert the three-dimensional coordinate equation of the laser radar corresponding to each plane in the plane pair into a zero-degree three-dimensional coordinate system to obtain the zero-degree three-dimensional coordinate equation of the motor corresponding to each plane in the plane pair; S604, based on the motor zero-degree three-dimensional coordinate equations corresponding to each plane in the plane alignment, a nonlinear iterative method is used to minimize the error between planes to obtain the external parameters of the laser radar to be calibrated.

[0044] In the embodiment of the present invention, when matching plane equations obtained by fitting point clouds of different frames in the same plane voxel, the following matching principles are followed: 1) The inner product of the normal vectors of the two planes is greater than the preset inner product threshold, which can generally be set to 0.9; and 2) The difference between the distances of the two planes and the origin is less than a preset distance difference threshold, which can generally be set to 1 cm; and 3) The average value of the distance between the corresponding inner points of the two planes is less than the preset average value threshold, which can generally be set to 1 cm.

[0045] When the two plane equations satisfy the above three conditions at the same time, the two planes are determined to be matched successfully. For the two successfully matched planes, the plane equations of the two planes and the corresponding motor rotation angles are obtained. Formula (6) is used to convert the plane equations of the two planes from the motor zero-degree coordinate system to the lidar coordinate system to obtain the lidar three-dimensional coordinate equations of the two planes. Then, the lidar three-dimensional coordinate equation is converted to the motor zero-degree coordinate system according to its rotation angle and the current external parameters to obtain the motor zero-degree three-dimensional coordinate equations of the two planes. Furthermore, the current external parameters are optimized using formulas (13) and (14): (13) (14) in, is the first residual term, is the second residual term, weight is the preset residual term weight, usually set to 300, is the inner product of the direction vectors of the two planes.

[0046] By minimizing and , the residual between the planes can be minimized, and the corresponding external parameter is the exact solution of the lidar to be calibrated.

[0047] The embodiment of the present invention can continuously optimize the extrinsic parameter value of the laser radar by minimizing the distance between the surfaces, so that the extrinsic parameter calibration is more accurate.

[0048] In order to better implement the laser radar calibration method in the embodiment of the present invention, based on the laser radar calibration method, correspondingly, Figure 7 As shown, the embodiment of the present invention further provides a laser radar calibration device, and the laser radar calibration device 700 includes: The point cloud data acquisition module 701 is used to acquire point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles; A coordinate conversion module 702 is used to convert each point cloud data into a motor zero-degree coordinate system by using a preset initial external parameter and a motor rotation angle corresponding to the point cloud data; The plane fitting module 703 is used to determine the plane voxels based on the point cloud coordinates of each point cloud data in the preset voxels in the motor zero-degree coordinate system, and perform plane fitting based on the point cloud in each plane voxel to obtain the plane equation corresponding to each plane voxel; The external parameter calculation module 704 is used to match the plane equations according to a preset matching criterion, and calculate the external parameters of the laser radar to be calibrated based on the conversion relationship between the successfully matched plane pairs.

[0049] The laser radar calibration device 700 provided in the above embodiment can implement the technical solution described in the above laser radar calibration method embodiment. The specific implementation principles of the above modules or units can refer to the corresponding contents in the above laser radar calibration method embodiment, which will not be repeated here.

[0050] The embodiment of the present invention obtains point cloud data collected by a laser radar when a rotating motor is at different optional angles, converts the point cloud data into a motor zero-degree coordinate system for plane fitting, and calculates the external parameters of the laser radar to be calibrated based on the relationship between the fitted planes. By performing plane fitting on the laser radar point cloud to eliminate random errors, the external parameters are optimized through plane feature matching and the relationship between planes. No special calibration tools are required, and the system is less affected by random errors and has higher accuracy.

[0051] like Figure 8 As shown, the present invention also provides an electronic device 800. The electronic device 800 includes a processor 801, a memory 802 and a display 803. Figure 8 Only some components of the electronic device 800 are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0052] In some embodiments, the processor 801 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run program codes or process data stored in the memory 802, such as the laser radar calibration method in the present invention.

[0053] In some embodiments, the processor 801 may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, the processor 801 may be local or remote. In some embodiments, the processor 801 may be implemented in a cloud platform. In some embodiments, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-cloud, etc., or any combination thereof.

[0054] In some embodiments, the memory 802 may be an internal storage unit of the electronic device 800, such as a hard disk or memory of the electronic device 800. In other embodiments, the memory 802 may also be an external storage device of the electronic device 800, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc., equipped on the electronic device 800.

[0055] Furthermore, the memory 802 may include both an internal storage unit of the electronic device 800 and an external storage device. The memory 802 is used to store application software installed in the electronic device 800 and various data.

[0056] In some embodiments, the display 803 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 803 is used to display information of the electronic device 800 and to display a visual user interface. The components 801-803 of the electronic device 800 communicate with each other via a system bus.

[0057] In some embodiments, when the processor 801 executes the laser radar calibration program in the memory 802, the following steps may be implemented: Obtaining point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles; Each point cloud data is converted to the motor zero-degree coordinate system using the preset initial external parameters and the motor rotation angle corresponding to the point cloud data; Determine the plane voxel based on the point cloud coordinates of each point cloud data in the preset voxel, and fit the plane equation corresponding to each plane voxel; The plane equations are matched according to the preset matching criteria, and the external parameters of the laser radar to be calibrated are calculated based on the transformation relationship between the successfully matched plane pairs.

[0058] It should be understood that: when the processor 801 executes the lidar calibration program in the memory 802, in addition to the above functions, other functions can also be implemented. For details, please refer to the description of the corresponding method embodiment above.

[0059] Furthermore, the embodiment of the present invention does not specifically limit the type of the electronic device 800 mentioned, and the electronic device 800 may be a portable electronic device such as a mobile phone, a tablet computer, a personal digital assistant (PDA), a wearable device, a laptop computer, etc. Exemplary embodiments of portable electronic devices include but are not limited to portable electronic devices equipped with IOS, Android, Microsoft or other operating systems. The above-mentioned portable electronic devices may also be other portable electronic devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of the present invention, the electronic device 800 may not be a portable electronic device, but a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0060] Correspondingly, an embodiment of the present invention also provides a computer-readable storage medium, which is used to store computer-readable programs or instructions. When the program or instructions are executed by a processor, the steps or functions in the laser radar calibration method provided in the above-mentioned method embodiments can be implemented.

[0061] Those skilled in the art can understand that all or part of the processes of the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, wherein the computer-readable storage medium is a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0062] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by any technician familiar with the technical field within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention.

Claims

1. A laser radar calibration method, characterized in that: The laser radar to be calibrated is set on a rotating motor, including: Acquire point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles; The point cloud data are converted into a motor zero-degree coordinate system by using a preset initial external parameter and a motor rotation angle corresponding to the point cloud data; Determine the plane voxel based on the point cloud coordinates of each point cloud data in the preset voxel, and fit the plane equation corresponding to each of the plane voxels; The plane equations are matched according to a preset matching criterion, and the external parameters of the laser radar to be calibrated are calculated based on the conversion relationship between the successfully matched plane pairs.

2. The laser radar calibration method according to claim 1, characterized in that: The step of obtaining the point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles includes: When the rotating motor rotates from zero degree at each preset interval angle, point cloud data collected by the laser radar to be calibrated is obtained until the rotating motor rotates one circle.

3. The laser radar calibration method according to claim 1, characterized in that: The point cloud data are converted to a motor zero-degree coordinate system using a preset initial external parameter and a motor rotation angle corresponding to the point cloud data, including: Obtain the laser radar three-dimensional coordinates of each point cloud in the laser radar coordinate system in the point cloud data; In combination with the preset initial external parameters and the camera rotation angle corresponding to the point cloud data, the laser radar three-dimensional coordinates are transformed to obtain the motor zero-degree three-dimensional coordinates of each point cloud in the point cloud data in the motor zero-degree coordinate system.

4. The laser radar calibration method according to claim 3, characterized in that: The step of determining the plane voxel based on the point cloud coordinates of each point cloud data in the preset voxel includes: Divide the space corresponding to the point cloud data into voxels to obtain a plurality of voxels, and obtain the motor zero-degree three-dimensional coordinates of the point cloud located in each voxel in each frame of the point cloud data; For each voxel, performing a centroiding operation on the point cloud in the voxel based on the motor zero-degree three-dimensional coordinates of the point cloud in the voxel, and calculating a covariance matrix of the point cloud based on the motor zero-degree three-dimensional coordinates of the point cloud after the centroiding operation; The covariance matrix is ​​subjected to eigendecomposition to obtain a plane eigenvalue, and when the plane eigenvalue meets a preset plane identification criterion, the voxel is determined to be a plane voxel.

5. The laser radar calibration method according to claim 4, characterized in that: The fitting of the plane equations corresponding to the plane voxels comprises: Performing plane fitting on the point cloud in the plane voxels using a random sampling consistency algorithm to determine the inner points of the plane corresponding to the plane voxels in the point cloud; The plane equation corresponding to the plane voxel is obtained by performing least square fitting on the motor zero-degree three-dimensional coordinates of the interior point.

6. The laser radar calibration method according to claim 5, characterized in that: The step of matching the plane equations according to a preset matching criterion and calculating the external parameters of the laser radar to be calibrated based on the conversion relationship between the successfully matched plane equations includes: The plane equations obtained by fitting point cloud data of different frames in the same plane voxel are matched according to a preset matching criterion to determine the successfully matched plane pairs; According to a preset plane conversion formula, the plane equations of each plane in the plane pair are converted from the motor zero-degree three-dimensional coordinate system to the laser radar coordinate system to obtain the laser radar three-dimensional coordinate equations corresponding to each plane in the plane pair; Based on the rotation angle and initial external parameters of the motor when collecting the point cloud data corresponding to the plane pair, the three-dimensional coordinate equation of the laser radar corresponding to each plane in the plane pair is converted into a zero-degree three-dimensional coordinate system to obtain the zero-degree three-dimensional coordinate equation of the motor corresponding to each plane in the plane pair; Based on the motor zero-degree three-dimensional coordinate equations corresponding to each plane in the plane pair, a nonlinear iterative method is used to minimize the error between planes to obtain the external parameters of the laser radar to be calibrated.

7. The laser radar calibration method according to claim 6, characterized in that: The preset matching criteria include: The inner product of the normal vectors of the two planes is greater than a preset inner product threshold; and The difference between the distances of the two planes and the origin is less than a preset distance difference threshold; and The average value of the distances between the corresponding inner points of the two planes is less than a preset average value threshold.

8. A laser radar calibration device, characterized in that: The laser radar to be calibrated is set on a rotating motor, including: A point cloud data acquisition module, used to acquire point cloud data collected by the laser radar to be calibrated when the rotating motor is at different rotation angles; A coordinate conversion module, used to convert each of the point cloud data into a motor zero-degree coordinate system by using a preset initial external parameter and a motor rotation angle corresponding to the point cloud data; A plane fitting module, used for determining plane voxels based on the point cloud coordinates of each point cloud data in a preset voxel in the motor zero-degree coordinate system, and performing plane fitting based on the point cloud in each plane voxel to obtain a plane equation corresponding to each plane voxel; The external parameter calculation module is used to match the plane equations according to a preset matching criterion, and calculate the external parameters of the laser radar to be calibrated based on the conversion relationship between the successfully matched plane pairs.

9. An electronic device, characterized in that: comprising a memory and a processor, wherein: The memory is used to store programs; The processor is coupled to the memory and is used to execute the program stored in the memory to implement the steps in the laser radar calibration method described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: Used to store computer-readable programs or instructions, which, when executed by a processor, can implement the steps in the lidar calibration method described in any one of claims 1 to 7.

Citation Information

Cited By

  • Ship loader cabin moving auxiliary method, device and equipment based on laser radar and medium

    CN119429760A

  • Deviation calibration method of laser radar

    CN119986612A