A method and device for calibrating parameters of a mobile laser scanning system

Through automated point cloud matching and nonlinear optimization algorithms, external parameter calibration of mobile laser scanning systems is realized, solving the problems of low efficiency and difficulty in ensuring accuracy in the existing technology, and achieving efficient and accurate external parameter calibration.

CN114755661BActive Publication Date: 2024-11-15WUHAN UNIV +2
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210203786.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-03
Publication Date
2024-11-15
Estimated Expiration
2042-03-03

AI Technical Summary

Technical Problem

The mobile laser scanning system has problems such as low efficiency, high workload and difficult to ensure accuracy during the external parameter calibration process. It is mainly because the calibration of the rotation angle requires manual adjustment, which leads to low efficiency and is affected by subjective judgment errors.

Method used

Using an automated parameter calibration method, by obtaining laser point clouds of multiple aircraft belts, solving and matching point clouds, using VGICP algorithm and LM nonlinear optimization algorithm to solve external parameters, including translation matrix and rotation matrix, until the solution is done. The average error change of the point pairs of the same name before and after is less than the threshold, achieving fully automatic and efficient calibration.

Benefits of technology

It realizes fully automatic and efficient calibration of the mobile laser scanning system, saves manpower, improves efficiency, and does not require external control fields. The calibration process is flexible and reduces errors caused by human operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114755661B_ABST
    Figure CN114755661B_ABST
Patent Text Reader

Abstract

This invention provides a method and apparatus for calibrating the extrinsic parameters of a mobile laser scanning system. The calibration method includes: Step 1, acquiring laser point clouds of multiple flight strips scanned by the mobile laser scanning system; Step 2, calculating the laser point clouds based on the initial extrinsic parameters and positioning data of the mobile laser scanning system to obtain point clouds in a geodetic coordinate system; Step 3, matching point clouds of different flight strips pairwise to obtain corresponding point pairs; Step 4, solving for the extrinsic parameters of the mobile laser scanning system by minimizing the distance between corresponding point pairs; Step 5, repeating steps 2 to 4 based on the extrinsic parameters of the mobile laser scanning system until the average error change between corresponding point pairs before and after calculation is less than a threshold, thereby obtaining the final extrinsic parameters of the mobile laser scanning system. This invention eliminates the need for repeated manual adjustment of angles, reducing a large amount of manual operation, greatly improving efficiency, and to a certain extent reducing errors caused by human operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of parameter calibration, and more specifically, to a parameter calibration method and a calibration device for a mobile laser scanning system. Background Art

[0002] Mobile LiDAR technology integrates GNSS, IMU, laser scanners and other sensors into mobile platforms such as drones, and uses direct geo-orientation technology to efficiently acquire three-dimensional spatial information and attribute information of objects during the movement of the platform. It is widely used in agricultural and forestry surveys, military surveys, water conservancy and hydropower surveys and design, road design, land resources and meteorological environment surveys, national basic surveying and mapping, urban planning, dynamic monitoring of coal mine geological environment, and other major fields. It is one of the most advanced geospatial information acquisition technologies currently.

[0003] In the mobile laser scanning system, the laser scanner and the inertial measurement unit (IMU) are rigidly installed on the platform. The translation and rotation angles between the laser scanner coordinate system and the inertial navigation coordinate system are called the external parameters of the mobile laser scanning system. The inaccuracy of the external parameters is an important factor affecting the positioning accuracy of the mobile laser scanning system. Before the mobile laser scanning system is officially put into use, the external parameters need to be accurately calibrated.

[0004] The translation parameters of the external parameters can be accurately obtained through the design drawings or directly measured to obtain more accurate values, but the rotation parameters cannot be measured, and the design values ​​often have movement deviations. Usually, the "accurate" rotation angle parameters are obtained by repeatedly solving the laser point cloud and manually adjusting the rotation angle until the point clouds between different routes "perfectly" overlap. During the manual calibration process, the calibration of the roll angle requires the point clouds corresponding to two routes with opposite flight directions. Due to the existence of the roll angle, the point clouds of the round-trip routes will have cross-dislocations in the cross section, such as Figure 1 As shown, adjust the calibration angle of the Roll angle until the two color point clouds coincide.

[0005] The inspection of the pitch angle requires the point clouds corresponding to the two flight strips. Due to the existence of the pitch angle, objects that are higher than the average ground will be misaligned on the cross section parallel to the flight strip direction, and the higher the misalignment, the more obvious it is. Figure 2 As shown, adjust the calibration angle value of the Pitch angle until the two color point clouds coincide.

[0006] The inspection of the heading angle requires point clouds corresponding to two flight strips in the same direction. Due to the existence of the heading angle, objects that are higher than the average ground surface on the cross section parallel to the flight strip direction will be misaligned, and the higher the misalignment, the more obvious it is. Figure 3As shown in , the calibration angle of the Heading angle is adjusted until the two color point clouds overlap.

[0007] The above method of repeatedly solving the laser point cloud and manually adjusting the rotation angle until the point clouds between different routes "perfectly" overlap to obtain "accurate" rotation angle parameters is time-consuming, labor-intensive, and inefficient. At the same time, it is affected by the subjective judgment errors of different operators. There is an urgent need for an automatic external parameter calibration method to improve work efficiency. Summary of the invention

[0008] In order to solve the problems of low efficiency, large workload, and difficulty in ensuring accuracy in calibrating the external parameters of a mobile laser scanning system by manually adjusting parameters, the present invention proposes a method for calibrating parameters of a mobile laser scanning system, which does not require manual repeated adjustment of angles and eliminates a large amount of manual operation, greatly improves efficiency and reduces errors caused by manual operation to a certain extent.

[0009] According to a first aspect of the present invention, a method for calibrating parameters of a mobile laser scanning system is provided, wherein the mobile laser scanning system comprises a laser scanner, an inertial measurement unit and a combined positioning and attitude determination system, and the method comprises:

[0010] Step 1, obtaining laser point clouds of multiple flight strips scanned by a mobile laser scanning system;

[0011] Step 2, based on the initial external parameters and positioning data of the mobile laser scanning system, the laser point cloud is solved to obtain point clouds in the geodetic coordinate system of multiple flight paths;

[0012] Step 3, matching point clouds of different flight strips in pairs to obtain point pairs with the same name between point clouds of different flight strips;

[0013] Step 4, solving the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs, where the external parameters of the mobile laser scanning system are the translation matrix and the rotation matrix of the laser scanner relative to the inertial measurement unit;

[0014] Step 5: Based on the calculated external parameters of the mobile laser scanning system, repeat steps 2 to 4 until the average error change between the same-name point pairs before and after the solution is less than the threshold value, and obtain the final external parameters of the mobile laser scanning system.

[0015] According to a second aspect of the present invention, there is provided a mobile laser scanning system parameter calibration device, comprising:

[0016] An acquisition module, used for acquiring laser point clouds of multiple flight strips scanned by a mobile laser scanning system;

[0017] A solution module, used for solving the laser point cloud based on the initial external parameters and positioning data of the mobile laser scanning system to obtain point clouds in the geodetic coordinate system of multiple flight paths;

[0018] The registration module is used to match point clouds of different flight strips in pairs to obtain the same-name point pairs between point clouds of different flight strips;

[0019] A solution module is used to solve the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs. The external parameters of the mobile laser scanning system are the translation matrix and rotation matrix of the laser scanner relative to the inertial measurement unit; based on the calculated external parameters of the mobile laser scanning system, the solution module, the registration module and the solution module are repeatedly executed until the average error change between the same-name point pairs before and after the solution is less than a threshold value, so as to obtain the final external parameters of the mobile laser scanning system.

[0020] According to a third aspect of the present invention, there is provided an electronic device comprising a memory and a processor, wherein the processor is used to implement the steps of a method for calibrating parameters of a mobile laser scanning system when executing a computer management program stored in the memory.

[0021] According to a fourth aspect of the present invention, there is provided a computer-readable storage medium on which a computer management program is stored, and when the computer management program is executed by a processor, the steps of a method for calibrating parameters of a mobile laser scanning system are implemented.

[0022] A mobile laser scanning system parameter calibration method and calibration device provided by the present invention can realize fully automatic and efficient calibration of the mobile laser scanning system parameters, effectively saving manpower and improving efficiency; the calibration process does not require an external control field and is not restricted by the flight site, and the calibration of the external parameters of the mobile laser scanning system can be conveniently completed anytime and anywhere. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 This is a schematic diagram showing that during manual calibration, due to the existence of the roll angle, the round-trip route point cloud will have cross-sectional misalignment;

[0024] Figure 2 This is a schematic diagram showing that during manual calibration, due to the existence of the pitch angle, objects that are higher than the average ground surface will be misplaced on the cross section parallel to the flight path direction;

[0025] Figure 3 This is a schematic diagram showing that during manual calibration, due to the existence of the Heading angle, objects above the average ground level will be misplaced on the cross section parallel to the flight path direction.

[0026] Figure 4 It is a schematic diagram of the relationship between each sensor and coordinate system in the mobile laser scanning system;

[0027] Figure 5-1 This is a schematic diagram of the point cloud between flight strips when there is no error;

[0028] Figure 5-2 This is a schematic diagram of the point cloud between flight strips when there is an obvious error;

[0029] Figure 6 A flow chart of a method for calibrating parameters of a mobile laser scanning system provided by the present invention;

[0030] Figure 7 A schematic diagram of the entire process of parameter calibration of the mobile laser scanning system of the present invention;

[0031] Figure 8 A schematic diagram of the structure of a mobile laser scanning system parameter calibration device provided by the present invention;

[0032] Fig. 9 A schematic diagram of the hardware structure of a possible electronic device provided by the present invention;

[0033] Fig.10 A schematic diagram of the hardware structure of a possible computer-readable storage medium provided by the present invention. DETAILED DESCRIPTION

[0034] The specific implementation of the present invention is further described in detail below in conjunction with the accompanying drawings and examples. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0035] UAV laser scanning system During the flight of the UAV, the laser scanner continuously scans the ground objects, while the GNSS / INS combined positioning and attitude system records GNSS observation data and inertial measurement data at a high frequency, and obtains the position and attitude information of the platform through post-processing. In the UAV laser scanning system, the GNSS / INS combined positioning and attitude system provides the absolute position and attitude of the platform, and the laser scanner provides the relative measurement information of the ground objects relative to the laser scanner coordinate system. The relationship between the measurement data of each sensor in the UAV laser scanning system is as follows Figure 4 shown.

[0036] As above Figure 4 As shown in the figure, the coordinates of the ground point P measured by the laser scanner in the laser scanner coordinate system are P L , the relationship between the laser scanner and the inertial measurement unit IMU is rigidly fixed, and the coordinates of the ground point P in the laser scanner coordinate system, the inertial navigation coordinate system and the world coordinate system can be obtained by the following formula:

[0037]

[0038]

[0039] Substituting formula (1) into formula (2), we can obtain:

[0040]

[0041] In formula (1), formula (2) and formula (3): P L =[x L y L z L ] T is the spatial rectangular coordinate of the ground point P in the laser scanner coordinate system; P IMU is the coordinate of the ground point P in the inertial navigation coordinate system; W is the coordinate of the ground point P in the WGS84 Earth-centered Earth-fixed coordinate system; is the position of the origin of the laser scanner coordinate system in the inertial navigation coordinate system; The rotation matrix for transforming the laser scanner coordinate system to the inertial navigation coordinate system; is the position of the origin of the inertial navigation coordinate system in the WGS84 Earth-centered Earth-fixed space rectangular coordinate system; The rotation matrix for transforming the inertial navigation coordinate system into the WGS84 Earth-centered Earth-fixed rectangular coordinate system.

[0042] Ideally, there is no error in the UAV laser scanning system, and the laser point clouds of the UAV laser scanning system scanning the same object multiple times theoretically completely overlap. Figure 5-1 As shown in the figure, the laser point clouds of the two scans of the ground object by the UAV laser scanning system can completely overlap; in actual situations, due to the positioning and attitude errors of the GNSS / INS system, the measurement errors of the laser scanner, and the inaccuracy of the external parameters of the laser scanner, the laser scanning system’s multiple scans of the ground object cannot completely overlap, such as Figure 5-2 As shown, there is an offset between the ground feature points in the two scans.

[0043] The UAV laser scanning system does not have the occlusion and multipath effects of GNSS signals. When the inertial navigation attitude accuracy is guaranteed, it can be considered that the relative position error of the point cloud between flight strips is mainly caused by the measurement error of the laser scanner and the external parameter error. Therefore, the measurement error and external parameters of the laser scanner can be solved by minimizing the relative error of the point cloud between flight strips.

[0044] Based on this, the present invention provides a method for calibrating parameters of a mobile laser scanning system. Figure 6 , the calibration method mainly includes the following steps:

[0045] Step 1: Obtain laser point clouds of multiple flight strips scanned by a mobile laser scanning system.

[0046] It can be understood that the laser point clouds of the multiple flight paths scanned by the mobile laser scanning system in the present invention at least include the laser point cloud data of the ground objects of the multiple flight paths of the round-trip flight path or the parallel flight path.

[0047] Step 2: Based on the initial external parameters and positioning data of the mobile laser scanning system, the laser point cloud is solved to obtain point clouds in the geodetic coordinate system of multiple flight paths.

[0048] Step 3: Match point clouds of different flight strips in pairs to obtain point pairs with the same name between point clouds of different flight strips.

[0049] As an embodiment, in order to facilitate subsequent processing, the solved point cloud in the geodetic coordinate system is divided into blocks, and the point cloud is divided into flight strips according to the turning information in the positioning data; then, the point clouds of different flight strips in each block are matched pairwise to obtain the same-name points between the point clouds of different flight strips.

[0050] As an embodiment, the step 3, matching point clouds of different flight strips in pairs to obtain point pairs with the same name between point clouds of different flight strips, includes: matching point clouds of different flight strips based on the VGICP algorithm to obtain point pairs with the same name between different flight strips.

[0051] Among them, the point clouds of different flight strips are matched based on the VGICP algorithm to obtain the same-name point pairs between different flight strips, including: based on the point cloud to be registered and the reference point cloud, registration is performed through nearest neighbor search, the point cloud to be registered is the point cloud of one of the flight strips, and the reference point cloud is the point cloud of another flight strip; based on the surface where the laser point cloud is located obeys Gaussian distribution, a registration error is defined; based on the registration error, the registration parameters between the point cloud to be registered and the reference point cloud are obtained by maximizing the logarithm of the likelihood probability; based on the registration parameters, the point cloud to be registered is transformed, and for each transformed point, the nearest neighbor point is obtained in the reference point cloud, and the nearest neighbor point with a distance less than a set threshold is taken as the same-name point to constitute the same-name point pairs of two different flight strips.

[0052] It can be understood that the core of the external parameter calibration scheme of the mobile laser scanning system is the matching of the same-name points between flight strips and the external parameter solution method. The present invention adopts the VGICP (Voxelized General Iterative Closest Point) algorithm to obtain the same-name points between flight strips, and adopts the LM (Levenberg-Marquardt) nonlinear optimization method to solve the external parameters of the laser scanner.

[0053] The specific method of VGICP fast matching of same-name points is:

[0054] Although there are errors in the point cloud calculated using the initial laser scanner internal parameters and initial external parameters, the error size of the point cloud between different flight strips is sufficient to be directly registered using the precise registration algorithm. There are many algorithms that can be used for precise registration, such as ICP (Iterative Closest Point) and its variants, NDT (Normal Distribution Transform) and its variants. The ICP registration algorithm iteratively finds the nearest neighbor points of each point in the point cloud to be registered in the reference point cloud, and obtains the registration parameters by minimizing the error between the nearest neighbor points. Since it needs to iteratively obtain the nearest neighbor points of each point in the point cloud to be registered in the reference point cloud, it is usually less efficient. The NDT algorithm grids the reference point cloud and uses Gaussian distribution to fit the distribution of the points in each grid. It obtains the transformation parameters by maximizing the likelihood probability of the point cloud to be registered in the reference point cloud distribution. The registration effect of the NDT algorithm is closely related to the selection of the grid size. An inappropriate grid size will greatly reduce the registration effect.

[0055] In the joint calibration of multi-sensor systems, it is necessary to efficiently obtain robust matching points with the same name between different flight strips. This project combines the advantages of the ICP algorithm and the NDT algorithm and uses the VGICP algorithm to achieve efficient and robust matching of point clouds between different flight strips.

[0056] Point cloud to be registered and reference point cloud as well as Indicates that N is the number of points in the point cloud to be registered and the reference point cloud. In the classic ICP registration, the nearest neighbor point search is performed so that b i =Ta i , T is the transformation matrix between the point cloud to be registered and the reference point cloud. GICP (Generalized-ICP) assumes that the surface where the laser point cloud is located obeys Gaussian distribution, that is Under this assumption, the registration error can be defined as:

[0057]

[0058] According to the properties of Gaussian distribution, d i It obeys the following Gaussian distribution:

[0059]

[0060] GICP obtains the optimal transformation matrix T by maximizing the logarithm of the likelihood probability:

[0061]

[0062] The VGICP algorithm expands formula (4) and not only calculates a i Its closest point b i The distance between them is calculated instead of ai Instead of The neighboring points {b j |||a i -b j The distance between ||<r} and:

[0063]

[0064] Formula (7) can be considered as a smoothing of the target point distribution. Like formula (5), d′ i The distribution of is:

[0065]

[0066]

[0067]

[0068] Finally, the optimal transformation T is obtained by maximizing the logarithm of the likelihood generalization of formula (8):

[0069]

[0070] In order to calculate formula (11) more efficiently, formula (11) is changed to:

[0071]

[0072] In formula (12), N i For point a i The number of neighboring points in the reference point cloud.

[0073] After obtaining the registration parameters between flight strips through VGICP, the registration parameters are used to transform the point cloud to be registered. For each transformed point, its nearest neighbor point is obtained in the reference point cloud, and the nearest neighbor point pairs with a distance less than the threshold are regarded as the same-name point pairs between flight strips.

[0074] Step 4, by minimizing the distance between pairs of points with the same name, solving the external parameters of the mobile laser scanning system, the external parameters of the mobile laser scanning system are the translation matrix and the rotation matrix of the laser scanner relative to the inertial measurement unit.

[0075] As an embodiment, step 4 solves the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs, including: establishing a positioning equation based on the same-name point pairs between different flight strips; constructing an objective function based on the positioning equation of each pair of the same-name point pairs, wherein the objective function minimizes the sum of the squares of the distances between all the same-name point pairs; and obtaining the least squares solution of the calibration parameters of the mobile laser scanning system based on the LM nonlinear optimization algorithm.

[0076] Specifically, the same-name points between different flight strips are obtained by the method in a) above. For the same ground feature point P obtained by scanning different flight strips, its positioning equation is shown in the following equations (13) and (14).

[0077]

[0078]

[0079] In formulas (13) and (14), as well as is the measured value of P in the laser scanner coordinate system during the two scans, which is a known value. as well as It is the rotation matrix composed of the position value and attitude value of the flight strip scan P at the moment POS. as well as is the rotation matrix composed of the position value and attitude value of the second scan P of the flight strip, which are all known values. and is unknown, that is, only the external parameters of the laser scanner that need to be solved are unknown.

[0080] Subtracting equation (14) from equation (13) will give equation (15). According to the analysis above, the left side of the equal sign in equation (15) should be minimized.

[0081]

[0082] In formula (15), and unknown, Represents three translation parameters, are three rotation matrices representing the angles of rotation around the X-axis, Y-axis, and Z-axis, respectively. Therefore, there are six independent unknowns in equation (15), as shown in equation (16).

[0083]

[0084] Using f(x) to express equation (15), we can obtain:

[0085]

[0086] When there are m pairs of points with the same name, m equations can be listed. Then the LM (Levenberg-Marquardt) nonlinear optimization algorithm can be used to obtain the least squares solution of the calibration parameters by minimizing the sum of squares of the m equations. The objective function in the solution is shown in the following formula (18):

[0087]

[0088] The LM (Levenberg-Marquardt) nonlinear optimization algorithm obtains the final solution through iteration. The relationship between the k+1th iteration solution and the kth iteration solution is:

[0089] x k+1 =x k -(J T J+λI) -1 J T f (19);

[0090] In formula (19), J is the Jacobian matrix. When the initial value is known (which can be obtained through design parameters), the final external parameters of the mobile laser scanning system can be obtained through iteration.

[0091] Step 5: Based on the calculated external parameters of the mobile laser scanning system, repeat steps 2 to 4 until the average error change between the same-name point pairs before and after the solution is less than the threshold value, and obtain the final external parameters of the mobile laser scanning system.

[0092] Specifically, based on the above steps 2 to 4, the external parameters of the mobile laser scanning system are solved, and steps 2 to 4 are repeated until the average error change between the same-name point pairs before and after the solution is less than the threshold value, so as to obtain the final external parameters of the mobile laser scanning system.

[0093] It can be understood that based on the laser point clouds of multiple flight strips, for example, there are laser point clouds of three flight strips, the laser point cloud of the first flight strip can be first registered and solved with the point cloud of the second flight strip to calculate the corresponding external parameters of the mobile laser scanning system. The point cloud of the third flight strip can be transformed according to the external parameters calculated by the point cloud of the first flight strip and the point cloud of the second flight strip, and then the transformed point cloud data of the third flight strip is registered with the point cloud of the first flight strip to obtain the same-name point pairs. If the registration effect is good, it means that the external parameters calculated by the point cloud of the first flight strip and the point cloud of the second flight strip are relatively accurate, and the external parameters of the final relatively stable and accurate laser scanning system are obtained in this way.

[0094] See also Figure 7, which is an overall flow chart of a parameter calibration method for a mobile laser scanning system provided by the present invention. The present invention uses a method of minimizing the relative error between flight strips and without external control to calibrate the external parameters of the laser scanner. The process of the calibration method is shown in the figure below. First, the laser point cloud is solved using the initial external parameters and positioning data to obtain a point cloud in the geodetic coordinate system; in order to facilitate subsequent processing, the solved point cloud in the geodetic coordinate system is divided into blocks, and the point cloud is divided into flight strips according to the turning information in the positioning data; then, the point clouds of different flight strips in each block are matched in pairs to obtain the same-name points between the point clouds of different flight strips, and finally, the external parameters of the laser scanner are solved by minimizing the distance between the same-name points. The point cloud is re-solved using the external parameters of the laser scanner obtained by the solution. If the change in the average error between the points with the same name before and after the solution is less than the threshold, it means that the external parameters of the laser scanner have stabilized and the calibration is terminated. Otherwise, the point cloud is re-solved using the external parameters of the laser scanner obtained, the points with the same name between flight strips are matched again and the external parameters of the laser scanner are solved again until the obtained parameters make the average error between the points with the same name no longer decrease, and the final external parameters of the laser scanning system are obtained.

[0095] See also Figure 8 An embodiment of the present invention provides a mobile laser scanning system parameter calibration device, which includes an acquisition module 801, a solution module 802, a registration module 803 and a solution module 804.

[0096] Among them, the acquisition module 801 is used to acquire the laser point clouds of multiple flight strips scanned by the mobile laser scanning system; the solution module 802 is used to solve the laser point clouds based on the initial external parameters and positioning data of the mobile laser scanning system to obtain point clouds in the geodetic coordinate system of multiple flight strips; the registration module 803 is used to match the point clouds of different flight strips in pairs to obtain the same-name point pairs between the point clouds of different flight strips; the solution module 804 is used to solve the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs, and the external parameters of the mobile laser scanning system are the translation matrix and rotation matrix of the laser scanner relative to the inertial measurement unit; based on the calculated external parameters of the mobile laser scanning system, the solution module, the registration module and the solution module are repeatedly executed until the average error change between the same-name point pairs before and after the solution is less than the threshold value, and the final external parameters of the mobile laser scanning system are obtained.

[0097] It can be understood that the mobile laser scanning system parameter calibration system provided by the present invention corresponds to the mobile laser scanning system parameter calibration method provided by the aforementioned embodiments. The relevant technical features of the mobile laser scanning system parameter calibration system can refer to the relevant technical features of the mobile laser scanning system parameter calibration method, which will not be repeated here.

[0098] See also Fig. 9, Fig. 9 Schematic diagram of an electronic device provided by an embodiment of the present invention. Fig. 9 As shown, an embodiment of the present invention provides an electronic device 900, including a memory 910, a processor 920, and a computer program 911 stored in the memory 910 and executable on the processor 920. When the processor 920 executes the computer program 911, the following steps are implemented: Step 1, obtaining laser point clouds of multiple flight strips scanned by a mobile laser scanning system; Step 2, solving the laser point clouds based on the initial external parameters and positioning data of the mobile laser scanning system to obtain point clouds in the geodetic coordinate system of the multiple flight strips; Step 3, matching point clouds of different flight strips in pairs to obtain same-name point pairs between point clouds of different flight strips; Step 4, solving the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs, the external parameters of the mobile laser scanning system being the translation matrix and the rotation matrix of the laser scanner relative to the inertial measurement unit; Step 5, based on the calculated external parameters of the mobile laser scanning system, repeatedly executing Steps 2 to 4 until the average error change between the same-name point pairs before and after the solution is less than a threshold value, and the final external parameters of the mobile laser scanning system are obtained.

[0099] See also Fig.10 , Fig.10 Schematic diagram of an embodiment of a computer-readable storage medium provided by the present invention. Fig.10 As shown, the present embodiment provides a computer-readable storage medium 1000, on which a computer program 1011 is stored. When the computer program 1011 is executed by a processor, the following steps are implemented: Step 1, obtaining laser point clouds of multiple flight strips scanned by a mobile laser scanning system; Step 2, based on the initial external parameters and positioning data of the mobile laser scanning system, solving the laser point clouds to obtain point clouds in the geodetic coordinate system of the multiple flight strips; Step 3, matching the point clouds of different flight strips in pairs to obtain the same-name point pairs between the point clouds of different flight strips; Step 4, solving the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs, the external parameters of the mobile laser scanning system being the translation matrix and the rotation matrix of the laser scanner relative to the inertial measurement unit; Step 5, based on the calculated external parameters of the mobile laser scanning system, repeating steps 2 to 4 until the average error change between the same-name point pairs before and after the solution is less than a threshold value, thereby obtaining the final external parameters of the mobile laser scanning system.

[0100] A mobile laser scanning system parameter calibration method and a calibration device provided in an embodiment of the present invention can realize fully automatic and efficient calibration of the mobile laser scanning system parameters, effectively saving manpower and improving efficiency; the calibration process does not require an external control field and is not restricted by the flight site, and the calibration of the external parameters of the mobile laser scanning system can be conveniently completed anytime and anywhere.

[0101] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0102] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0103] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0104] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0105] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0106] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0107] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for calibrating parameters of a mobile laser scanning system, wherein the mobile laser scanning system comprises a laser scanner, an inertial measurement unit and a combined positioning and attitude determination system, characterized in that: The method comprises: Step 1, obtaining laser point clouds of multiple flight strips scanned by a mobile laser scanning system; Step 2, based on the initial external parameters and positioning data of the mobile laser scanning system, the laser point cloud is solved to obtain point clouds in the geodetic coordinate system of multiple flight paths; Step 3: Based on the VGICP algorithm, point clouds of different flight strips are matched in pairs to obtain the same-name point pairs between point clouds of different flight strips; Step 4, solving the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs, where the external parameters of the mobile laser scanning system are the translation matrix and the rotation matrix of the laser scanner relative to the inertial measurement unit; Step 5: Based on the calculated external parameters of the mobile laser scanning system, steps 2 to 4 are repeated until the average error change between the same-name point pairs before and after the solution is less than a threshold value, thereby obtaining the final external parameters of the mobile laser scanning system. The step 4, solving the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs, includes: Establish positioning equations based on the same-name point pairs between different flight strips; Based on the positioning equation of each pair of points with the same name, an objective function is constructed, wherein the sum of squares of distances between all points with the same name is minimized; The least squares solution of the calibration parameters of the mobile laser scanning system is obtained based on the LM nonlinear optimization algorithm.

2. The calibration method according to claim 1, characterized in that: The plurality of flight strips at least include a round-trip flight strip or a plurality of parallel flight strips.

3. The calibration method according to claim 1, characterized in that: The step 3, based on the VGICP algorithm, matches point clouds of different flight strips in pairs to obtain point pairs with the same name between point clouds of different flight strips, includes: Based on the point cloud to be registered and the reference point cloud, registration is performed by nearest neighbor search, wherein the point cloud to be registered is the point cloud of one flight strip, and the reference point cloud is the point cloud of another flight strip; Based on the fact that the surface where the laser point cloud is located follows a Gaussian distribution, the registration error is defined; Based on the registration error, obtaining the registration parameters between the point cloud to be registered and the reference point cloud by maximizing the logarithm of the likelihood probability; Based on the registration parameters, the point cloud to be registered is transformed. For each transformed point, the nearest neighbor point is obtained in the reference point cloud. The nearest neighbor points with a distance less than the set threshold are regarded as homonymous points to form homonymous point pairs of two different flight strips.

4. The calibration method according to claim 3, characterized in that: The registration is performed by searching for nearest neighbor points based on the point cloud to be registered and the reference point cloud, including: Define the point cloud to be registered and the reference point cloud as well as Indicates that N is the number of points in the point cloud to be registered and the reference point cloud; By searching the nearest neighbor point, b i =Ta i , T is the transformation matrix between the point cloud to be registered and the reference point cloud, and the transformation matrix is ​​the registration parameter; The registration error is defined based on the surface where the laser point cloud is located obeying the Gaussian distribution, including: The surface where the laser point cloud is located obeys the Gaussian distribution, that is, Under this assumption, the registration error can be defined as: Among them, d i ′ The distribution of is: The step of obtaining the optimal transformation matrix between the point cloud to be registered and the reference point cloud by maximizing the logarithm of the likelihood probability based on the registration error comprises: The optimal transformation matrix T is obtained by maximizing the logarithm of the likelihood probability of the registration error: Among them, N i For point a i The number of neighboring points in the reference point cloud.

5. The calibration method according to claim 1, characterized in that: The positioning equation is established based on the same-name point pairs between different flight strips, including: in, as well as is the measured value of P in the laser scanner coordinate system during the two scans, which is a known value. as well as It is the rotation matrix composed of the position value and attitude value of the flight strip scan P at the moment POS. as well as is the rotation matrix composed of the position value and attitude value of the second scan P of the flight strip, which are all known values. and is unknown, that is, the external parameters of the laser scanner that need to be solved are unknown; The positioning equation based on each pair of same-name point pairs is used to construct an objective function, wherein the objective function is to minimize the sum of squares of distances between all same-name point pairs, including: Calculate the distance difference between pairs of points with the same name based on their positioning equations: In the formula, and unknown, Represents three translation parameters, It is a rotation matrix represented by three angles of rotation around the X-axis, Y-axis and Z-axis respectively. There are six independent unknowns in the formula, which are expressed as: Using f(x) to represent the distance difference between pairs of points with the same name, we can get: The least square solution of the calibration parameters of the mobile laser scanning system is obtained based on the LM nonlinear optimization algorithm, including: When there are m pairs of points with the same name, m equations can be listed, and the LM nonlinear optimization algorithm is used to obtain the least squares solution of the calibration parameters by minimizing the sum of squares of the m equations. The objective function in the solution is shown as follows: The LM (Levenberg-Marquardt) nonlinear optimization algorithm obtains the final solution through iteration. The relationship between the k+1th iteration solution and the kth iteration solution is: x k+1 =x k -(J T J+λI) -1 J T f; Where J is the Jacobian matrix. When the initial value is known, the final external parameters of the mobile laser scanning system are obtained through iteration.

6. A mobile laser scanning system parameter calibration device, characterized in that: include: An acquisition module, used for acquiring laser point clouds of multiple flight strips scanned by a mobile laser scanning system; A solution module, used for solving the laser point cloud based on the initial external parameters and positioning data of the mobile laser scanning system to obtain point clouds in the geodetic coordinate system of multiple flight paths; The registration module is used to match point clouds of different flight strips based on the VGICP algorithm, and obtain the same-name point pairs between point clouds of different flight strips; A solution module is used to solve the external parameters of the mobile laser scanning system by minimizing the distance between the same-name point pairs, wherein the external parameters of the mobile laser scanning system are the translation matrix and the rotation matrix of the laser scanner relative to the inertial measurement unit; based on the calculated external parameters of the mobile laser scanning system, the solution module, the registration module and the solution module are repeatedly executed until the average error change between the same-name point pairs before and after the solution is less than a threshold value, thereby obtaining the final external parameters of the mobile laser scanning system; The method of solving the external parameters of the mobile laser scanning system by minimizing the distance between pairs of points with the same name includes: Establish positioning equations based on the same-name point pairs between different flight strips; Based on the positioning equation of each pair of points with the same name, an objective function is constructed, wherein the sum of squares of distances between all points with the same name is minimized; The least squares solution of the calibration parameters of the mobile laser scanning system is obtained based on the LM nonlinear optimization algorithm.

7. An electronic device, characterized in that: It comprises a memory and a processor, wherein the processor is used to implement the steps of the mobile laser scanning system parameter calibration method as described in any one of claims 1 to 5 when executing a computer management program stored in the memory.

8. A computer-readable storage medium, characterized in that: A computer management program is stored thereon, and when the computer management program is executed by a processor, the steps of the mobile laser scanning system parameter calibration method as described in any one of claims 1 to 5 are implemented.