Multi-camera three-dimensional point cloud splicing method and measuring system based on dynamic correction

Abstract

The invention discloses a multi-camera three-dimensional point cloud splicing method and measurement system based on dynamic correction, and belongs to the technical field of three-dimensional measurement, and the method comprises the steps: enabling a point cloud reconstruction part to move according to a planned solving path, and solving a matrix conversion relation between a feature point coordinate system and a scanning coordinate system; the point cloud reconstruction component measures a measurement target according to a planned scanning path, tracks the point cloud reconstruction component and the measurement platform through the multi-view tracking component, and solves a matrix conversion relation between a tracking coordinate system and a global coordinate system and a matrix conversion relation between a scanning coordinate system and the tracking coordinate system. Converting the three-dimensional point cloud data of the measurement target measured by the point cloud reconstruction component to the same coordinate system; and converting the three-dimensional point cloud of the measurement target corresponding to the current scanning path point obtained by scanning of the point cloud reconstruction component and the point coordinate data corresponding to the first scanning path point of the feature points of the feature polyhedron to a global coordinate system to complete point cloud splicing. According to the invention, the problem of precision loss in measurement is corrected.

Description

Technical Field

[0001] The present application relates to a multi-camera three-dimensional point cloud stitching method and a measurement system based on dynamic correction, belonging to the technical field of three-dimensional measurement. Background Art

[0002] Point cloud stitching is a key step in three-dimensional reconstruction and measurement, which is a process of stitching and fusing point clouds obtained from multiple different perspectives or positions into a complete three-dimensional model. According to different stitching principles, point cloud stitching is divided into multiple methods such as reference point stitching, feature stitching, deep learning matching stitching, etc. Reference point stitching features high matching accuracy but high environmental dependence, and reference points need to be arranged on the target surface. Feature stitching features relatively high matching, but requires obvious features on the surface of the measurement target. Deep learning matching stitching features low dependence on the environment and features, but there are significant differences in the stitching effects of different iterative matching algorithms. Among them, reference point stitching is currently recognized in the industry as a point cloud stitching method with relatively high accuracy. Since the reference points are always on or near the measurement target, they will affect the actual shape of the measurement target, so the scope of application is limited.

[0003] To get rid of the influence of reference points and achieve high-precision point cloud stitching, there have emerged various point cloud stitching methods in the industry that eliminate the dependence on reference points. Among them, to meet the needs of industrial production and detection, corresponding automated detection technical solutions have been generated by combining point cloud stitching methods that eliminate the dependence on reference points. The currently mature technical means include: there is a rigid connection between the reference points and the measurement target, and the reference points do not need to be attached to the measurement target. The point cloud reconstruction component captures the measurement target and the reference points near the target at multiple positions, and the binocular tracking component tracks the feature points on the shell of the point cloud reconstruction component at the corresponding positions. Currently, the commonly used point cloud reconstruction component is a three-dimensional laser scanner. Based on the principle of laser ranging, by projecting one or multiple laser lines onto the surface of the measurement target, the three-dimensional point cloud data of the measured target can be quickly reconstructed. Using the matrix transformation relationship between the scanning coordinate system of the point cloud reconstruction component and the feature point coordinate system of the feature points on the shell of the point cloud reconstruction component, the matrix transformation relationship between the feature point coordinate system of the feature points on the shell of the point cloud reconstruction component and the tracking coordinate system of the binocular tracking component, and the matrix transformation relationship between the tracking coordinate system of the binocular tracking component and the global coordinate system of the measurement plane where the measurement target is placed. The point cloud data of the measurement target and the three-dimensional coordinates of the reference points obtained by the point cloud reconstruction component are transformed from the scanning coordinate system of the point cloud reconstruction component to the global coordinate system of the measurement plane, and the point cloud stitching of the measurement target is completed. Common automatic tracking systems are as Figure 1 shown.

[0004] However, there may be the following three problems: 1) Precision loss problem caused by environmental vibration: The vibration in the industrial site affects the relative position relationship between the binocular tracking component and the measurement plane, and this position relationship directly affects the stitching precision of the measured target point cloud captured. For the offset problem of this position relationship, methods such as foundation backfilling and vibration isolation table earthquake resistance are given in the industry, but the cost is relatively high.

[0005] 2) Precision loss problem caused by temperature change: The ambient temperature in the workshop where the measurement system is located may change continuously, and at the same time, the system's own operation will also cause self-heating. Among them, the structural components fixing the camera will deform under the action of heat. This deformation will directly change the relative position relationship between the cameras of the binocular tracking component, and this position relationship directly determines the reconstruction precision of the three-dimensional point cloud data of the measured target. Although for the above problems, methods such as selecting structural components with small thermal expansion and contraction to fix the camera or performing temperature compensation in real time by algorithms are given in the industry, the overall cost is relatively high. Among them, the temperature compensation method is complex to operate and may have the situation that the temperature compensation amount is not accurate enough.

[0006] 3) Precision loss problem caused by limited tracking view: The observation points of the binocular tracking component are fixed, and its field of view is limited, so the effective measurement range is limited. For the view angle problem, methods such as performing transfer station shooting on the binocular tracking component are also given in the industry to solve it, but such a tracking method will cause cumulative errors between different observation points. Summary of the Invention

[0007] According to one aspect of the present application, a multi-camera three-dimensional point cloud stitching method based on dynamic correction is provided, which dynamically corrects the precision loss problems caused by environmental vibration and temperature change in the measurement.

[0008] The multi-camera three-dimensional point cloud stitching method based on dynamic correction is characterized by including: Step 1: Calibrate the multi-eye tracking component, the point cloud reconstruction component, the feature points on the point cloud reconstruction component, and the measurement platform where the measurement target is located, and establish a tracking coordinate system, a scanning coordinate system, a feature point coordinate system, and a global coordinate system; Step 2: Move the point cloud reconstruction component along the planned solution path to solve the matrix transformation relationship between the feature point coordinate system and the scanning coordinate system; Step 3: The point cloud reconstruction component measures the measurement target along the planned scanning path, and the multi-eye tracking component tracks the feature points on the point cloud reconstruction component and the backlight marking points on the measurement platform, and solves the matrix transformation relationship between the tracking coordinate system and the global coordinate system and the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system under each scanning path; Step 4: While the component for point cloud reconstruction is photographing the measurement target and the feature points on the feature polyhedron, convert the three-dimensional point cloud data of the measurement target obtained by the component for point cloud reconstruction into coordinate values in the same reference coordinate system; wherein, both the measurement target and the feature polyhedron are located on the electric turntable of the measurement platform. Step 5: Convert the three-dimensional point cloud of the measurement target and the coordinate data of the feature points of the feature polyhedron in the scanning coordinate system corresponding to the current scanning path points scanned by the component for point cloud reconstruction into the point coordinate data in the scanning coordinate system corresponding to the first scanning path point, and then convert them into the global coordinate system to complete point cloud stitching.

[0009] Further, Step 2 includes: Step 2.1: The component for point cloud reconstruction runs to the th solution path point, photographs the calibration board, and determines the transformation relationship between the scanning coordinate system and the calibration board coordinate system. Step 2.2: The multi-camera tracking coordinate system determines the transformation relationship between the tracking coordinate system and the feature point coordinate system by photographing the feature points on the component for point cloud reconstruction. Step 2.3: Calculate the transformation relationship between the scanning coordinate system and the feature point coordinate system through the transformation relationship from the calibration board coordinate system to the scanning coordinate system and the transformation relationship from the feature point coordinate system to the tracking coordinate system.

[0010] Further, Step 2.1 includes: Suppose the three-dimensional point coordinates of the common marker points on the calibration board in the scanning coordinate system photographed at the th solution path point are denoted as , then: ; wherein, and respectively represent the rotation matrix and the translation matrix from the calibration board coordinate system to the scanning coordinate system at the th solution path point, is the three-dimensional coordinate of the common marker point corresponding to in the calibration board coordinate system; is the transformation matrix from the calibration board coordinate system to the scanning coordinate system at the current scanning path point.

[0011] Further, Step 2.2 includes: Suppose at the th solution path point, the three-dimensional coordinates of the feature points on the component for point cloud reconstruction obtained by the multi-camera tracking component in the tracking coordinate system are denoted as , then: ; wherein, represents the number of solution path points, i ∈ {1, 2, 3,..., n}, and are respectively the rotation matrix and the translation matrix from the feature point coordinate system to the tracking coordinate system at the th solution path point; is the three-dimensional coordinate of the common feature point corresponding to in the feature point coordinate system; is the transformation matrix from the feature point coordinate system to the tracking coordinate system at the current solution path point; is the transformation matrix from the feature point coordinate system to the tracking coordinate system.

[0012] Further, step 2.3 includes: Each solution path point satisfies: ; For all solution path points, the matrix transformation relationship remains unchanged. Therefore, each path point satisfies: ; Simplified representation: ; where: ; ; ; Determine the matrix transformation relationship from the calibration plate coordinate system to the tracking coordinate system at all solution path points ; Determine the matrix transformation relationship from the scanning coordinate system to the feature point coordinate system at all scanning path points .

[0013] Further, in step three, dynamically solve the matrix transformation relationship between the tracking coordinate system and the global coordinate system and the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system for each scanning path, including: Step 3.1, The multi-camera tracking component tracks the backlight marker points on the measurement platform at each scanning path point, and dynamically corrects the transformation relationship from the tracking coordinate system to the global coordinate system at the current path point; Suppose the three-dimensional coordinate of the common marker point on the backlight marker point in the tracking coordinate system obtained at the current scanning path point is , then: ; where, and are the rotation matrix and the translation matrix for transforming the three-dimensional coordinates of the backlight marker points captured by the multi-camera tracking component at the th scanning path point in the global coordinate system to the tracking coordinate system; Represents the matrix transformation relationship from the global coordinate system to the tracking coordinate system under the current scanning path point; Are the three-dimensional coordinates of the corresponding common marker points in the global coordinate system; Step 3.2: The multi-camera tracking component simultaneously tracks the feature points on the point cloud reconstruction component under the same scanning path point, and dynamically solves the transformation relationship from the feature point coordinate system on the point cloud reconstruction component to the tracking coordinate system under the current scanning path point; Suppose that the three-dimensional coordinates of the common feature points of the feature points in the tracking coordinate system obtained by the multi-camera tracking component under the current scanning path point are , then: ; Among them, and Are the rotation matrix and translation matrix for transforming the three-dimensional coordinates of the feature points captured by the multi-camera tracking component at the th path point in the feature point coordinate system to the tracking coordinate system; Represents the matrix transformation relationship from the feature point coordinate system to the tracking coordinate system under the current path point; Are the three-dimensional coordinates of the feature points on the point cloud reconstruction component captured by the multi-camera tracking component at the th path point in the feature point coordinate system.

[0014] Furthermore, in step four, the point cloud reconstruction component simultaneously captures the measurement target and the feature points on the feature polyhedron, and unifies the three-dimensional point cloud data of the measurement target measured by the point cloud reconstruction component into one coordinate system, including: Step 4.1: The point cloud reconstruction component captures the point cloud data of the measurement target and the feature polyhedron with feature points in the scanning coordinate system corresponding to the first scanning path point ; The point cloud reconstruction component continues to move along the scanning path and captures the point cloud data of the measurement target and the feature polyhedron with feature points in the scanning coordinate system corresponding to the current scanning path point , where there are at least 4 common feature points in the point cloud data scanned by adjacent path points; Based on the common feature point coordinate data of the measurement target scanned by the point cloud reconstruction component at adjacent path points, solve the matrix transformation relationship between the two scanning coordinate systems, that is: ; Among them, Represents the number of points on the scanning path, k ∈ {1, 2, 3,..., m}, Is the coordinate data of the feature points on the feature polyhedron in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component at the th path point; At the th scanning path point, the coordinate data of the feature points on the corresponding feature polyhedron in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component; and At the th scanning path point, the rotation matrix and translation matrix for transforming the three-dimensional coordinates of the feature points on the feature polyhedron in the scanning coordinate system corresponding to the th scanning path point to the scanning coordinate system corresponding to the represents the matrix transformation relationship between the th scanning coordinate system and the scanning coordinate system corresponding to the th scanning path point at the current path point; Step 4.2. At the th scanning path point, the matrix transformation relationship between the scanning coordinate system corresponding to the point cloud reconstruction component and the scanning coordinate system corresponding to the first scanning path point is: ; where At the th scanning path point, the coordinate data of the feature points on the feature polyhedron in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component; At the first scanning path point, the coordinate data of the feature points on the feature polyhedron in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component; represents the matrix transformation relationship between the scanning coordinate system corresponding to the th scanning path point and the scanning coordinate system corresponding to the first path point; Determine the matrix transformation relationship between the three-dimensional point cloud data of the measurement target captured by the point cloud reconstruction component and the feature point data on the feature polyhedron at the th scanning path point in the scanning coordinate system corresponding to the first scanning path point: ; where At the th scanning path point, the three-dimensional point cloud of the measurement target and the coordinate data of the feature points of the feature polyhedron in the scanning coordinate system corresponding to the current scanning path point scanned by the point cloud reconstruction component; At the first scanning path point, the three-dimensional point cloud of the measurement target and the coordinate data of the feature points of the feature polyhedron in the scanning coordinate system corresponding to the current scanning path point scanned by the point cloud reconstruction component.

[0015] Furthermore, in the fifth step, the transformation to the global coordinate system and the completion of point cloud stitching include: ; where is the At the th scanning path point, the three-dimensional point cloud data of the measurement target scanned by the point cloud reconstruction component and the point coordinate data of the feature points of the feature polyhedron in the global coordinate system; is the inverse matrix of the matrix transformation relationship from the global coordinate system to the tracking coordinate system at the th scanning path point; is the matrix transformation relationship from the feature point coordinate system to the tracking coordinate system at the th scanning path point; is the matrix transformation relationship from the scanning coordinate system to the feature point coordinate system during the measurement process; is the point coordinate data of the three-dimensional point cloud of the measurement target and the feature point coordinates of the feature polyhedron in the corresponding scanning coordinate system at the th scanning path point in the scanning coordinate system corresponding to the first scanning path point; There are at least 4 common feature points in the point cloud data of adjacent path points, and the point cloud is stitched in the global coordinate system through the common feature points.

[0016] Further, it further includes: Step six, encapsulate the three-dimensional point cloud data of the stitched measurement target to obtain a complete mesh data model of the measurement target, and perform inspection and comparison with the CAD design model corresponding to the measurement target.

[0017] According to another aspect of the present application, there is provided a multi-camera three-dimensional measurement system based on dynamic correction, which is characterized in that it includes: A measurement platform, on which a measurement target and backlight marking points are provided; A point cloud reconstruction component, which is installed on the measurement platform through a robotic arm, and the point cloud reconstruction component measures the measurement target; A multi-eye tracking component, which performs tracking measurement on the measurement target on the measurement platform. Feature points are provided on the point cloud reconstruction component and are within the field of view of the multi-eye tracking component; Among them, the measurement target is installed on the measurement platform through an electric turntable and is located at the center of the electric turntable. A plurality of feature polyhedrons with feature points are also provided on the tabletop of the electric turntable, and the plurality of feature polyhedrons are located around the measurement target; The backlight marking points are located on the peripheral side of the electric turntable.

[0018] The beneficial effects that can be produced by the present application include: The multi-camera three-dimensional point cloud stitching method and measurement system based on dynamic correction provided by this application move the point cloud reconstruction component along the planned solution path, solve the matrix transformation relationship between the feature point coordinate system and the scanning coordinate system, and the point cloud reconstruction component measures the measurement target along the planned scanning path. The multi-view tracking component simultaneously tracks the feature points on the point cloud reconstruction component and the backlight marking points on the measurement platform, dynamically solves the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system at the same path point, and quickly converts the three-dimensional point cloud data of the measurement target measured by the point cloud reconstruction component at each path point to the global coordinate system to achieve point cloud stitching. It dynamically corrects the accuracy loss problems caused by environmental vibration and temperature changes during measurement; introduces an electric turntable, reduces the spatial tracking range of the tracking component, and increases the system freedom to 7 degrees, meeting the high-precision and efficient measurement requirements of large workpiece measurement, and ensuring the efficiency and accuracy of point cloud stitching. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a schematic diagram of an automatic tracking system in the prior art; Figure 2 is a flowchart of the multi-camera three-dimensional point cloud stitching method based on dynamic correction in an embodiment of this application; Figure 3 is a schematic diagram of the multi-camera three-dimensional measurement system based on dynamic correction in an embodiment of this application; List of components and reference numerals: 1 - measurement platform; 2 - measurement target; 3 - backlight marking point; 4 - point cloud reconstruction component; 5 - robotic arm; 6 - multi-view tracking component; 7 - electric turntable; 8 - feature polyhedron. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0020] The following describes this application in detail with reference to the embodiments, but this application is not limited to these embodiments.

[0021] See Figure 2 , the multi-camera three-dimensional point cloud stitching method based on dynamic correction, characterized by including: Step 1, calibrate the multi-view tracking component 6, the point cloud reconstruction component 4, the feature points on the point cloud reconstruction component 4, and the measurement platform where the measurement target is located, and establish a tracking coordinate system, a scanning coordinate system, a feature point coordinate system, and a global coordinate system; Step 2, move the point cloud reconstruction component 4 along the planned solution path, and solve the matrix transformation relationship between the feature point coordinate system and the scanning coordinate system; Step 3: The point cloud reconstruction component 4 measures the measurement target 2 according to the planned scanning path. The multi-view tracking component 6 tracks the feature points on the point cloud reconstruction component 4 and the backlight marking points 3 on the measurement platform, and solves the matrix transformation relationship between the tracking coordinate system and the global coordinate system and the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system for each scanning path; Step 4: The point cloud reconstruction component 4 simultaneously photographs the measurement target and the feature points on the feature polyhedron 8, and converts the three-dimensional point cloud data of the measurement target measured by the point cloud reconstruction component 4 into coordinate values in the same reference coordinate system; wherein, both the measurement target and the feature polyhedron 8 are located on the electric turntable 7 of the measurement platform; Step 5: Convert the three-dimensional point cloud of the measurement target and the coordinate data of the feature points of the feature polyhedron 8 corresponding to the current scanning path points scanned by the point cloud reconstruction component 4 into point coordinate data in the scanning coordinate system corresponding to the first scanning path point, and convert them to the global coordinate system and complete point cloud stitching.

[0022] Specifically, based on the principle of close-range photogrammetry, the multi-camera tracking component 6 is calibrated to determine the initial internal and external parameters of the multi-camera and establish a tracking coordinate system; the adjustment optimization method is used to calibrate the point cloud reconstruction component 4 to determine the internal and external parameters of the camera of the point cloud reconstruction component 4 and establish a scanning coordinate system; the matrix transformation relationship between the scanning coordinate system and the feature point coordinate system is solved, and the robotic arm 5 drives the point cloud reconstruction component 4 to move along the planned solution path, and the point cloud reconstruction component 4 and the multi-camera tracking component 6 simultaneously photograph the ceramic calibration board. During the whole process, the tracking component does not move relative to the ceramic calibration board, and the feature points of the point cloud reconstruction component 4 and the housing of the point cloud reconstruction component 4 are rigidly connected, and the matrix transformation relationship between the scanning coordinate system and the feature point coordinate system is solved. The robotic arm 5 drives the point cloud reconstruction component 4 to perform three-dimensional measurement along the planned scanning path. The electric turntable 7 fixed with the measurement target and the feature polyhedron 8 rotates or remains stationary according to the viewing angle requirements of the point cloud reconstruction component 4 at each path point. The multi-camera tracking component 6 fixed on the top of the system frame simultaneously tracks the feature points on the housing of the point cloud reconstruction component 4 and the backlight marking points 3 fixed on the measurement platform of the marble base. Dynamically correct the matrix transformation relationship between the tracking coordinate system and the global coordinate system. Affected by environmental vibrations and system temperature changes, the external parameters of the cameras of the multi-camera tracking component change, and this set of external parameter relationships directly affect the matrix transformation relationship between the tracking coordinate system and the global coordinate system. Through the three-dimensional point coordinates of the marking points photographed at each scanning path point in the tracking coordinate system, combined with the three-dimensional point coordinates of the corresponding marking points in the global coordinate system obtained by prior photogrammetry, dynamically correct the matrix transformation relationship between the tracking coordinate system and the global coordinate system at each scanning path point. Dynamically solve the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system. The point cloud reconstruction component 4 is driven by the robotic arm 5 to move along the planned scanning path. The multi-camera tracking component 6 tracks the feature points on the housing of the point cloud reconstruction component 4 at each scanning path point, determines the three-dimensional coordinates of the feature points photographed at the current path point in the tracking coordinate system, and combines the matrix transformation relationship between the scanning coordinate system and the feature point coordinate system to solve the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system at the current path point.

[0023] Further, driven by the robotic arm 5, the point cloud reconstruction component 4 moves along a predefined scanning path and captures the point cloud data of the measurement target on the electric turntable 7 and the feature polyhedron 8 with feature points at each path point. Considering that in the entire scanning path, the scanning coordinate system continuously changes with the path points of the current point cloud reconstruction component 4, and the electric turntable 7 also rotates according to different scanning path points, the relative position between the electric turntable 7 and the point cloud reconstruction component 4 changes accordingly. First, capture the point cloud data of the measurement target and the feature polyhedron 8 with feature points in the scanning coordinate system corresponding to the first scanning path point; continue scanning and capture the point cloud data of the measurement target and the feature polyhedron 8 with feature points in the scanning coordinate system corresponding to the current scanning path point. It is required that there are at least 4 common feature points on the known feature polyhedron 8 in the point cloud data of each path point in the current scanning coordinate system and the point cloud data in the corresponding scanning coordinate system of the adjacent path point; then, based on the coordinate data of the common feature points scanned from the adjacent path points, determine the matrix transformation relationship between the scanning coordinate systems of all other scanning path points and the scanning coordinate system corresponding to the first scanning path point; finally, for the point cloud data captured at all path points in the current scanning coordinate system, apply the matrix transformation relationship between the scanning coordinate system of the corresponding scanning path point and the scanning coordinate system corresponding to the first scanning path point to uniformly transform the point cloud data scanned from all other scanning path points to the scanning coordinate system corresponding to the first scanning path point. While solving the problem of the relative position change between the electric turntable 7 and the point cloud reconstruction component 4, based on the determined matrix transformation relationship between the tracking coordinate system and the global coordinate system at each path point, and the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system, the point cloud data obtained by the point cloud reconstruction component 4 at each path point in the scanning coordinate system corresponding to the first scanning path point can be transformed to the global coordinate system and the point cloud stitching can be completed.

[0024] Preferably, a large field-of-view calibration algorithm based on close-range photogrammetry is used to calibrate the multi-camera tracking component 6, which specifically includes: the cameras of the multi-camera tracking component 6 simultaneously capture the honeycomb calibration board to obtain a set of calibration board images; move the position of the honeycomb calibration board on the measurement platform and repeat capturing the calibration board images in multiple poses. Given the global point data of the calibration board in its own coordinate system, combined with the captured calibration board images, first match the coded points in the images and preliminarily calculate and determine the initial values of the internal and external parameters of each camera; then match the non-coded points on the calibration board and perform bundle adjustment calculation to optimize and solve the initial values of the internal and external parameters of each camera. The calibration of the point cloud reconstruction component 4 adopts the adjustment optimization method, and the calibration plate is a ceramic calibration plate with circular coded points and non-coded points regularly arranged. Among them, the point cloud reconstruction component 4 is a grating structured light scanning component, which projects grating stripes with periodically changing thickness and phase on the object surface, and the camera interprets the deformed grating stripes modulated by the object surface, so as to determine and output the three-dimensional point cloud of the grating projection area on the object surface. The point cloud reconstruction accuracy of this kind of technical means is relatively high.

[0025] The second step includes: Step 2.1, the point cloud reconstruction component 4 runs to the th solution path point, takes a picture of the calibration plate and determines the transformation relationship between the scanning coordinate system and the calibration plate coordinate system; Step 2.2, the multi-view tracking coordinate system determines the transformation relationship between the tracking coordinate system and the feature point coordinate system by taking pictures of the feature points on the point cloud reconstruction component 4; Step 2.3, calculate the transformation relationship from the scanning coordinate system to the feature point coordinate system through the transformation relationship from the calibration plate coordinate system to the scanning coordinate system and the transformation relationship from the feature point coordinate system to the tracking coordinate system.

[0026] Step 2.1 includes: Suppose the three-dimensional point coordinates of the common marker points on the calibration plate in the scanning coordinate system taken at the th solution path point are recorded as , then: ; Among them, and respectively represent the rotation matrix and translation matrix from the calibration plate coordinate system to the scanning coordinate system at the th solution path point, is the three-dimensional coordinate of the common marker point corresponding to in the calibration plate coordinate system; is the transformation matrix from the calibration plate coordinate system to the scanning coordinate system at the current scanning path point.

[0027] Step 2.2 includes: Suppose at the th solution path point, the three-dimensional coordinates of the feature points on the point cloud reconstruction component 4 obtained by the multi-view tracking component 6 in the tracking coordinate system are recorded as , then: ; Among them, represents the number of solution path points, i ∈ {1, 2, 3,..., n}, and are respectively the The rotation matrix and translation matrix from the feature point coordinate system to the tracking coordinate system at each solution path point; is the three-dimensional coordinate of the common feature point corresponding to in the feature point coordinate system; is the transformation matrix from the feature point coordinate system to the tracking coordinate system at the current solution path point; solved by the SVD singular value decomposition method .

[0028] Step 2.3 includes: Since the movement duration of the entire solution path does not exceed 5 minutes, the matrix conversion relationship between the two remains unchanged, and each solution path point satisfies: ; For all solution path points, the matrix conversion relationship remains unchanged. Therefore, each path point satisfies: ; Simplified representation: ; Where: ; ; ; Determine the matrix conversion relationship from the calibration plate coordinate system to the tracking coordinate system at all solution path points ; Determine the matrix conversion relationship from the scanning coordinate system to the feature point coordinate system at all scanning path points .

[0029] In the third step described above, dynamically solve the matrix conversion relationship between the tracking coordinate system and the global coordinate system and the matrix conversion relationship between the scanning coordinate system and the tracking coordinate system for each scanning path, including: Step 3.1, the multi-camera tracking component 6 tracks the backlight marking points 3 on the measurement platform at each scanning path point, and dynamically corrects the conversion relationship from the tracking coordinate system to the global coordinate system at the current path point; Suppose the three-dimensional coordinate of the common marking point on the backlight marking point 3 in the tracking coordinate system obtained at the current scanning path point is , then: ; Among them, and are the rotation matrix and translation matrix for transforming the three-dimensional coordinate of the backlight marking point 3 captured by the multi-camera tracking component 6 at the th scanning path point in the global coordinate system to the tracking coordinate system; ; Represents the matrix transformation relationship from the global coordinate system to the tracking coordinate system at the current scanned path point; Are the three-dimensional coordinates of the corresponding common marker points in the global coordinate system; Step 3.2: The multi-view tracking component 6 simultaneously tracks the feature points on the point cloud reconstruction component 4 at the same scanned path point, and dynamically solves the transformation relationship from the feature point coordinate system on the point cloud reconstruction component 4 to the tracking coordinate system at the current scanned path point; Suppose that at the current scanned path point, the three-dimensional coordinates of the common feature points of the feature points in the tracking coordinate system obtained by the multi-view tracking component 6 are , then: ; Wherein, and Are the rotation matrix and translation matrix for transforming the three-dimensional coordinates of the feature points captured by the multi-view tracking component 6 at the th path point in the feature point coordinate system to the tracking coordinate system; ; Represents the matrix transformation relationship from the feature point coordinate system to the tracking coordinate system at the current path point; Are the three-dimensional coordinates of the feature points on the outer shell of the point cloud reconstruction component 4 captured by the multi-view tracking component 6 at the th path point in the feature point coordinate system.

[0030] Specifically, the multi-view tracking component 6 is used to simultaneously track the feature points on the housing of the point cloud reconstruction component 4 and the backlight marking points 3 on the measurement platform, and dynamically solve the matrix transformation relationship between the tracking coordinate system and the global coordinate system and the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system at each path point. The feature points on the outer housing of the point cloud reconstruction component 4 and the backlight marking points 3 on the measurement platform respectively obtain accurate three-dimensional global coordinates of the points through a preset high-resolution device, that is, the three-dimensional global coordinates of the feature points on the outer housing of the point cloud reconstruction component 4 in the feature point coordinate system are known; the three-dimensional global coordinates of the backlight marking points 3 on the measurement platform in the global coordinate system are known. In the subsequent automated measurement process, repeated measurement is not required, unless the point cloud reconstruction component 4 or the marking points undergo large deformations resulting in a decrease in accuracy, in which case re-measurement is required. During the three-dimensional measurement process of the point cloud reconstruction component 4 along the planned scanning path, the feature polyhedron 8 and the measurement target are fixed on the electric turntable 7, and the electric turntable 7 will move into the scanning area of the point cloud reconstruction component 4 according to the scanning path points. In this application, the multi-view tracking component 6 simultaneously tracks the feature points on the housing of the point cloud reconstruction component 4 and the backlight marking points 3 on the measurement platform, thereby achieving high-precision tracking of the movement of the point cloud reconstruction component 4 and dynamic correction of the external parameters of the multi-view tracking component 6 at the corresponding scanning path points. During the tracking process, the multi-view tracking component 6 remains stationary, and by tracking the feature points on the housing of the point cloud reconstruction component 4 and the marking points on the measurement platform, the matrix transformation relationship from the tracking coordinate system to the global coordinate system and the matrix transformation relationship from the scanning coordinate system to the tracking coordinate system are respectively calculated at the current path point.

[0031] Among them, a scanning coordinate system is established on the point cloud reconstruction component 4, a feature point coordinate system is established on the feature points of the housing of the point cloud reconstruction component 4, a calibration plate coordinate system is established on the ceramic calibration plate, a tracking coordinate system is established on the multi-view tracking component 6, and a global coordinate system is established on the marble measurement tabletop. A ceramic calibration plate with a small thermal expansion coefficient is placed on the electric turntable 7 and remains stationary. The solution path of the robotic arm 5 is planned, and the robotic arm 5 drives the point cloud reconstruction component 4 to move. The point cloud reconstruction component 4 moves to the specified th movement path point and takes a picture of the ceramic calibration plate to determine the matrix transformation relationship between the scanning coordinate system and the calibration plate coordinate system ; the multi-view tracking component 6 takes pictures of the feature points on the point cloud reconstruction component 4 at the same path point to determine the matrix transformation relationship between the tracking coordinate system and the feature point coordinate system ; based on and two sets of matrix transformation relationships, at the th path point, establish the matrix transformation relationship between the calibration plate coordinate system and the tracking coordinate system: ; where: It represents the matrix transformation relationship between the feature point coordinate system of the housing of the point cloud reconstruction component 4 and the tracking system coordinate system under the It represents the matrix transformation relationship between the scanning coordinate system and the feature point coordinate system, which is an unknown quantity; It represents the matrix transformation relationship between the calibration plate coordinate system and the scanning coordinate system. Given the global points of the calibration plate, this matrix can be directly obtained.

[0032] For all path points the matrix transformation relationships remain unchanged; Solve the matrix transformation relationship from the calibration plate coordinate system to the tracking coordinate system under all path points ; At the same time, obtain the matrix transformation relationship from the scanning coordinate system to the feature point coordinate system that remains unchanged under all path points .

[0033] Based on the above technical solution, preferably, the point cloud reconstruction component 4 performs three-dimensional measurement according to the planned scanning path. Under each path point, dynamically correct the matrix transformation relationship between the tracking coordinate system and the global coordinate system, and dynamically solve the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system. The specific process is as follows: First, the multi-view tracking component 6 tracks the marking points on the measurement platform of the marble base under a single path point to obtain the matrix transformation relationship between the tracking coordinate system and the global coordinate system under the current path point. At the same time, the multi-view tracking component 6 tracks the feature points on the housing of the point cloud reconstruction component 4 under the same path point to obtain the matrix transformation relationship between the tracking coordinate system and the feature point coordinate system under the current path point.

[0034] In step 4 described above, the point cloud reconstruction component 4 simultaneously captures the measurement target and the feature points on the feature polyhedron 8, and unifies the three-dimensional point cloud data of the measurement target measured by the point cloud reconstruction component 4 into one coordinate system, including: Step 4.1, the point cloud reconstruction component 4 captures the point cloud data of the measurement target and the feature polyhedron 8 with feature points in the scanning coordinate system corresponding to the first scanning path point ; The point cloud reconstruction component 4 continues to move along the scanning path and captures the point cloud data of the measurement target and the feature polyhedron 8 with feature points in the scanning coordinate system corresponding to the current scanning path point , where there are at least 4 common feature points in the point cloud data scanned by adjacent path points; Based on the coordinate data of the common feature points of the measurement target scanned by the point cloud reconstruction component 4 at adjacent path points, solve the matrix transformation relationship between the two scanning coordinate systems, that is: ; Among them, represents the number of points on the scanning path, k ∈ {1, 2, 3, …, m}, is the coordinate data of the feature points on the feature polyhedron 8 in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component 4 under the th scanning path point; is the coordinate data of the feature points on the corresponding feature polyhedron 8 in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component 4 under the th scanning path point; and are the rotation matrix and translation matrix for transforming the three-dimensional coordinates of the feature points on the feature polyhedron 8 in the scanning coordinate system corresponding to the th scanning path point to the scanning coordinate system corresponding to the th scanning path point; ; represents the matrix conversion relationship between the th scanning coordinate system and the scanning coordinate system corresponding to the th scanning path point under the current path point, represents a real number matrix, and 4 is the number of factors of the matrix; Step 4.2, the matrix conversion relationship between the scanning coordinate system corresponding to the point cloud reconstruction component 4 and the scanning coordinate system corresponding to the first scanning path point under the th scanning path point is: ; Among them, is the coordinate data of the feature points on the feature polyhedron 8 in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component 4 under the th scanning path point; is the coordinate data of the feature points on the feature polyhedron 8 in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component 4 under the first scanning path point; represents the matrix conversion relationship between the scanning coordinate system corresponding to the th scanning path point and the scanning coordinate system corresponding to the first path point; Determine the matrix conversion relationship between the three-dimensional point cloud data of the measurement target captured by the point cloud reconstruction component 4 and the feature point data on the feature polyhedron 8 in the scanning coordinate system corresponding to the first scanning path point under the th scanning path point: ; Among them, is the At each scanning path point, the point cloud reconstruction component 4 scans to obtain the three-dimensional point cloud of the measurement target and the coordinate data of the feature points of the feature polyhedron 8 in the scanning coordinate system corresponding to the current scanning path point; For the first scanning path point, the point cloud reconstruction component 4 scans to obtain the three-dimensional point cloud of the measurement target and the coordinate data of the feature points of the feature polyhedron 8 in the scanning coordinate system corresponding to the current scanning path point.

[0035] In the fifth step, the conversion to the global coordinate system and the completion of point cloud stitching include: ; Among them, is the three-dimensional point cloud data of the measurement target scanned by the point cloud reconstruction component 4 and the point coordinate data of the feature points of the feature polyhedron 8 in the global coordinate system at the th scanning path point; is the inverse matrix of the matrix conversion relationship from the global coordinate system to the tracking coordinate system at the th scanning path point; is the matrix conversion relationship from the feature point coordinate system to the tracking coordinate system at the th scanning path point; is the matrix conversion relationship from the scanning coordinate system to the feature point coordinate system during the measurement process; is the point coordinate data of the three-dimensional point cloud of the measurement target and the feature points of the feature polyhedron 8 in the scanning coordinate system corresponding to the th scanning path point in the scanning coordinate system corresponding to the first scanning path point; There are at least 4 common feature points in the point cloud data of adjacent path points, and the point cloud stitching in the global coordinate system is realized through the common feature points.

[0036] Specifically, the point cloud reconstruction component 4 simultaneously photographs the measurement target and the feature points on the feature polyhedron 8, and unifies the three-dimensional point cloud data of the measurement target measured by the point cloud reconstruction component 4 at each path point into one coordinate system. When the point cloud reconstruction component 4 performs three-dimensional measurement according to the planned path, the measurement target and the feature polyhedron 8 are simultaneously fixed on the electric turntable 7, and the electric turntable 7 moves into the measurement range of the point cloud reconstruction component 4 according to the planned scanning path points, greatly reducing the spatial tracking range of the point cloud reconstruction component 4 and ensuring that the point cloud reconstruction component 4 can obtain high-precision point cloud.

[0037] Among them, driven by the robotic arm 5, the point cloud reconstruction component 4 moves along a predetermined scanning path and captures the point cloud data of the measurement target on the electric turntable 7 and the feature polyhedron 8 with feature points at each path point. Considering that in the entire scanning path, the scanning coordinate system continuously changes with the path points of the current point cloud reconstruction component 4, and the electric turntable 7 also rotates according to different scanning path points, the relative position between the electric turntable 7 and the point cloud reconstruction component 4 changes accordingly.

[0038] It should be noted that the point cloud reconstruction component 4 captures the point cloud data of the measurement target and the feature polyhedron 8 with feature points in the scanning coordinate system corresponding to the first scanning path point. ; Then, the point cloud reconstruction component 4 continues to move along the scanning path and captures the point cloud data of the measurement target and the feature polyhedron 8 with feature points in the scanning coordinate system corresponding to the current scanning path point. It is required that there are at least 4 common feature points in the point cloud data scanned at adjacent path points; Then, based on the coordinate data of the common feature points of the measurement target scanned by the point cloud reconstruction component 4 at adjacent path points, the matrix transformation relationship between the two scanning coordinate systems is solved. Then, the coordinate data of the feature points on the feature polyhedron 8 in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component 4 at each path point is unified into the scanning coordinate system corresponding to the first scanning path point, that is, the matrix transformation relationship between the scanning coordinate system corresponding to the point cloud reconstruction component 4 at the th path point and the scanning coordinate system corresponding to the first scanning path point is determined.

[0039] Finally, since during the scanning process of the point cloud reconstruction component 4, the feature polyhedron 8 and the measurement target on the electric turntable 7 are in a benign connection, the matrix transformation relationship between the scanning coordinate system corresponding to the th scanned path point and the scanning coordinate system corresponding to the first path point is applicable to the three-dimensional point cloud data of the measurement target and all the feature point data on the feature polyhedron 8. By applying the determined matrix transformation relationship, the coordinate data of the three-dimensional point cloud data of the measurement target and the feature point data on the feature polyhedron 8 captured by the point cloud reconstruction component 4 at the th path point in the scanning coordinate system corresponding to the first scanning path point can be determined.

[0040] Based on the above technical solutions, preferably, the point coordinates of the three-dimensional point cloud of the measurement target and the feature point coordinates of the feature polyhedron 8 in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component 4 in the scanning coordinate system corresponding to the first scanning path point. Since there are at least 4 common feature points in the point cloud data of adjacent path points, point cloud stitching in the global coordinate system can be achieved through the common feature points.

[0041] It also includes: Step 6: Encapsulate the three-dimensional point cloud data of the measured target after splicing to obtain a complete mesh data model of the measured target, and perform inspection and comparison with the CAD design model corresponding to the measured target.

[0042] Specifically, triangulate and encapsulate the three-dimensional point cloud data of the obtained measured target to obtain a complete mesh data model of the measured target, and perform post-data processing, including filling holes and removing unnecessary edge regions. Perform inspection and comparison on the point cloud data of the measured target and the imported CAD design model of the object under test. The inspections performed include calculating the surface deviation, cross-section deviation, geometric tolerance, etc. of the actual object under test, and a test report can be output.

[0043] See Figure 3 , a multi-camera three-dimensional measurement system based on dynamic correction, characterized by including: A measurement platform, on which a measured target and backlight marking points 3 are arranged; A point cloud reconstruction component 4, which is installed on the measurement platform through a robotic arm 5, and the point cloud reconstruction component measures the measured target; A multi-view tracking component 6, which tracks and measures the measured target on the measurement platform. Feature points are arranged on the point cloud reconstruction component 4 and are within the field of view of the multi-view tracking component 6; Among them, the measured target is installed on the measurement platform through an electric turntable 7 and is located at the center of the electric turntable 7. A plurality of feature polyhedrons 8 with feature points are also arranged on the tabletop of the electric turntable 7, and the plurality of feature polyhedrons 8 are located around the measured target; The backlight marking points 3 are located on the peripheral side of the electric turntable 7.

[0044] Specifically, the point cloud reconstruction component 4 is fixed at the end of the robotic arm 5. Feature points are arranged on the outer shell of the point cloud reconstruction component 4 and are within the field of view of the multi-view tracking component 6; the multi-view tracking component 6 is provided with a plurality of industrial cameras, and the cameras are connected through metal structural members; the electric turntable 7 is fixed within the working range of the robotic arm 5; the center of the electric turntable 7 is fixed with a measured target, and a feature polyhedron 8 with feature points is arranged on the tabletop of the electric turntable 7; a ceramic calibration plate is placed on the electric turntable 7 for calibration and is within the field of view of the point cloud reconstruction component 4; the feature polyhedron 8 is fixed on the electric turntable 7 and is within the field of view of the point cloud reconstruction component 4; the backlight marking points 3 are fixed on the measurement platform of the marble base and are within the field of view of the multi-view tracking component 6; the measurement platform of the marble base remains stationary, and backlight marking points 3 are arranged on the surface; The robotic arm 5 is used to drive the point cloud reconstruction component 4 to move along the planned path. The point cloud reconstruction component 4 is fixed at the end of the industrial manipulator and is used to perform three-dimensional measurement. Feature points are fixed on the outer shell of the point cloud reconstruction component 4. The electric turntable 7 is fixed within the working range of the robotic arm 5 and within the optimal measurement distance of the point cloud reconstruction component 4. The feature polyhedron 8 is arranged on the tabletop of the electric turntable 7, and feature points are arranged on its surface to facilitate the point cloud reconstruction component 4 to track the movement of the measurement target. The cameras of the multi-camera tracking component 6 are fixed on the metal structural member and are used to track the feature points on the outer shell of the point cloud reconstruction component 4 and the backlight marking points 3 on the measurement plane of the marble base. The measurement plane of the marble base is arranged on the operation cabinet, and backlight marking points 3 are arranged on the measurement plane to facilitate the multi-camera tracking component 6 to dynamically correct the matrix conversion relationship between the tracking coordinate system and the global coordinate system to achieve point cloud stitching. The operation cabinet is electrically connected to the robotic arm 5, the electric turntable 7, and the backlight marking points 3 on the measurement plane of the marble base, and contains an automated control computer terminal for controlling the movement of the robotic arm 5 and the electric turntable 7 and the brightness of the backlight marking points 3 on the measurement plane of the marble base. The CAD design model of the measurement target is preset and imported into the computer in the operation cabinet for subsequent deviation comparison with the measured point cloud data of the measurement target. The ceramic calibration plate is placed on the tabletop of the electric turntable 7 and within the field of view of the point cloud reconstruction component 4 for calibrating the point cloud reconstruction component 4 and simultaneously dynamically solving the matrix conversion relationship between the scanning coordinate system of the point cloud reconstruction component 4 and the feature point coordinate system of the feature points on the outer shell of the point cloud reconstruction component 4 under the scanning path. The honeycomb aluminum calibration plate is placed within the field of view of the multi-camera tracking component 6 for calibrating the multi-camera tracking component 6.

[0045] It should be noted that when calibrating the multi - vision tracking component 6 using the honeycomb aluminum calibration plate, the calibration of the multi - vision tracking component 6 is based on the principle of close - range photogrammetry. The honeycomb aluminum calibration plate is a calibration plate with a dot - matrix arrangement of marker points that matches the measurement field of view of the multi - vision tracking component 6. The essence of calibrating the multi - vision tracking component 6 is to use the global point coordinates of all marker points on the known honeycomb aluminum plate and the two - dimensional image point coordinates captured by the corresponding multi - cameras, and bundle - optimize and adjust the internal and external parameters of the cameras to complete the calibration of the multi - vision tracking component 6. For the automatic calibration of the point cloud reconstruction component 4 using the ceramic calibration plate, the automatic calibration of the point cloud reconstruction component 4 uses the adjustment and optimization method. The ceramic calibration plate is a dot - matrix calibration plate with circular marker points arranged regularly. The point cloud reconstruction component 4 is fixed on the robotic arm 5. By moving the position of the ceramic calibration plate, the point cloud reconstruction component 4 captures a series of images of the calibration plate at different positions to achieve camera calibration. Use the ceramic calibration plate to solve the matrix transformation relationship between the scanning coordinate system of the point cloud reconstruction component 4 and the feature point coordinate system of the feature points on the shell of the point cloud reconstruction component 4. Place the ceramic calibration plate on the electric turntable 7. The ceramic calibration plate contains coded points and non - coded points. Ensure that the point cloud reconstruction component 4 and the multi - vision tracking component 6 can always capture the ceramic calibration plate simultaneously. According to the planned solution path, move the point cloud reconstruction component 4 to different positions within the space to be measured. Pre - establish a scanning coordinate system on the point cloud reconstruction component 4, establish a feature point coordinate system at the position of the marker points on the shell of the point cloud reconstruction component 4, establish a calibration plate coordinate system on the ceramic calibration plate, establish a tracking coordinate system at the position of the multi - vision tracking component 6, and establish a global coordinate system near the backlight point of the marble measurement table. This application uses the ceramic calibration plate to solve the matrix transformation relationship between the scanning coordinate system of the point cloud reconstruction component 4 and the feature point coordinate system of the feature points on the shell of the point cloud reconstruction component 4.

[0046] In this application, the multi - vision tracking component 6 simultaneously tracks the feature points on the shell of the point cloud reconstruction component 4 and the backlight marker points 3 on the marble measurement platform, dynamically corrects the matrix transformation relationship between the tracking coordinate system and the global coordinate system at each path point. At the same time, it dynamically solves the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system at the same path point, and quickly converts the three - dimensional point cloud data of the measurement target measured by the point cloud reconstruction component 4 at each path point to the global coordinate system to achieve point cloud stitching. It dynamically corrects the accuracy loss problems caused by environmental vibration and temperature changes during measurement; by introducing the electric turntable 7, it reduces the spatial tracking range of the tracking component and increases the system freedom degree to 7 degrees, meeting the high - precision and high - efficiency measurement requirements for large - scale workpiece measurement, and ensuring the efficiency and accuracy of point cloud stitching.

[0047] As described above, these are only several embodiments of the present application and do not impose any form of limitation on the present application. Although the present application is disclosed above with preferred embodiments, it is not intended to limit the present application. Any person skilled in the art, without departing from the scope of the technical solution of the present application, making some changes or modifications using the disclosed technical content above is equivalent to equivalent implementation cases and all fall within the scope of the technical solution.

Claims

1. A multi-camera 3D point cloud stitching method based on dynamic correction, characterized in that: include: Step 1: calibrate the multi-eye tracking component (6), the point cloud reconstruction component (4), the feature points on the point cloud reconstruction component (4), and the measurement platform (1) where the measurement target (2) is located, and establish a tracking coordinate system, a scanning coordinate system, a feature point coordinate system, and a global coordinate system; Step 2: Move the point cloud reconstruction component (4) according to the planned solution path to solve the matrix transformation relationship between the feature point coordinate system and the scanning coordinate system; Step 3: The point cloud reconstruction component (4) measures the measurement target (2) according to the planned scanning path, and the multi-eye tracking component (6) tracks the feature points on the point cloud reconstruction component (4) and the backlight marking points (3) on the measurement platform (1), and solves the matrix transformation relationship between the tracking coordinate system and the global coordinate system and the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system under each scanning path; Step 4: Using a point cloud reconstruction component (4) to simultaneously photograph the characteristic points on the measurement target (2) and the characteristic polyhedron (8), the three-dimensional point cloud data of the measurement target (2) measured by the point cloud reconstruction component (4) is converted into coordinate values ​​in the same reference coordinate system; wherein the measurement target (2) and the characteristic polyhedron (8) are both located on the electric turntable (7) of the measurement platform (1); Step 5: The three-dimensional point cloud of the measurement target (2) and the point coordinate data of the feature point of the feature polyhedron (8) in the scanning coordinate system corresponding to the current scanning path point obtained by scanning the point cloud reconstruction component (4) are converted to the global coordinate system and the point cloud splicing is completed.

2. The multi-camera three-dimensional point cloud stitching method based on dynamic correction according to claim 1, characterized in that: The second step comprises: Step 2.1: Point cloud reconstruction component (4) runs to the Solve the path points, shoot the calibration plate and determine the transformation relationship between the scanning coordinate system and the calibration plate coordinate system; Step 2.2, the multi-eye tracking coordinate system determines the transformation relationship between the tracking coordinate system and the feature point coordinate system by photographing the feature points on the point cloud reconstruction component (4); Step 2.3: Calculate the transformation relationship from the scanning coordinate system to the feature point coordinate system through the transformation relationship from the calibration plate coordinate system to the scanning coordinate system and the transformation relationship from the feature point coordinate system to the tracking coordinate system.

3. The multi-camera three-dimensional point cloud stitching method based on dynamic correction according to claim 2, characterized in that: Step 2.1 includes: Located in The three-dimensional coordinates of the common marking point on the calibration plate in the scanning coordinate system captured by the solution path point are ,but: ； in, and Respectively represent Under the solution path point, the rotation matrix and translation matrix from the calibration plate coordinate system to the scanning coordinate system are: is the calibration plate coordinate system The three-dimensional coordinates of the corresponding common marker points; It is the transformation matrix from the calibration plate coordinate system to the scanning coordinate system at the current scanning path point.

4. The multi-camera three-dimensional point cloud stitching method based on dynamic correction according to claim 2, characterized in that: Step 2.2 includes: Located in The three-dimensional coordinates of the feature points on the point cloud reconstruction component (4) in the tracking coordinate system obtained by the multi-eye tracking component (6) are as follows: ,but: ； in, Indicates the number of solution path points, i∈{1,2,3,…,n}, and Respectively Under the solution path point, the rotation matrix and translation matrix from the feature point coordinate system to the tracking coordinate system; is the feature point coordinate system The three-dimensional coordinates of the corresponding common feature points; It is the transformation matrix from the feature point coordinate system to the tracking coordinate system under the current solution path point; It is the transformation matrix from the feature point coordinate system to the tracking coordinate system.

5. The multi-camera three-dimensional point cloud stitching method based on dynamic correction according to claim 2, characterized in that: Step 2.3 includes: Each solution path point satisfies: All solution path points The matrix transformation relationship remains unchanged, so, All path points satisfy: ； Simplified expression: ; in: ； ； ； Determine the matrix transformation relationship from the calibration plate coordinate system to the tracking coordinate system under all solution path points ; Determine the matrix transformation relationship from the scanning coordinate system to the feature point coordinate system at all scanning path points .

6. The multi-camera three-dimensional point cloud stitching method based on dynamic correction according to claim 1, characterized in that: In the step 3, dynamically solving the matrix transformation relationship between the tracking coordinate system and the global coordinate system and the matrix transformation relationship between the scanning coordinate system and the tracking coordinate system under each scanning path includes: Step 3.1, the multi-eye tracking component (6) tracks the backlight mark point (3) on the measuring platform (1) at each scanning path point, and dynamically corrects the transformation relationship between the tracking coordinate system and the global coordinate system at the current path point; Assume that the three-dimensional coordinates of the common marking point on the backlight marking point (3) in the tracking coordinate system are obtained at the current scanning path point: ,but: ； in, and To convert the global coordinate system scanning path points, the three-dimensional coordinates of the backlight marker point (3) photographed by the multi-eye tracking component (6) are transformed into a rotation matrix and a translation matrix in the tracking coordinate system; Indicates the matrix transformation relationship from the global coordinate system to the tracking coordinate system at the current scanning path point; is the three-dimensional coordinate of the corresponding public marker point in the global coordinate system; Step 3.2, the multi-eye tracking component (6) simultaneously tracks the feature points on the point cloud reconstruction component (4) at the same scanning path point, and dynamically solves the transformation relationship between the feature point coordinate system and the tracking coordinate system of the feature points on the point cloud reconstruction component (4) at the current scanning path point; Assume that at the current scanning path point, the multi-eye tracking component (6) obtains the three-dimensional coordinates of the common feature points of the feature points in the tracking coordinate system as follows: ,but: ； in, and To convert the feature point coordinate system into The three-dimensional coordinates of the feature points captured by the multi-eye tracking component (6) are transformed into the rotation matrix and translation matrix in the tracking coordinate system; Indicates the matrix transformation relationship from the feature point coordinate system to the tracking coordinate system at the current path point; is the feature point coordinate system, At each path point, the multi-eye tracking component (6) captures the three-dimensional coordinates of the feature points on the point cloud reconstruction component (4) in the feature point coordinate system.

7. The multi-camera three-dimensional point cloud stitching method based on dynamic correction according to claim 1, characterized in that: In the fourth step, the point cloud reconstruction component (4) simultaneously photographs the measurement target (2) and the feature points on the feature polyhedron (8), and converts the three-dimensional point cloud data of the measurement target (2) measured by the point cloud reconstruction component (4) into coordinate values ​​in the same reference coordinate system, including: Step 4.1: The point cloud reconstruction component (4) obtains the point cloud data of the measurement target (2) and the feature polyhedron (8) with feature points in the scanning coordinate system corresponding to the first scanning path point. The point cloud reconstruction component (4) continues to move along the scanning path and captures the point cloud data of the measurement target (2) and the feature polyhedron (8) with feature points in the scanning coordinate system corresponding to the current scanning path point. , where the point cloud data obtained by scanning adjacent path points have at least 4 common feature points; Based on the common feature point coordinate data of the measurement target (2) scanned by the point cloud reconstruction component (4) at adjacent path points, the matrix transformation relationship between the two scanning coordinate systems is solved, that is: ； in, represents the number of scan path points, k∈{1,2,3,…,m}, For the At a path point, coordinate data of a feature point on a feature polyhedron (8) in a scanning coordinate system corresponding to the current path point obtained by scanning the point cloud reconstruction component (4); For the Under the scanning path point, the coordinate data of the feature point on the corresponding feature polyhedron (8) in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component (4); and For the The three-dimensional coordinates of the feature points on the feature polyhedron (8) in the scanning coordinate system corresponding to the scanning path points are transformed to The rotation matrix and translation matrix in the scanning coordinate system corresponding to the scanning path points; Represents the matrix transformation relationship between the scanning coordinate system corresponding to the scanning path point at the current path point and the scanning coordinate system corresponding to the scanning path point; Step 4.2, in Under the scanning path point, the matrix transformation relationship between the scanning coordinate system corresponding to the point cloud reconstruction component (4) and the scanning coordinate system corresponding to the first scanning path point is: ； in, For the The coordinate data of the feature points on the feature polyhedron (8) in the scanning coordinate system corresponding to the current path point scanned by the point cloud reconstruction component (4) under the scanning path point; The coordinate data of the feature points on the feature polyhedron (8) in the scanning coordinate system corresponding to the current path point obtained by scanning the point cloud reconstruction component (4) at the first scanning path point; Indicates The matrix transformation relationship between the scanning coordinate system corresponding to each scanning path point and the scanning coordinate system corresponding to the first path point; Determine At each scanning path point, the matrix transformation relationship between the three-dimensional point cloud data of the measurement target (2) captured by the point cloud reconstruction component (4) and the feature point data on the feature polyhedron (8) in the scanning coordinate system corresponding to the first scanning path point is: ； in, For the At a scanning path point, the point cloud reconstruction component (4) scans and obtains the three-dimensional point cloud of the measurement target (2) and the feature point coordinate data of the feature polyhedron (8) in the scanning coordinate system corresponding to the current scanning path point; At the first scanning path point, the point cloud reconstruction component (4) scans and obtains the three-dimensional point cloud of the measurement target (2) and the feature point coordinate data of the feature polyhedron (8) in the scanning coordinate system corresponding to the current scanning path point.

8. The multi-camera three-dimensional point cloud stitching method based on dynamic correction according to claim 1, characterized in that: In step 5, the conversion to the global coordinate system and the completion of point cloud stitching include: ； in, It is At each scanning path point, the three-dimensional point cloud data of the measurement target (2) and the point coordinate data of the feature points of the feature polyhedron (8) in the global coordinate system obtained by scanning the point cloud reconstruction component (4); For the The inverse matrix of the matrix transformation relationship from the global coordinate system to the tracking coordinate system at each scanning path point; For the The matrix transformation relationship from the feature point coordinate system to the tracking coordinate system under each scanning path point; It is the matrix transformation relationship from the scanning coordinate system to the feature point coordinate system during the measurement process; For the The three-dimensional point cloud of the measurement target (2) and the feature point coordinate data of the feature polyhedron (8) in the scanning coordinate system corresponding to the first scanning path point are measured in the scanning coordinate system corresponding to the scanning path point; The point cloud data of adjacent path points all have at least four common feature points, and point cloud splicing in the global coordinate system is achieved through the common feature points.

9. The multi-camera three-dimensional point cloud stitching method based on dynamic correction according to claim 1, characterized in that: Also includes: Step 6: Encapsulate the spliced ​​three-dimensional point cloud data of the measurement target (2), obtain a complete mesh data model of the measurement target (2), and perform detection and comparison with the CAD design model corresponding to the measurement target (2).

10. A multi-camera three-dimensional measurement system based on dynamic correction, characterized in that: include: A measuring platform (1), wherein a measuring target (2) and a backlight marking point (3) are arranged on the measuring platform (1); A point cloud reconstruction component (4) is mounted on the measurement platform (1) via a mechanical arm (5), and the point cloud reconstruction component (4) measures the measurement target (2); A multi-eye tracking component (6), wherein the multi-eye tracking component (6) tracks and measures a measurement target (2) on the measurement platform (1); feature points are arranged on the point cloud reconstruction component (4) and are arranged within the field of view of the multi-eye tracking component (6); The measurement target (2) is mounted on the measurement platform (1) via an electric turntable (7) and is located at the center of the electric turntable (7). A plurality of feature polyhedrons (8) with feature points are also arranged on the surface of the electric turntable (7). The plurality of feature polyhedrons (8) are located around the measurement target (2). The backlight marking point (3) is located on the peripheral side of the electric turntable (7).

Images