Measurement method, system, device and storage medium
Through the integration of multi-source data fusion of laser ranging, image measurement and navigation modules, the problem of limited measurement range and unstable accuracy of RTK receivers is solved, and a higher accuracy and stable measurement of the position of the spatial point to be measured is achieved.
Patent Information
- Application Number
- CN202310946196.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-29
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2043-07-29
AI Technical Summary
In the field of high-precision measurement and mapping, the measurement range of the RTK receiver in the prior art is limited by the length of the centering rod, and the measurement accuracy of the laser RTK receiver is easily affected by factors such as light intensity, receiver inclination angle and operating jitter, resulting in The measurement accuracy is unstable.
Using a measurement system that integrates laser ranging module, image measurement module and navigation module, the measurement data of the points to be measured is obtained through the fusion of multi-source sensor data, and the final position measurement results are calculated using a preset measurement fusion algorithm to reduce the influence of factors and improve the Measurement accuracy.
It improves the accuracy of measuring the position of the points to be measured at different distances, reduces the influence of factors such as light intensity, inclination angle of the measuring equipment and operator jitter, and ensures the stability of measurement accuracy.
Smart Images

Figure CN117848294B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a measurement method, system, device and storage medium. Background Art
[0002] In the field of high-precision surveying and mapping, the use of inertial navigation RTK (Real Time Kinematic) receivers can achieve the measurement of three-dimensional space points. For RTK receivers that rely on centering poles, the measurement range of RTK receivers is often limited due to the length of the centering pole, and even when it is inconvenient for personnel to reach the vicinity of the measurement point, it is impossible to obtain measurement results. The laser RTK receiver that uses a laser ranging module instead of a centering pole can break through the length limitation of the centering pole and achieve non-contact target point measurement, but it is easily affected by factors such as light intensity, receiver tilt angle, and operator jitter, and its measurement accuracy varies greatly within different operating distances.
[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute prior art known to ordinary technicians in the field. Summary of the invention
[0004] In view of the problems in the prior art, the purpose of this application is to provide a measurement method, system, device and storage medium, which can effectively improve the accuracy of spatial point position measurement through data fusion of multi-source sensors.
[0005] The present invention provides a measurement method, comprising the following steps:
[0006] The method is implemented by using a measurement system, the measurement system includes a laser ranging module, an image measurement module and a navigation module, and the method includes the following steps:
[0007] Acquire measurement data of the point to be measured, the measurement data comprising first measurement data acquired from the laser ranging module, second measurement data acquired from the image measurement module, and third measurement data acquired from the navigation module;
[0008] Calculate at least one position measurement result of the point to be measured based on the measurement data of the point to be measured;
[0009] A preset measurement fusion algorithm is adopted to calculate a final position measurement result of the point to be measured based on the at least one position measurement result.
[0010] In some embodiments, the step of obtaining the measurement data of the point to be measured comprises the following steps:
[0011] Acquire navigation information of the measurement system at each time from the navigation module;
[0012] Setting a plurality of shooting positions, at each shooting position, respectively obtaining distance information and shooting images at corresponding moments from the laser ranging module and the image measuring module, the distance information at the plurality of moments being used as the first measurement data, and the shooting images at the plurality of moments being used as the second measurement data;
[0013] Determining a plurality of timestamps corresponding to the first measurement data and the second measurement data;
[0014] Acquire multiple navigation information at corresponding moments from the navigation module according to multiple timestamps of the first measurement data and the second measurement data as the third measurement data.
[0015] In some embodiments, respectively obtaining the distance information and the captured image at the corresponding moment from the image measurement module and the laser ranging module comprises the following steps:
[0016] At each of the shooting positions, controlling the laser ranging module to emit laser light to illuminate the point to be measured;
[0017] The distance information is acquired from the laser distance measuring module by triggering the instruction, and at the same time, the image of the point to be measured is collected by the image measuring module.
[0018] In some embodiments, calculating and obtaining at least one position measurement result of the point to be measured based on the measurement data of the point to be measured comprises the following steps:
[0019] Calculate at least one first position measurement result based on the first measurement data and the third measurement data;
[0020] At least one second position measurement result is calculated based on the second measurement data and the third measurement data.
[0021] In some embodiments, the navigation module includes an IMU sensor and a navigation unit, and the navigation information includes three-dimensional position information and attitude information of the IMU sensor;
[0022] Calculating at least one first position measurement result based on the first measurement data and the third measurement data comprises the following steps:
[0023] Determine the three-dimensional coordinates of the IMU sensor in the geodetic coordinate system according to the three-dimensional position information of the IMU sensor
[0024] Get the coordinate conversion parameters D between the current navigation coordinate system and the earth coordinate system -1 ;
[0025] Determine the coordinate conversion parameters from the carrier coordinate system of the IMU sensor to the current navigation coordinate system according to the posture information of the IMU sensor
[0026] Obtain the projection coordinates of the position vector pointing from the center of the IMU sensor to the laser emission point in the carrier coordinate system
[0027] Determine the projection coordinates of the position vector from the laser emission point to the point to be measured in the IMU carrier coordinate system according to the distance information
[0028] The first position measurement result is obtained by calculation.
[0029] In some embodiments, calculating at least one second position measurement result based on the second measurement data and the third measurement data comprises the following steps:
[0030] Selecting an image captured at a moment as a reference image, and using the camera coordinate system at the moment corresponding to the timestamp of the reference image as a reference coordinate system;
[0031] Acquire coordinate conversion parameters between the reference coordinate system and the earth coordinate system according to the navigation information corresponding to the timestamp of the reference image;
[0032] Obtaining coordinate conversion parameters between a camera coordinate system at a time corresponding to the timestamp of each of the other captured images and the reference coordinate system according to navigation information at a time corresponding to the timestamp of the other captured images except the reference image and navigation information corresponding to the timestamp of the reference image;
[0033] extracting the plane pixel coordinates of the laser irradiation points in the plurality of captured images;
[0034] Calculate the three-dimensional coordinates of the point to be measured in the reference coordinate system based on the plane pixel coordinates of the laser irradiation points in the plurality of captured images and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured images and the reference coordinate system;
[0035] According to the coordinate conversion parameters between the reference coordinate system and the geodetic coordinate system and the three-dimensional coordinates of the measured point in the reference coordinate system, the second measured three-dimensional coordinates of the measured point in the geodetic coordinate system are determined as the second position measurement result.
[0036] In some embodiments, the navigation module includes an IMU sensor and a navigation unit, and the navigation information includes three-dimensional position information and attitude information of the IMU sensor;
[0037] Acquiring coordinate conversion parameters between the reference coordinate system and the earth coordinate system according to navigation information corresponding to the timestamp of the reference image, comprising the following steps:
[0038] Obtaining coordinate conversion parameters between the carrier coordinate system of the IMU sensor and the camera coordinate system of the image measurement module;
[0039] Based on the three-dimensional position information and posture information of the IMU sensor at the time corresponding to the timestamp of the reference image, coordinate conversion parameters between the reference coordinate system and the earth coordinate system are determined.
[0040] In some embodiments, the method of calculating the three-dimensional coordinates of the point to be measured in the reference coordinate system based on the plane pixel coordinates of the laser irradiation point in the plurality of captured images and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured images and the reference coordinate system comprises the following steps:
[0041] For each of the captured images, based on the plane pixel coordinates of the laser irradiation point in the captured image and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured image and the reference coordinate system, respectively calculate the first three-dimensional coordinates of the point to be measured corresponding to the captured image in the reference coordinate system;
[0042] Based on the first three-dimensional coordinates, a triangulation method or a three-dimensional point cloud construction method is used to determine the three-dimensional coordinates of the point to be measured in the reference coordinate system.
[0043] In some embodiments, after calculating and obtaining at least one position measurement result of the point to be measured based on the measurement data of the point to be measured, and before calculating and obtaining a second position measurement result based on the second measurement data and the third measurement data, the following steps are also included:
[0044] Determining whether the distance between the point to be measured and the measurement system is greater than or equal to a preset distance threshold according to the first measurement data;
[0045] If yes, calculating at least one second position measurement result based on the second measurement data and the third measurement data;
[0046] Otherwise, the second position measurement is not calculated.
[0047] In some embodiments, calculating at least one second position measurement result based on the second measurement data and the third measurement data comprises the following steps:
[0048] Screening each captured image in the second measurement data to eliminate captured images whose quality does not meet preset image quality requirements;
[0049] The second position measurement result is calculated based on the captured image that is not eliminated and the navigation information at the corresponding moment in the third measurement data.
[0050] In some embodiments, the using of a preset measurement fusion algorithm to calculate the final position measurement result of the point to be measured based on the at least one position measurement result comprises the following steps:
[0051] Performing weighted fusion on the first position measurement results corresponding to the plurality of the moments based on a set first weight value to obtain a fused first position measurement result;
[0052] The fused first position measurement result and the second position measurement result are weighted-fused based on a set second weight value to obtain a final position measurement result of the point to be measured.
[0053] In some embodiments, the first position measurement results at multiple moments are weightedly fused based on a set first weight value.
[0054] In some embodiments, the following steps are also included:
[0055] A second weight of the fused first position measurement result and the second position measurement result is set according to the image quality of the captured image corresponding to the second position measurement result.
[0056] The present application also provides a measurement system, which is used to implement the measurement method, and includes:
[0057] Laser ranging module, image measurement module and navigation module;
[0058] A control module is used to obtain measurement data of a point to be measured, wherein the measurement data includes first measurement data obtained from the laser ranging module, second measurement data obtained from the image measurement module, and third measurement data obtained from the navigation module; calculate at least one position measurement result of the point to be measured based on the measurement data of the point to be measured; and use a preset measurement fusion algorithm to calculate a final position measurement result of the point to be measured based on the at least one position measurement result.
[0059] The present application also provides a measuring device, including:
[0060] case;
[0061] A laser ranging module is arranged on the housing;
[0062] An image measurement module is disposed on the housing, and a shooting direction of the image measurement module is consistent with a laser emission direction of the laser ranging module;
[0063] A navigation module is at least partially disposed in the housing, and an antenna of the navigation module is disposed outside the housing;
[0064] The control module is disposed inside the housing and is configured to execute the steps in the measurement method.
[0065] An embodiment of the present application also provides a computer-readable storage medium for storing a program, and when the program is executed by a processor, the steps of the measurement method are implemented.
[0066] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.
[0067] The measurement method, system, device and storage medium of the present application have the following beneficial effects:
[0068] The present application proposes a new measurement method for measuring the position of a spatial point to be measured, which is implemented by a measurement system that integrates a laser ranging module, an image measurement module and a navigation module. By fusion processing of multi-source measurement data, the accuracy of position measurement of points to be measured at different distances is improved, and the influence of factors such as light intensity, tilt angle of the measuring equipment and operator jitter during the measurement process is reduced, thereby ensuring the stability of the measurement accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0069] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings.
[0070] Figure 1 is a flow chart of a measurement method according to an embodiment of the present application;
[0071] Figure 2 is a schematic diagram of the structure of a measurement system according to an embodiment of the present application;
[0072] Figure 3 is a front view of a measuring device according to an embodiment of the present application;
[0073] Figure 4 is a bottom view of a measuring device according to an embodiment of the present application;
[0074] Figure 5 is a flow chart of obtaining measurement data of a point to be measured according to an embodiment of the present application;
[0075] Figure 6 is a flow chart of calculating and obtaining at least one position measurement result of a point to be measured according to an embodiment of the present application;
[0076] Figure 7This is a flow chart of calculating a final position measurement result of a point to be measured based on at least one position measurement result according to an embodiment of the present application. DETAILED DESCRIPTION
[0077] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0078] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and thus their repeated descriptions will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices. Although "first" or "second" etc. are used in this specification to represent certain features, they are only used to represent the function and are not used as a limitation on the number and importance of specific features.
[0079] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the steps. For example, some steps may be decomposed, while some steps may be combined or partially combined. Therefore, the actual execution order may be changed according to the actual situation.
[0080] like Figure 1 As shown, an embodiment of the present application provides a measurement method, which is implemented by a measurement system, wherein the measurement system includes a laser ranging module, an image measurement module, and a navigation module. The measurement method includes the following steps:
[0081] S100: Acquire measurement data of a point to be measured, wherein the measurement data includes first measurement data acquired from the laser ranging module, second measurement data acquired from the image measurement module, and third measurement data acquired from the navigation module;
[0082] The first measurement data, the second measurement data, and the third measurement data respectively acquired by different measurement modules form multi-source measurement data, which are commonly used for subsequent measurement result calculation;
[0083] S200: Obtain at least one position measurement result of the point to be measured by calculation based on the measurement data of the point to be measured;
[0084] S300: Using a preset measurement fusion algorithm, calculate a final position measurement result of the point to be measured based on the at least one position measurement result.
[0085] Therefore, the present application proposes a new measurement method for measuring the position of a spatial point to be measured, which is implemented by a measurement system that integrates a laser ranging module, an image measurement module and a navigation module. By fusion processing of multi-source measurement data, the accuracy of the position measurement of points to be measured at different distances is improved, and the influence of factors such as light intensity, tilt angle of the measuring equipment and operator jitter during the measurement process is reduced, thereby ensuring the stability of the measurement accuracy.
[0086] like Figure 2 As shown, an embodiment of the present invention further provides a measurement system for implementing the measurement method, the system comprising:
[0087] Laser ranging module M100, image measurement module M200 and navigation module M300;
[0088] The control module M400 is used to obtain measurement data of the point to be measured, the measurement data including first measurement data obtained from the laser ranging module M100, second measurement data obtained from the image measurement module M200 and third measurement data obtained from the navigation module M300; calculate at least one position measurement result of the point to be measured based on the measurement data of the point to be measured; and use a preset measurement fusion algorithm to calculate the final position measurement result of the point to be measured based on the at least one position measurement result.
[0089] The present application is implemented by adopting the measurement system, which is a measurement system integrating a laser ranging module, an image measurement module and a navigation module. By fusion processing of multi-source measurement data, the accuracy of the position measurement of the measured point is improved, and the influence of factors such as light intensity, tilt angle of the measuring equipment and operator jitter during the measurement process is reduced, thereby ensuring the stability of the measurement accuracy.
[0090] An embodiment of the present invention further provides a measuring device, including:
[0091] case;
[0092] A laser ranging module is arranged on the housing;
[0093] An image measurement module is disposed on the housing, and a shooting direction of the image measurement module is consistent with a laser emission direction of the laser ranging module;
[0094] A navigation module is at least partially disposed inside the housing, and an antenna of the navigation module is disposed outside the housing, for example, the navigation module includes a GNSS module, an IMU sensor and an antenna, and the GNSS module and the IMU sensor are disposed inside the housing;
[0095] The control module is disposed inside the housing and is configured to execute the steps in the measurement method by executing the executable instructions.
[0096] like Figure 3 and Figure 4 The figure is a schematic diagram of the structure of the measuring device of this embodiment. The measuring device comprises a housing 1, a navigation module 2, an image measurement module 4, a laser ranging module 5 and a control module 7. A linkage trigger device 3 is provided on the surface of the housing 1. The housing 1 is also provided with a centering rod connection hole 6 for connecting with the centering rod. The measuring device adopts an integrated design structure, is small in size and has low power consumption, and is convenient for users to carry and operate for a long time.
[0097] The navigation module 2 adopts a GNSS / INS combined navigation module, GNSS stands for Global Navigation Satellite System, and INS stands for Inertial Navigation System, an inertial orientation positioning navigation system. The navigation module 2 includes a navigation unit and an IMU (Inertial Measurement Unit) sensor, the navigation unit includes a GNSS antenna, a radio frequency front end, a Kalman filter and a CPU processor, and the IMU sensor includes a three-axis accelerometer and a three-axis gyroscope. The navigation module 2 sends the high-frequency attitude observation values and GNSS observation values of the IMU sensor to the CPU processor, respectively realizing the mechanical arrangement of the inertial navigation system and the RTK solution of the satellite navigation system, and further fusing the solution results through the Kalman filter to obtain the high-frequency position and attitude information of the IMU sensor, that is, to obtain navigation information.
[0098] The linkage trigger device 3 can be in the form of a button or a touch screen. When it is operated, it triggers the laser distance measurement module 5 to measure the distance and the image measurement module 4 to take pictures. The image measurement module 4 can be a camera, specifically, including a lens, a photosensitive chip, an A / D converter and a digital information processing chip. The laser distance measurement module 5 includes a single-line laser rangefinder and a CPU processor. By irradiating the laser point onto the point to be measured in space, a phase difference observation value is obtained when it is triggered by the linkage trigger device 3. The CPU processor processes the observation value to obtain the distance information between the point to be measured and the laser emission point. The shooting direction of the image measurement module 4 is consistent with the laser emission direction of the laser distance measurement module 5, so that when the image measurement module 4 and the laser distance measurement module 5 are triggered at the same time, the distance information and the pictures can be obtained at the same time.
[0099] like Figure 5 As shown, in this embodiment, the step S100: obtaining the measurement data of the point to be measured, includes the following steps:
[0100] S110: Acquire navigation information of the measurement system at each time from the navigation module;
[0101] The navigation module described here is used to obtain navigation information at various times in real time, and each navigation information has a timestamp of the acquisition time;
[0102] The step S110 specifically includes: turning on the navigation module on an open surface, configuring the navigation module and accessing differential data to obtain RTK high-precision three-dimensional position and velocity information. Then the following steps are used to initialize the navigation module: first, the receiver is stationary for a few seconds to obtain the initial values of the roll angle and pitch angle of the IMU sensor relative to the local navigation coordinate system, and then the measurement device is shaken to initialize the heading angle of the IMU sensor relative to the local navigation coordinate system, so that the GNSS / INS combined navigation module is successfully initialized; the local navigation coordinate value here refers to the local geographic horizontal coordinate system (Local Level Frame, LLF), which can provide intuitive navigation parameters, the origin of the coordinate system is the center of the carrier, the x-axis points to the north along the tangent direction of the reference ellipsoid meridian, the y-axis is vertically downward along the normal of the reference ellipsoid, and the z-axis forms a right-handed coordinate system with the x-axis and the y-axis in the local horizontal plane; in this embodiment, the carrier is a measurement device equipped with an IMU sensor;
[0103] Initializing the navigation module here may also include the following steps: randomly selecting a fixed point on an open surface, tilting a certain angle above the selected fixed point, generally in the front, back, left and right directions, irradiating the laser point of the laser ranging module on the fixed point, obtaining multiple distance information from the emission point of the laser ranging module to the fixed point, using the distance information to calculate the initial heading angle of the IMU sensor relative to the local navigation coordinate system, and completing the initialization of the GNSS / INS integrated navigation module;
[0104] After the navigation module is initialized, the RTK three-dimensional position and velocity information and the mechanical arrangement results of the IMU sensor are continuously fed into the Kalman filter to obtain the high-frequency IMU three-dimensional position and attitude information, that is, to obtain real-time navigation information;
[0105] S120: setting a plurality of shooting positions, and at each of the shooting positions, obtaining distance information and shooting images at corresponding moments from the laser ranging module and the image measuring module, respectively, the distance information at the plurality of moments being used as the first measurement data, and the shooting images at the plurality of moments being used as the second measurement data;
[0106] Specifically, the shooting position and the time may correspond one-to-one, or multiple distance information and multiple captured images may be obtained for each shooting position, that is, the shooting position and the time are in a one-to-many relationship, but the time and the distance information and the captured image are in a one-to-one correspondence;
[0107] Taking setting two shooting positions as an example, step S120 may specifically include the following steps:
[0108] At the first position, the laser distance measuring module is controlled to irradiate the laser point onto the point to be measured, and the linkage trigger device is pressed, so that the laser distance measuring module and the image measuring module respectively collect the distance information and the captured image corresponding to the point to be measured, and the laser distance measuring module and the image measuring module respectively attach time stamp information to the collected distance information and the captured image based on the PPS (Pulse Per Second) signal;
[0109] Similarly, at the second position, the distance information and captured images of the same point to be measured can be collected according to the specific steps at the first position, and the collected distance information and captured images are attached with the timestamp information when collected at the second position. The images taken at the selected second position and the first position should generally have a certain parallax. Many shooting positions can also be selected to perform the measurement process described above on the above-mentioned point to be measured, and the distance information and captured images with timestamp information collected at multiple shooting positions can be obtained;
[0110] S130: Determine multiple timestamps corresponding to the first measurement data and the second measurement data;
[0111] S140: acquiring, from the navigation module, a plurality of navigation information at corresponding moments according to a plurality of timestamps of the first measurement data and the second measurement data, as the third measurement data, so that the third measurement data also includes navigation information at a plurality of moments, and the timestamp of the third measurement data corresponds to the timestamp of the first measurement data and the second measurement data;
[0112] The timestamp here is the timestamp of each moment when the distance information and the captured image are obtained, and the navigation information corresponding to the timestamp is obtained from the navigation module, so that the IMU position and attitude information obtained by the navigation module, the distance information obtained by the laser ranging module, and the captured image obtained by the image measurement module have the same time reference.
[0113] In this embodiment, the step S120: respectively obtaining the distance information and the captured image at the corresponding moment from the image measurement module and the laser ranging module, comprises the following steps:
[0114] At each of the shooting positions, controlling the laser ranging module to emit laser light to illuminate the point to be measured;
[0115] The distance information is obtained from the laser distance measurement module through a trigger instruction, and at the same time, the image measurement module collects the photographed image of the point to be measured. The trigger instruction can be issued by pressing a physical button, or it can be issued from a mobile terminal carried by the user.
[0116] like Figure 6 As shown, in this embodiment, the step S200: obtaining at least one position measurement result of the point to be measured by calculation based on the measurement data of the point to be measured, comprises the following steps:
[0117] S210: Calculate and obtain at least one first position measurement result based on the first measurement data and the third measurement data;
[0118] S230: Calculate at least one second position measurement result based on the second measurement data and the third measurement data.
[0119] As described above, the navigation module includes an IMU sensor and a navigation unit, and the navigation information includes three-dimensional position information and attitude information of the IMU sensor. The step S210: calculating at least one first position measurement result based on the first measurement data and the third measurement data includes the following steps:
[0120] Determine the three-dimensional coordinates of the IMU sensor in the geodetic coordinate system according to the three-dimensional position information of the IMU sensor The three-dimensional position information of the IMU sensor obtained from the navigation module is the three-dimensional coordinates of the IMU sensor in the geodetic coordinate system;
[0121] Get the coordinate conversion parameters D between the current navigation coordinate system and the earth coordinate system -1 Here, the coordinate conversion parameter D between the current navigation coordinate system and the geodetic coordinate system can be calculated based on the three-dimensional position information of the IMU sensor and the inherent parameters of the earth reference ellipsoid -1 (including translation matrix and rotation matrix), or directly obtain the pre-configured coordinate conversion parameters D between the current navigation coordinate system and the earth coordinate system according to the type of navigation module -1 ;
[0122] Determine the coordinate conversion parameters from the carrier coordinate system of the IMU sensor to the current navigation coordinate system according to the posture information of the IMU sensor (including translation matrix and rotation matrix); the carrier coordinate system here refers to an orthogonal coordinate system fixed to the carrier, the x-axis is in the same direction as the roll axis of the carrier angular motion and points to the front of the carrier, the y-axis is in the same direction as the pitch axis of the carrier angular motion and points to the right of the carrier, and the z-axis is in the same direction as the heading axis of the carrier angular motion and forms a right-handed coordinate system with the x-axis and y-axis;
[0123] Obtain the projection coordinates of the position vector pointing from the center of the IMU sensor to the laser emission point in the carrier coordinate system Here the projection coordinates The external parameters of the IMU sensor and the laser ranging module can be obtained by calibrating the software (including the coordinate conversion parameters between the carrier coordinate system of the IMU sensor and the laser coordinate system of the laser ranging module, including the translation matrix and the rotation matrix), or by actually measuring the distance between the IMU sensor and the laser ranging module with a ruler, or by measuring in the structural design drawings of the measuring equipment, specifically, by converting the three-dimensional coordinates of the laser emission point in the laser coordinate system into the three-dimensional coordinates in the carrier coordinate system;
[0124] Determine the projection coordinates of the position vector from the laser emission point to the point to be measured in the IMU carrier coordinate system according to the distance information Here The acquisition method can be: obtaining the distance information between the point to be measured and the laser emission point through the laser ranging module, obtaining the three-dimensional coordinates of the point to be measured in the laser coordinate system, and converting the three-dimensional coordinates of the point to be measured in the laser coordinate system into the carrier coordinate system of the IMU sensor through the external parameters of the IMU sensor and the laser rangefinder;
[0125] The first position measurement result is calculated using the following formula:
[0126]
[0127] in, The first measured three-dimensional coordinates of the point to be measured in the geodetic coordinate system are used as the first position measurement result.
[0128] In this embodiment, the step S220: calculating and obtaining at least one second position measurement result based on the second measurement data and the third measurement data comprises the following steps:
[0129] (1) Calibrate the internal parameters of the image measurement module. The camera internal parameters of the image measurement module can be obtained by calibrating the camera on a camera calibration platform using a chessboard or an AprilGrid calibration plate. The camera internal parameters mainly include resolution (e.g., 1920×1080), coordinate conversion parameters between the UV coordinate system and the pixel coordinate system, and the size of the photosensitive chip.
[0130] (2) Selecting any one of the multiple images captured by the image measurement module as a reference image to initialize the image measurement; specifically including:
[0131] Select an image captured at a certain moment as a reference image, and use the camera coordinate system at the time corresponding to the timestamp of the reference image as the reference coordinate system. The camera coordinate system here refers to the coordinate system based on the image measurement module, whose origin is the center of the optical lens of the image measurement module, the x-axis points to the right along the direction of the camera lens, the z-axis points to the front along the direction of the camera lens, and the y-axis, x-axis and z-axis form a right-handed coordinate system.
[0132] According to the navigation information corresponding to the timestamp of the reference image, coordinate conversion parameters between the reference coordinate system and the earth coordinate system are obtained.
[0133] In this embodiment, obtaining the coordinate conversion parameters between the reference coordinate system and the earth coordinate system according to the navigation information corresponding to the timestamp of the reference image includes the following steps:
[0134] Calibrate the external parameters of the IMU sensor and the image measurement module, the external parameters including the coordinate conversion parameters between the carrier coordinate system of the IMU sensor and the image measurement module, including the rotation matrix and the translation matrix;
[0135] The coordinate conversion parameters between the carrier coordinate system of the IMU sensor and the earth coordinate system are determined by combining the external parameters of the IMU sensor and the image measurement module to determine the conversion parameters between the reference coordinate system and the earth coordinate system, including the translation matrix and the rotation matrix.
[0136] (3) according to the navigation information at the time corresponding to the timestamp of other captured images other than the reference image and the navigation information corresponding to the timestamp of the reference image, obtaining coordinate conversion parameters between the camera coordinate system at the time corresponding to the timestamp of each of the other captured images and the reference coordinate system, including a translation matrix and a rotation matrix; wherein the coordinate conversion parameters can also be obtained by a VIO (Visual Inertial Odometry) method, which is a technology for measuring sensor status using one or more cameras and one or more IMU sensors, or can also be obtained by using a VO (Visual Odometry) method after determining a monocular scale factor;
[0137] (4) extracting the plane pixel coordinates of the laser irradiation points in the plurality of captured images;
[0138] Specifically, the laser emitted by the laser ranging module irradiates the red background formed on the point to be measured, and the plane pixel coordinates of the point to be measured are extracted from each captured image, which may include extracting the plane pixel coordinates of the point to be measured in other captured images except the reference image, or extracting the plane pixel coordinates of the point to be measured in each captured image including the reference image;
[0139] The plane pixel coordinates can be directly extracted by a feature point extraction algorithm, or obtained by extracting several closest similar feature points and then manually screening them, or by manually selecting them after enlarging the image, thereby determining the pixel point coordinates corresponding to the point to be measured.
[0140] (5) Calculating the three-dimensional coordinates of the point to be measured in the reference coordinate system based on the plane pixel coordinates of the laser irradiation points in the plurality of captured images and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured images and the reference coordinate system.
[0141] In this embodiment, the three-dimensional coordinates of the point to be measured in the reference coordinate system are calculated based on the plane pixel coordinates of the laser irradiation points in the plurality of captured images and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured images and the reference coordinate system, including the following steps:
[0142] For each of the captured images, based on the plane pixel coordinates of the laser irradiation point in the captured image and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured image and the reference coordinate system, respectively calculate the first three-dimensional coordinates of the point to be measured corresponding to the captured image in the reference coordinate system;
[0143] Based on the first three-dimensional coordinates, a triangulation method or a three-dimensional point cloud construction method is used to determine the three-dimensional coordinates of the point to be measured in the reference coordinate system.
[0144] Specifically, according to the plane pixel coordinates of the point to be measured extracted on the plane of the captured image, the camera intrinsic parameters obtained by calibration, the coordinate system transformation relationship between the camera coordinate system at the time corresponding to the timestamp of the captured image and the reference coordinate system, a triangulation method is used to calculate the three-dimensional coordinates of the point to be measured in the reference coordinate system. Among them, if the image measurement module shoots more than two captured images, the three-dimensional point cloud information around the point to be measured can also be generated by the SFM (Structure From Motion) method, and then the three-dimensional coordinates of the point to be measured in the reference coordinate system are determined according to the three-dimensional point cloud information. The triangulation method here refers to: in the field of photogrammetry, a single image cannot restore the three-dimensional coordinates of the image point, and at least two images are required to obtain the true coordinates of the pixel point. Triangulation determines the distance to the same position point by observing the angle between the two shooting positions, so as to obtain depth information and then determine the true coordinates. SFM is a technology for estimating three-dimensional structure from a series of multiple two-dimensional image sequences containing visual motion information.
[0145] (6) Determine, based on the coordinate conversion parameters between the reference coordinate system and the geodetic coordinate system and the three-dimensional coordinates of the measured point in the reference coordinate system, the second measured three-dimensional coordinates of the measured point in the geodetic coordinate system as the second position measurement result.
[0146] Therefore, in this embodiment, by making the laser distance measurement module irradiate the laser on the point to be measured to form a red background during shooting, the laser point can be directly used as the image feature point, so that it has obvious feature information, and there is no need to use complex feature point extraction and matching algorithms to achieve impact measurement, saving computing resources while ensuring computing timeliness. The user only needs to simply control the linkage trigger device to collect distance information and shoot images at the same time, which is very convenient to operate.
[0147] In this embodiment, the combination of navigation information, distance information and image information can realize accurate measurement of the position of the test point, which is particularly suitable for the position measurement of the long-distance space test point. In one embodiment, when the measurement method is used to measure the position of the space test point at a short distance, due to the short distance, the measurement is less likely to be affected by other factors. The navigation information and distance information can also achieve high-precision position measurement. At this time, there is no need to process the captured image, which saves the time of image processing and improves the speed of solving the position result.
[0148] Specifically, Figure 6As shown, in this embodiment, after the step S200: at least one position measurement result of the point to be measured is calculated based on the measurement data of the point to be measured, before the step S230, the following steps are also included:
[0149] S220: Determine, according to the first measurement data, whether the distance between the point to be measured and the measurement system is greater than or equal to a preset distance threshold;
[0150] If yes, it means that the position measurement is for the long-distance measured point, and the process continues to step S230: at least one second position measurement result is calculated based on the second measurement data and the third measurement data, and at least one first position measurement result and at least one second position measurement result are used to fuse the position results in the subsequent step S300;
[0151] Otherwise, S240: if it indicates that the position measurement is for the short-distance measured point, the second position measurement result is not calculated, but the position result fusion is directly performed using the at least one first position measurement result obtained.
[0152] When the point to be measured is far away, when holding the measuring device to collect distance information and take pictures, the hand may shake, making it difficult for the laser point to illuminate the point to be measured in the three-dimensional space, or the image quality is too poor due to the environment where the image is collected due to excessive light or too dark light, making it difficult to extract feature points. At this time, the captured images can be adaptively screened and the images with poor shooting quality can be eliminated to avoid introducing inaccurate position measurement results. In this embodiment, the step S230: calculating at least one second position measurement result based on the second measurement data and the third measurement data includes the following steps:
[0153] Screening each captured image in the second measurement data to eliminate captured images whose quality does not meet preset image quality requirements;
[0154] The second position measurement result is calculated based on the captured image that is not eliminated and the navigation information at the corresponding moment in the third measurement data.
[0155] The quality score of the image captured here can be scored manually by the staff, or a preset image quality scoring model can be used to score the image quality, or several quality scoring indicators can be set: brightness, clarity, contrast, whether the test point is visible, etc., and score them separately and then calculate the total score by weight.
[0156] like Figure 7 As shown, in this embodiment, the step S300: using a preset measurement fusion algorithm to calculate the final position measurement result of the point to be measured based on the at least one position measurement result, includes the following steps:
[0157] S310: performing weighted fusion on the first position measurement results corresponding to the plurality of the moments based on a set first weight value to obtain a fused first position measurement result; the weighted fusion herein is to weighted average the three-dimensional position coordinates in the first position measurement results at each moment to obtain a three-dimensional position coordinate;
[0158] S320: weighted fusion is performed on the fused first position measurement result and the second position measurement result based on a set second weight value to obtain a final position measurement result of the point to be measured; the weighted fusion here is to weighted average the three-dimensional position coordinates in the fused first position measurement result and the second position measurement result to obtain a final three-dimensional position coordinate as the final position measurement result.
[0159] In this embodiment,
[0160] The first position measurement results at the multiple moments are weightedly fused based on the corresponding first weights using the following formula:
[0161]
[0162] Among them, P is the first position measurement result after fusion, P i is the first position measurement result at the i-th moment, w i is the first weight of the first position measurement result at the i-th moment and satisfies:
[0163]
[0164] Where i∈[1,n], n is the number of moments corresponding to the first position measurement result obtained, s i is the distance information at the i-th moment.
[0165] In this embodiment, the following steps are also included:
[0166] A second weight of the fused first position measurement result and the second position measurement result is set according to the image quality of the captured image corresponding to the second position measurement result.
[0167] For example, the second weights of the fused first position measurement result and the second position measurement result can be determined according to the quality score of the image. For example, when the quality score of the image is less than the first preset score threshold, the second weight of the second position measurement result is set to 0, and the second weight of the fused first position measurement result is set to 1. If the quality score of the image is between the first preset score threshold and the second preset score threshold, the second weight of the first position measurement result is set to 0.7, and the second weight of the second position measurement result is set to 0.3. If the quality score of the image is greater than the second preset score threshold, the second weight of the first position measurement result is set to 0.5, and the second weight of the second position measurement result is set to 0.5. The method of setting the second weight here is only an example. In other implementation methods, other setting methods can also be used, all of which are within the protection scope of the present application.
[0168] Therefore, in this embodiment, by fusing the measurement data of multiple source sensors and combining the distance of the measured point, the quality of the measurement data, and the quality of the captured image to screen and fuse the measurement results, the optimal position measurement result can be output, effectively avoiding the influence of hand shaking, weather conditions or other interference on the position measurement accuracy, thereby improving the position measurement accuracy.
[0169] The embodiment of the present application also provides a computer-readable storage medium for storing a program, which implements the steps of the measurement method when executed by a processor. In some possible implementations, various aspects of the present application can also be implemented in the form of a program product, which includes a program code, and when the program product is executed on a terminal device, the program code is used to cause the terminal device to perform the steps of various exemplary implementations of the present application described in the above measurement method section of this specification.
[0170] According to the program product for implementing the above method according to the embodiment of the present application, it can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be executed on a terminal device, such as a personal computer. However, the program product of the present application is not limited to this. In this document, the readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.
[0171] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0172] The computer readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by an instruction execution system, an apparatus, or a device or used in combination with it. The program code contained on the readable storage medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.
[0173] Program code for performing the operations of the present application may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).
[0174] The program in the computer storage medium implements the steps of the measurement method when executed by the processor. Therefore, the computer storage medium can also obtain the technical effect of the above-mentioned measurement method.
[0175] The above content is a further detailed description of the present application in combination with specific preferred implementation methods, and it cannot be determined that the specific implementation of the present application is limited to these descriptions. For ordinary technicians in the technical field to which the present application belongs, several simple deductions or substitutions can be made without departing from the concept of the present application, which should be deemed to fall within the scope of protection of the present application.
Claims
1. A position measurement method, characterized in that: The method is implemented by using a position measurement system, the position measurement system includes a laser ranging module, an image measurement module and a navigation module, the navigation module includes an IMU sensor and a navigation unit, and the method includes the following steps: Acquire measurement data of the point to be measured, the measurement data comprising first measurement data acquired from the laser ranging module, second measurement data acquired from the image measurement module, and third measurement data acquired from the navigation module; Calculate at least one position measurement result of the point to be measured based on the measurement data of the point to be measured; Using a preset measurement fusion algorithm, calculate a final position measurement result of the point to be measured based on the at least one position measurement result; The step of obtaining the measurement data of the point to be measured comprises the following steps: Acquire navigation information of the measurement system at each time from the navigation module, the navigation information including three-dimensional position information and attitude information of the IMU sensor; Setting a plurality of shooting positions, at each shooting position, respectively obtaining distance information and shooting images at corresponding moments from the laser ranging module and the image measuring module, the distance information at the plurality of moments being used as the first measurement data, and the shooting images at the plurality of moments being used as the second measurement data; Determining a plurality of timestamps corresponding to the first measurement data and the second measurement data; acquiring, from the navigation module, a plurality of navigation information at corresponding moments according to a plurality of timestamps of the first measurement data and the second measurement data as the third measurement data; Wherein, calculating and obtaining at least one position measurement result of the point to be measured based on the measurement data of the point to be measured comprises the following steps: Calculate at least one first position measurement result based on the first measurement data and the third measurement data; Calculate at least one second position measurement result based on the second measurement data and the third measurement data; The method of using a preset measurement fusion algorithm to calculate the final position measurement result of the point to be measured based on the at least one position measurement result comprises the following steps: Performing weighted fusion on the first position measurement results corresponding to the plurality of the moments based on a set first weight value to obtain a fused first position measurement result; The fused first position measurement result and the second position measurement result are weighted-fused based on a set second weight value to obtain a final position measurement result of the point to be measured.
2. The position measurement method according to claim 1, characterized in that: Acquiring the distance information and the captured image at the corresponding time from the image measurement module and the laser distance measurement module respectively comprises the following steps: At each of the shooting positions, controlling the laser ranging module to emit laser light to illuminate the point to be measured; The distance information is acquired from the laser distance measuring module by triggering the instruction, and at the same time, the image of the point to be measured is collected by the image measuring module.
3. The position measurement method according to claim 1, characterized in that: Calculating at least one first position measurement result based on the first measurement data and the third measurement data comprises the following steps: Determine the three-dimensional coordinates of the IMU sensor in the geodetic coordinate system according to the three-dimensional position information of the IMU sensor Get the coordinate conversion parameters D between the current navigation coordinate system and the earth coordinate system -1 ; Determine the coordinate conversion parameters from the carrier coordinate system of the IMU sensor to the current navigation coordinate system according to the posture information of the IMU sensor Obtain the projection coordinates of the position vector pointing from the center of the IMU sensor to the laser emission point in the carrier coordinate system Determine the projection coordinates of the position vector from the laser emission point to the point to be measured in the IMU carrier coordinate system according to the distance information The first position measurement result is obtained by calculation.
4. The position measurement method according to claim 1, characterized in that: Calculating at least one second position measurement result based on the second measurement data and the third measurement data comprises the following steps: Selecting an image captured at a moment as a reference image, and using the camera coordinate system at the moment corresponding to the timestamp of the reference image as a reference coordinate system; Acquire coordinate conversion parameters between the reference coordinate system and the earth coordinate system according to the navigation information corresponding to the timestamp of the reference image; Obtaining coordinate conversion parameters between a camera coordinate system at a time corresponding to the timestamp of each of the other captured images and the reference coordinate system according to navigation information at a time corresponding to the timestamp of the other captured images except the reference image and navigation information corresponding to the timestamp of the reference image; extracting the plane pixel coordinates of the laser irradiation points in the plurality of captured images; Calculate the three-dimensional coordinates of the point to be measured in the reference coordinate system based on the plane pixel coordinates of the laser irradiation points in the plurality of captured images and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured images and the reference coordinate system; According to the coordinate conversion parameters between the reference coordinate system and the geodetic coordinate system and the three-dimensional coordinates of the measured point in the reference coordinate system, the second measured three-dimensional coordinates of the measured point in the geodetic coordinate system are determined as the second position measurement result.
5. The position measurement method according to claim 4, characterized in that: Acquiring coordinate conversion parameters between the reference coordinate system and the earth coordinate system according to navigation information corresponding to the timestamp of the reference image, comprising the following steps: Obtaining coordinate conversion parameters between the carrier coordinate system of the IMU sensor and the camera coordinate system of the image measurement module; Based on the three-dimensional position information and posture information of the IMU sensor at the time corresponding to the timestamp of the reference image, coordinate conversion parameters between the reference coordinate system and the earth coordinate system are determined.
6. The position measurement method according to claim 4, characterized in that: The method of calculating the three-dimensional coordinates of the point to be measured in the reference coordinate system based on the plane pixel coordinates of the laser irradiation points in the plurality of captured images and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured images and the reference coordinate system comprises the following steps: For each of the captured images, based on the plane pixel coordinates of the laser irradiation point in the captured image and the coordinate conversion parameters between the camera coordinate system at the moment corresponding to the timestamp of the captured image and the reference coordinate system, respectively calculate the first three-dimensional coordinates of the point to be measured corresponding to the captured image in the reference coordinate system; Based on the first three-dimensional coordinates, a triangulation method or a three-dimensional point cloud construction method is used to determine the three-dimensional coordinates of the point to be measured in the reference coordinate system.
7. The position measurement method according to claim 1, characterized in that: After calculating and obtaining at least one position measurement result of the point to be measured based on the measurement data of the point to be measured, and before calculating and obtaining a second position measurement result based on the second measurement data and the third measurement data, the following steps are also included: Determining whether the distance between the point to be measured and the measurement system is greater than or equal to a preset distance threshold according to the first measurement data; If yes, calculating at least one second position measurement result based on the second measurement data and the third measurement data; Otherwise, the second position measurement is not calculated.
8. The position measurement method according to claim 1, characterized in that: Calculating at least one second position measurement result based on the second measurement data and the third measurement data comprises the following steps: Screening each captured image in the second measurement data to eliminate captured images whose quality does not meet preset image quality requirements; The second position measurement result is calculated based on the captured image that is not eliminated and the navigation information at the corresponding moment in the third measurement data.
9. The position measurement method according to claim 1, characterized in that: The first position measurement results at the multiple moments are weightedly fused based on a set first weight value.
10. The position measurement method according to claim 1, characterized in that: The following steps are also included: A second weight of the fused first position measurement result and the second position measurement result is set according to the image quality of the captured image corresponding to the second position measurement result.
11. A position measurement system, characterized in that: For implementing the position measurement method according to any one of claims 1 to 10, the system comprises: Laser ranging module, image measurement module and navigation module; A control module is used to obtain measurement data of a point to be measured, wherein the measurement data includes first measurement data obtained from the laser ranging module, second measurement data obtained from the image measurement module, and third measurement data obtained from the navigation module; calculate at least one position measurement result of the point to be measured based on the measurement data of the point to be measured; and use a preset measurement fusion algorithm to calculate a final position measurement result of the point to be measured based on the at least one position measurement result.
12. A position measuring device, characterized in that: include: case; A laser ranging module is arranged on the housing; An image measurement module is disposed on the housing, and a shooting direction of the image measurement module is consistent with a laser emission direction of the laser ranging module; A navigation module is at least partially disposed in the housing, and an antenna of the navigation module is disposed outside the housing; The control module is disposed inside the housing and is configured to execute the steps in the position measurement method according to any one of claims 1 to 10.
13. A computer-readable storage medium for storing a program, characterized in that: When the program is executed by a processor, the steps of the position measurement method according to any one of claims 1 to 10 are implemented.
