Image-based shipborne point cloud correction method
Through image processing and interpolation algorithms, point cloud data abnormalities caused by ship jitter in ship 3D laser scanning measurements are automatically identified and corrected, which solves the problem of data jitter in ship jitter and improves the stability and accuracy of the measurement data.
Patent Information
- Application Number
- CN202410985678.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2024-11-12
AI Technical Summary
During the three-dimensional laser scanning measurement on board, the point cloud data caused by the jitter of the ship cannot be corrected by the attitude measurement equipment, resulting in the data jitter that cannot be eliminated, affecting the measurement efficiency and accuracy.
Using the image-based ship-borne point cloud correction method, the three-dimensional laser scanning data and the image data obtained synchronously are processed, and the interpolation algorithm and feature line matching mechanism are used to automatically identify and correct abnormal areas, and the correction data is generated to correct point cloud data. .
It effectively solves the problem of point cloud data jitter caused by ship jitter in shipboard measurement, improves the stability and accuracy of the measurement data, and ensures the completion of the measurement task.
Smart Images

Figure CN118941475A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of massive technology, and in particular to an image-based shipborne point cloud correction method. Background Art
[0002] Laser 3D scanning equipment is generally composed of lasers, optical cameras, positioning equipment and attitude measurement equipment. It uses the principle of laser ranging to project the laser onto the surface of the object to be measured, and then reflect it back to the sensor in the scanner. The scanner calculates the distance between it and the object based on this. Combined with the ranging position and attitude, the position of the object in space can be determined, and then 3D point cloud data can be obtained. Combined with the synchronously acquired image data, color point cloud data can be obtained.
[0003] This technology can quickly acquire massive amounts of high-precision three-dimensional point cloud data. It is an efficient data collection method that has been widely used in various measurement fields. It can be used for mobile data collection in a variety of ways, such as airborne, vehicle-mounted, ship-mounted, and backpack-mounted. The airborne and vehicle-mounted measurement platforms are relatively stable, with basically no low-frequency jitter; the backpack method is more stable; and the ship-mounted method is affected by the low-frequency jitter of the ship's engine, and there are vibrations that cannot be eliminated and cannot be corrected by the attitude measurement equipment, resulting in a large amount of jitter in the point cloud data that cannot be repaired by conventional post-processing methods, resulting in invalid data acquisition and the need for re-measurement. However, during re-measurement, the jitter of the ship is always present and difficult to overcome, which in turn leads to the inability to complete the measurement task. Summary of the invention
[0004] The purpose of the present invention is to provide an image-based shipborne point cloud correction method, which is used to solve the problem that when the laser is affected by the jitter of the ship engine during shipborne three-dimensional laser scanning measurement, the point cloud data jitters and cannot be corrected by posture data.
[0005] In order to achieve the above object, the present invention provides the following technical solution: a shipborne point cloud correction method based on image, comprising the following steps:
[0006] S01. Processing the 3D laser scanning data and saving it in a point cloud format, wherein the point cloud format includes data in las format, PTS format or XYZ format;
[0007] S02, opening the image data synchronously acquired during the three-dimensional point cloud acquisition and its corresponding positioning data and posture data to generate three-dimensional point cloud data;
[0008] S03, performing data processing on the image data according to a predetermined processing strategy to generate an image set A;
[0009] S04, preprocessing the three-dimensional point cloud data to obtain mapping data in image format to generate an image set B;
[0010] S05, performing matching mechanism processing on the image set A and the image set B to determine whether there is an abnormal area in the three-dimensional point cloud data, and arranging the three-dimensional point cloud data with the abnormal area into an abnormal point cloud set;
[0011] S06. Processing the abnormal point cloud set based on an interpolation algorithm to obtain corrected data;
[0012] S07, re-execute step S04 to step S04 with the corrected data until no abnormal data occurs, and then store the data.
[0013] Preferably, the processing of the image data by the predetermined processing strategy in step S03 includes the following steps:
[0014] S31, loading image data and positioning data and posture data corresponding to each frame of the original image under the image data;
[0015] S32, identifying the format of the original image and actively changing it to PNG format;
[0016] S33, segmenting the image according to the characteristics of shipborne photogrammetry:
[0017] S33a, identifying water bodies, sky, vegetation and artificial buildings in the image through existing algorithms;
[0018] S33b, set the Alpha channel data of the water and sky in the PNG image to 0 to achieve transparency;
[0019] S33c. For non-artificial structures such as vegetation, set the Alpha channel value to 100;
[0020] S33d. For dams, sluice gates and various artificial buildings, the Alpha channel value is set to 255, achieving a completely opaque state;
[0021] S34, the segmented images are combined with the positioning data and the posture data for two-dimensional stitching, and are stored in slices according to a certain degree of overlap, and are converted into grayscale images to produce an image set A.
[0022] Preferably, the three-dimensional point cloud data is preprocessed in step S04, comprising the following steps:
[0023] S41, load the positioning data of the original collected image, calculate the center point of the three-dimensional point cloud data to generate the image according to the positioning data, and 重叠度 To generate the range of images;
[0024] S41, calculate the intermediate image generated by the positioning data of three consecutive images, then the positioning data is (x n-1 ,y n-1 , z n-1 ), (x n ,y n , z n ), (x n+1 ,y n+1 , z n+1 ), then the point cloud data range of the generated image is
[0025] S42, based on the point cloud data range, select the corresponding point cloud, and convert the point cloud data within the known range into image coordinate system data, which is converted into:
[0026]
[0027] Among them, h 图像 Represents the grayscale data of the image;
[0028] S43, the gray value is 0 to 255, and the image (x 图像 ,y 图像 ,h 图像 ), map the data of x and y to 0 to the corresponding maximum value, map the data of h to 0-255, and find the maximum value of h max and the minimum value h min ,but:
[0029]
[0030] Preferably, the matching mechanism processing of the image set A and the image set B in step S05 includes:
[0031] S51, using the geographic location coordinates as initial conditions, matching the images of the image set A and the image set B using a scale-invariant feature conversion algorithm based on one of the oriented histogram descriptors, and obtaining image C in the image set A and image D in the image set B respectively;
[0032] S52, resampling image D using cubic B-spline interpolation according to the length and width of image C to obtain image E,
[0033] S53, then use the cubic B-spline interpolation algorithm to use the data of 4×4 pixels of image D to calculate the gray value of the target pixel point (x′, y′) of image E:
[0034]
[0035] W(i,j)=w(d i )×w(d j )
[0036]
[0037] d i =p(i,j).xx′;
[0038] d j =p(i,j)·yy′;
[0039] Make the size and resolution of the resampled image E consistent with that of image C.
[0040] Preferably, judging whether there is an abnormal area in the three-dimensional point cloud data in step S05 comprises the following steps:
[0041] S54, subtracting the grayscale of corresponding pixel values of image C and image E to obtain image F, wherein image F represents the grayscale difference between image C and image E;
[0042] S55, reading the minimum grayscale value of image F and subtracting the value from image F to obtain image G, so as to eliminate the systematic grayscale difference between image C and image E;
[0043] S56a, if there is no abnormal data of jitter in the laser point cloud, the gray value of the image G should be around 0, and the whole image appears black;
[0044] S56b, if there is an area of jittery abnormal data in the laser point cloud, the gray value is large and the whole area shows a bright feature, the abnormal data area is extracted by checking whether the gray value is greater than a threshold given by the user;
[0045] S57, projecting the abnormal area extracted in step S56b into image C, and using Hough transform to detect whether there is a straight line:
[0046] If there is a straight line, extract the line segment directly;
[0047] If it does not exist, the abnormal area is deleted and the processing ends.
[0048] Preferably, the step of processing the abnormal point cloud set based on the interpolation algorithm in step S06 includes:
[0049] S61, reading image C and its geographical location, abnormal areas and characteristic lines;
[0050] S62, for the abnormal area, calculate the corresponding area of the image D by using the cubic B-spline interpolation algorithm, and calculate the corresponding line of the characteristic line in the image D;
[0051] S63. Convert the calculated data from the image coordinate system to the point cloud coordinate system:
[0052]
[0053] The data are stored in (x 异常 ,y 异常 ,z 异常 ) and (x 特征 ,y 特征 ,z 特征 ) collection.
[0054] Preferably, the correction data obtained in step S06 uses the data of the characteristic line as a constraint condition to correct the point cloud posture, and because the moving laser point cloud is generally performed by line scanning, the measurement equation for each point can be expressed as:
[0055]
[0056] The abnormal data has an error in the ω angle in the elevation direction, so:
[0057]
[0058] Use this correction value to recalculate the coordinates of the outlier point and get (x 修正 ,y 修正 ,z 修正 )data.
[0059] In the above technical scheme, the present invention provides an image-based shipborne point cloud correction method, which has the following beneficial effects: using laser point cloud data to generate grayscale images, and performing subtraction with image data collected synchronously during the measurement process, automatically identifying point cloud data with abnormal jitter; using image data collected synchronously during the measurement process to extract feature lines as constraint conditions for point cloud data repair. By adding constraints to images, the problem of point cloud data caused by various vibrations such as ship engines that cannot be compensated by attitude sensors is automatically repaired, solving the vibration problem of shipborne measurement. BRIEF DESCRIPTION OF THE DRAWINGS
[0060] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.
[0061] Figure 1 A flowchart provided for an embodiment of the present invention;
[0062] Figure 2 A schematic diagram of photo overlap provided by an embodiment of the present invention;
[0063] Figure 3A schematic diagram of an image and point cloud coordinate system provided by an embodiment of the present invention;
[0064] Figure 4 An interpolation schematic diagram provided for an embodiment of the present invention;
[0065] Figure 5 A schematic diagram of laser point cloud measurement provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0066] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0067] Embodiment 1
[0068] like Figure 1 As shown, a shipborne point cloud correction method based on imagery comprises the following steps:
[0069] S01. Process the 3D laser scanning data and save it in a point cloud format. The point cloud format includes data in las format, PTS format or XYZ format;
[0070] S02, opening the image data synchronously acquired during the three-dimensional point cloud acquisition and its corresponding positioning data and posture data to generate three-dimensional point cloud data;
[0071] S03, performing data processing on the image data according to a predetermined processing strategy to generate an image set A;
[0072] S04, preprocessing the three-dimensional point cloud data to obtain mapping data in image format to generate an image set B;
[0073] S05, performing matching mechanism processing on the image set A and the image set B to determine whether there is an abnormal area in the three-dimensional point cloud data, and arranging the three-dimensional point cloud data with the abnormal area into an abnormal point cloud set;
[0074] S06. Processing the abnormal point cloud set based on an interpolation algorithm to obtain corrected data;
[0075] S07, correct the data and re-execute step S04 to step S04 until no abnormal data occurs, then store the data.
[0076] In the above technology, the grayscale image is generated by using the laser point cloud data, and the difference is calculated with the image data collected synchronously during the measurement process to automatically identify the point cloud data with abnormal jitter;
[0077] And, the feature lines are extracted using the image data collected synchronously during the measurement process as constraints for point cloud data restoration.
[0078] This makes it possible to automatically repair the point cloud data caused by various vibrations such as ship engines by adding constraints through images, which cannot be compensated by the attitude sensor, thus solving the vibration problem of ship-borne measurements.
[0079] Embodiment 2
[0080] The processing of the image data by the predetermined processing strategy in step S03 in the first embodiment includes the following steps:
[0081] S31, loading the image data and the positioning data and posture data corresponding to each frame of the original image under the image data; (that is, when acquiring the image data, the image data is generated in the form of a picture and a frame, thereby forming an original image, and the original image corresponds to the time period, and the positioning data and posture data of the corresponding time period are acquired)
[0082] S32, identifying the format of the original image (whether it is PNG format), and actively modifying it to PNG format;
[0083] S33. Segment the image according to the characteristics of shipborne photogrammetry:
[0084] S33a, identifying water bodies, sky, vegetation and artificial buildings in the image through existing algorithms;
[0085] S33b, set the Alpha channel data of the water and sky in the PNG image to 0 to achieve transparency;
[0086] S33c. For non-artificial structures such as vegetation, set the Alpha channel value to 100;
[0087] S33d. For dams, sluice gates and various artificial buildings, the Alpha channel value is set to 255, achieving a completely opaque state;
[0088] S34, the segmented images are combined with the positioning data and the posture data for two-dimensional stitching, and are stored in slices according to a certain degree of overlap, and are converted into grayscale images to produce an image set A.
[0089] Embodiment 3
[0090] The preprocessing of the three-dimensional point cloud data in step S04 in the first embodiment, that is, projecting the three-dimensional point cloud data in a plane direction to generate a two-dimensional image, includes the following steps:
[0091] S41, load the positioning data of the original collected image, calculate the center point of the three-dimensional point cloud data to generate the image according to the positioning data, and 重叠度 To generate the range of images;
[0092] S41, calculate the intermediate image generated by the positioning data of three consecutive images, then the positioning data is (x n-1 ,y n-1 , z n-1 ), (x n ,y n , z n ), (x n+1 ,y n+1 , z n+1 ), then the point cloud data range of the generated image is
[0093] S42, based on the point cloud data range, select the corresponding point cloud, and convert the point cloud data within the known range into image coordinate system data, which is converted into:
[0094]
[0095] Among them, h 图像 Represents the grayscale data of the image;
[0096] S43, the gray value is 0 to 255, and the image (x 图像 ,y 图像 ,h 图像 ), map the data of x and y to 0 to the corresponding maximum value, map the data of h to 0-255, and find the maximum value of h max and the minimum value h min ,but:
[0097]
[0098] Specific, combined Figure 1 Taking the calculation of generating the intermediate image through the positioning data of three images as an example, the positioning data are (x1, y1, z1), (x2, y2, z2) and (x3, y3, z3), respectively. The point cloud data range used to generate the image is Then the corresponding point cloud is selected in the calculated range, and the point cloud data within the known range is converted into image coordinate system data, such as Figure 2 As shown, the corresponding conversion is:
[0099]
[0100] In the above formula, h 图像 Represents the grayscale data of the image;
[0101] Combination Figure 3 , since there is no negative value in the image, but there may be negative values in the laser point cloud data, and the gray value ranges from 0 to 255, the image (x 图像 ,y 图像 ,h 图像 ), map the data of x and y to 0 to the corresponding maximum value, and map the data of h to 0~255. Taking the data mapping of h as an example, first find its maximum and minimum values, which are h max and h min Then use the following formula to calculate:
[0102] Embodiment 4
[0103] The processing of the matching mechanism for the image set A and the image set B in step S05 recorded in the first embodiment includes:
[0104] S51, using the geographic location coordinates as initial conditions, matching the images of the image set A and the image set B using a scale-invariant feature transformation (SIFT) algorithm based on one of the HOG descriptors, and obtaining image C in the image set A and image D in the image set B respectively;
[0105] S52, resampling image D using cubic B-spline interpolation according to the length and width of image C to obtain image E,
[0106] S53, then use the cubic B-spline interpolation algorithm to use the data of 4×4 pixels of image D to calculate the gray value of the target pixel point (x′, y′) of image E:
[0107]
[0108] W(i,j)=w(d i )×w(d j )
[0109]
[0110] d i =p(i,j)·xx′;
[0111] d j =p(i,j).yy′;
[0112] Make the size and resolution of the resampled image E consistent with that of image C.
[0113] Further, combined with Figure 4 It can be seen that judging whether there is an abnormal area in the three-dimensional point cloud data includes the following steps:
[0114] S54, subtracting the grayscale of corresponding pixel values of image C and image E to obtain image F, wherein image F represents the grayscale difference between image C and image E;
[0115] S55, reading the minimum grayscale value of image F and subtracting the value from image F to obtain image G, so as to eliminate the systematic grayscale difference between image C and image E;
[0116] S56a, if there is no abnormal data of jitter in the laser point cloud, the gray value of the image G should be around 0, and the whole image appears black;
[0117] S56b, if there is an area of jittery abnormal data in the laser point cloud, the gray value is large and the whole area shows a bright feature, the abnormal data area is extracted by checking whether the gray value is greater than a threshold given by the user;
[0118] S57, projecting the abnormal area extracted in step S56b into image C, and using Hough transform to detect whether there is a straight line:
[0119] If there is a straight line, extract the line segment directly;
[0120] If it does not exist, the abnormal area is deleted and the processing ends.
[0121] Embodiment 5
[0122] The step of processing the abnormal point cloud set based on the interpolation algorithm in step S06 recorded in the first embodiment includes:
[0123] S61, reading image C and its geographical location, abnormal areas and characteristic lines;
[0124] S62, for the abnormal area, calculate the corresponding area of the image D by using the cubic B-spline interpolation algorithm, and calculate the corresponding line of the characteristic line in the image D;
[0125] S63. Convert the calculated data from the image coordinate system to the point cloud coordinate system:
[0126]
[0127] The data are stored in (x 异常 ,y 异常 ,z 异常 ) and (x 特征 ,y 特征 ,z 特征 ) collection.
[0128] Furthermore, the feature line data is used as a constraint to correct the point cloud posture, and the mobile laser point cloud is generally carried out by line scanning (in Figure 5 As shown), the measurement equation for each point can be expressed as:
[0129]
[0130] The abnormal data has an error in the ω angle in the elevation direction, so:
[0131]
[0132] Use this correction value to recalculate the coordinates of the outlier point and get (x 修正 ,y 修正 ,z 修正 )data.
[0133] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0134] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0135] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0136] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0137] The present invention uses specific embodiments to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
[0138] The embodiments of the present application also provide a specific implementation of an electronic device capable of implementing all steps of the method in the above embodiments, and the electronic device specifically includes the following contents:
[0139] Processor, memory, communications interface and bus;
[0140] Wherein, the processor, memory, and communication interface communicate with each other via the bus;
[0141] The processor is used to call the computer program in the memory, and when the processor executes the computer program, all the steps in the method in the above embodiment are implemented.
[0142] The embodiments of the present application also provide a computer-readable storage medium capable of implementing all the steps of the method in the above embodiments, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, all the steps of the method in the above embodiments are implemented.
[0143] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the hardware + program embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. Although the embodiment of this specification provides the method operation steps described in the embodiment or flow chart, more or less operation steps can be included based on conventional or non-creative means. The order of steps listed in the embodiment is only one way of executing the order of many steps, and does not represent the only execution order. When the device or terminal product in practice is executed, it can be executed in sequence or in parallel according to the method shown in the embodiment or the accompanying drawings (for example, a parallel processor or a multi-threaded processing environment, or even a distributed data processing environment). The term "include", "include" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, product or device including a series of elements includes not only those elements, but also includes other elements that are not explicitly listed, or also includes elements inherent to such a process, method, product or device. In the absence of more restrictions, it is not excluded that there are other identical or equivalent elements in the process, method, product or device including the elements. For the convenience of description, the above device is described by dividing it into various modules according to its functions. Of course, when implementing the embodiments of this specification, the functions of each module can be implemented in the same one or more software and / or hardware, or the module implementing the same function can be implemented by a combination of multiple sub-modules or sub-units. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The present invention is described with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the embodiments of the present invention. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the process Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0144] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems or computer program products. Therefore, the embodiments of this specification may be in the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the embodiments of this specification may be in the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes. Each embodiment in this specification is described in a progressive manner, and the same and similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts refer to the partial description of the method embodiment. In the description of this specification, the description of the reference term "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the embodiment of this specification.
[0145] In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradicting each other. The above is only an embodiment of the embodiment of this specification and is not intended to limit the embodiment of this specification. For those skilled in the art, the embodiment of this specification may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiment of this specification shall be included in the scope of the claims of the embodiment of this specification.
Claims
1. A shipborne point cloud correction method based on image, characterized in that: The following steps are involved: S01. Processing the 3D laser scanning data and saving it in a point cloud format, wherein the point cloud format includes data in LAS format, PTS format or XYZ format; S02. Open the image data and its corresponding positioning data and posture data acquired synchronously during the three-dimensional point cloud acquisition to generate three-dimensional point cloud data; S03, performing data processing on the image data according to a predetermined processing strategy to generate an image set A; S04. Preprocess the three-dimensional point cloud data to obtain mapping data in image format to generate an image set B; S05, performing matching mechanism processing on the image set A and the image set B to determine whether the three-dimensional point cloud data has an abnormal area, and organizing the three-dimensional point cloud data with the abnormal area into an abnormal point cloud set; S06. Processing the abnormal point cloud set based on an interpolation algorithm to obtain corrected data; S07: re-execute step S04 to step S05 for the corrected data until no abnormal data occurs, and then store the data.
2. The image-based shipborne point cloud correction method according to claim 1, characterized in that: The processing of the image data by the established processing strategy in step S03 includes the following steps: S31, loading image data and positioning data and posture data corresponding to each frame of the original image under the image data; S32, identifying the format of the original image and actively changing it to PNG format; S33. Segmenting the image according to the characteristics of shipborne photogrammetry: S33a, identifying water bodies, sky, vegetation and artificial buildings in the image using existing algorithms; S33b, set the Alpha channel data of the water and sky in the PNG image to 0 to achieve transparency; S33c. For non-artificial structures such as vegetation, set the Alpha channel value to 100; S33d. For dams, sluice gates, and various artificial buildings, the Alpha channel value is set to 255, achieving a completely opaque state. S34. The segmented images are combined with the positioning data and the posture data for two-dimensional splicing, and are stored in slices according to a certain degree of overlap, and converted into grayscale images to produce an image set A.
3. The image-based shipborne point cloud correction method according to claim 1, characterized in that: The three-dimensional point cloud data is pre-processed in step S04, including the following steps: S41, load the positioning data of the original captured image, calculate the center point of the 3D point cloud data to generate the image based on the positioning data, and calculate the overlap X set by the user. 重叠度 To generate the range of images; S41, calculate the intermediate image generated by the positioning data of three consecutive images, and the positioning data is (x n-1 ,y n-1 , z n-1 ), (x n ,y n , z n ), (x n+1 ,y n+1 , z n+1 ), then the point cloud data range of the generated image is S42. Select the corresponding point cloud based on the point cloud data range, and convert the point cloud data within the known range into image coordinate system data, which is converted into: Among them, h 图像 Represents the grayscale data of the image; S43, the gray value is 0 to 255, and the image (x 图像 ,y 图像 ,h 图像 ), map the data of x and y to 0 to the corresponding maximum value, map the data of h to 0~255, and find the maximum value of h max and the minimum value h min ,but:
4. The image-based shipborne point cloud correction method according to claim 1, characterized in that: The matching mechanism processing of the image set A and the image set B in step S05 includes: S51, using the geographic location coordinates as initial conditions, matching the images of image set A and image set B using a scale-invariant feature transformation algorithm based on one of the oriented histogram descriptors, and obtaining image C in image set A and image D in image set B respectively; S52, resample image D using cubic B-spline interpolation according to the length and width of image C to obtain image E, S53. Calculate the grayscale value of the target pixel (x′, y′) in image E using the data of 4×4 pixels in image D through a cubic B-spline interpolation algorithm: W(i,j)=w(d i )×w(d j ); d i =p(i,j).x-x′; d j =p(i,j)·y-y′; Make the size and resolution of the resampled image E consistent with that of image C.
5. The image-based shipborne point cloud correction method according to claim 4, characterized in that: Determining whether there is an abnormal area in the three-dimensional point cloud data in step S05 includes the following steps: S54, subtracting the grayscale of corresponding pixel values of image C and image E to obtain image F, where image F represents the grayscale difference between image C and image E; S55, reading the minimum grayscale value of image F and subtracting the minimum grayscale value from image F to obtain image G, so as to eliminate the systematic grayscale difference between images C and E; S56a, if there is no abnormal jitter data in the laser point cloud, the grayscale value of image G should be around 0, and the whole image should appear black; S56b. If there is an area of jittery abnormal data in the laser point cloud, the grayscale value is large and the overall feature is highlighted, the abnormal data area is extracted by checking whether the grayscale value is greater than a user-specified threshold; S57: Project the abnormal area extracted in step S56b onto image C, and use Hough transform to detect whether there is a straight line: If a straight line exists, the line segment is directly extracted; If it does not exist, the abnormal area is deleted and the processing ends.
6. The image-based shipborne point cloud correction method according to claim 1, characterized in that: The step of processing the abnormal point cloud set based on the interpolation algorithm in step S06 includes: S61, read image C and its geographical location, abnormal areas and characteristic lines; S62. For the abnormal area, calculate the corresponding area of image D using a cubic B-spline interpolation algorithm, and calculate the corresponding line of the characteristic line in image D; S63. Convert the calculated data from the image coordinate system to the point cloud coordinate system: The data are stored in (x 异常 ,y 异常 ,z 异常 ) and (x 特征 ,y 特征 ,z 特征 ) collection.
7. The image-based shipborne point cloud correction method according to claim 1, characterized in that: The correction data obtained in step S06 uses the characteristic line data as a constraint condition to correct the point cloud posture. Since the moving laser point cloud is generally performed by line scanning, the measurement equation for each point can be expressed as: The abnormal data has an error in the ω angle in the elevation direction, so: Use the correction value to recalculate the coordinates of the abnormal point and get (x 修正 ,y 修正 ,z 修正 )data.
8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the steps of the image-based shipborne point cloud correction method according to any one of claims 1 to 7 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the image-based shipborne point cloud correction method according to any one of claims 1 to 7 are implemented.
Citation Information
Cited By
Curcumin extraction and purification method based on aminophosphonic acid complexing agent
CN122036481A
