Sea island reef terrain and water depth integrated surveying and mapping method, system, equipment and medium
By integrating multiple surveying and mapping equipment on the aircraft and fusion data using Kalman filtering and SLAM algorithms, an integrated topographic map of sea, island, reef terrain is generated, which solves the problem of insufficient accuracy and coverage in shallow water areas by traditional surveying and mapping methods, and achieves high efficiency. Accurate terrain and water depth mapping of islands and reefs.
Patent Information
- Application Number
- CN202410988935.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2024-11-08
AI Technical Summary
Traditional sea island and reef terrain and water depth mapping methods are difficult to ensure data accuracy and coverage under shallow water areas and complex terrain conditions. In addition, manual measurement and submersible measurement are inefficient and limited coverage, making it difficult to meet the needs of large-scale surveying and mapping.
Data is collected through GPS/IMU positioning device, lidar device, green wave laser device and optical imaging device integrated on the aircraft, and data fusion and feature extraction are used to generate sea, island, reef, terrain, water depth integrated with sea, island, reef, and reef terrain To transform topographic map.
It significantly improves the accuracy, efficiency and comprehensiveness of island and reef terrain and water depth mapping, solves the data accuracy and coverage problems of traditional ship-borne surveying and mapping systems in shallow water areas and complex terrain, and realizes unmanned island surveying.
Smart Images

Figure CN118913285A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of marine surveying and mapping technology, and in particular to an integrated surveying and mapping method, system, equipment and medium for island and reef topography and water depth. Background Art
[0002] With the development and utilization of global marine resources and the development of marine transportation, marine surveying and mapping technology is particularly important. Especially in some islands, reefs and shallow waters, traditional island and reef topography and water depth mapping mainly rely on traditional surveying ships and equipment. Surveying ships are equipped with multi-beam sonar, single-beam sonar, side-scan sonar and other equipment to obtain underwater topographic data. These methods work well in deep waters, but it is often difficult to ensure the accuracy and coverage of data in shallow waters and complex terrain conditions; in addition, although manual measurement and diving measurement can provide high-precision data, they are difficult to meet the needs of large-scale surveying and mapping due to cumbersome operations, low efficiency and limited coverage. Due to the problems of low efficiency, insufficient coverage and difficult operation of traditional ship-borne surveying and mapping methods, there is an urgent need for an efficient and accurate surveying and mapping method to generate island and reef topography and water depth maps. Summary of the invention
[0003] The embodiment of the present invention provides an integrated surveying and mapping method, system, device and medium for island and reef topography and water depth to solve the problems existing in the related technologies. The technical solution is as follows:
[0004] In a first aspect, an embodiment of the present invention provides a method for integrated surveying and mapping of island and reef topography and water depth, comprising:
[0005] Acquire the data collected by the aircraft when passing through the island and reef terrain area, including positioning data, three-dimensional point cloud data corresponding to the island and reef area, bathymetric echo data corresponding to the seawater area, and optical image data corresponding to the island and reef and surrounding areas;
[0006] The collected data is fused by using an extended Kalman filter algorithm to obtain fused data; the fused data is feature extracted to obtain feature point data, which includes point cloud feature points and image feature points;
[0007] The currently observed feature point data is matched with the previously observed feature points to obtain feature pairs, the position and posture information of the aircraft is estimated based on the feature pairs, and the map information is updated based on the position and posture information to generate an island and reef terrain map.
[0008] In one embodiment, the collected data is synchronously collected by airborne equipment integrated on the aircraft, and the airborne equipment includes a GPS / IMU positioning device, a laser radar device, a green wave laser device, and an optical imaging device.
[0009] In one embodiment, the pre-processed collected data is fused by an extended Kalman filter algorithm to obtain fused data, including:
[0010] Based on the state transfer function, the predicted state vector and the predicted covariance matrix corresponding to the current state are calculated according to the state vector at the previous moment and the positioning data;
[0011] Based on the observation function, the state estimation is updated according to the three-dimensional point cloud data and the bathymetric echo data to obtain the observation matrix and the observation noise covariance matrix;
[0012] The Kalman gain is calculated based on the prediction covariance matrix, the observation matrix and the observation noise covariance matrix. The prediction state is adjusted by the Kalman gain and the residual to obtain the fusion data corresponding to the current state estimate.
[0013] In one implementation, feature extraction is performed on the fused data, including:
[0014] Extract feature points of optical image data based on SIFT algorithm to obtain image feature points;
[0015] Feature extraction is performed on three-dimensional point cloud data to obtain point cloud feature points.
[0016] In one implementation, matching currently observed feature point data with previously observed feature points includes:
[0017] The ICP algorithm is used to align the feature points of the point clouds collected in different time periods to obtain the feature pairs between the source point cloud and the target point cloud.
[0018] In one embodiment, estimating the position and posture information of the aircraft according to the feature pair includes:
[0019] The cost function is defined based on the feature pairs, and a nonlinear optimization algorithm is used to minimize the cost function to obtain the optimal pose information.
[0020] In one embodiment, it further includes:
[0021] Preprocessing the three-dimensional point cloud data through a statistical filter to obtain point cloud data;
[0022] Calculate the water depth value according to the bathymetric echo data to obtain the water depth data;
[0023] Performing posture correction on the optical image data using the positioning data to obtain image data;
[0024] Based on the extended Kalman filter algorithm, point cloud data, water depth data and image data are fused to obtain fused data.
[0025] In a second aspect, an embodiment of the present invention provides an island and reef topography and water depth integrated surveying and mapping system, which executes an island and reef topography and water depth integrated surveying and mapping method as described above.
[0026] In a third aspect, an embodiment of the present invention provides an electronic device, the device comprising: a memory and a processor. The memory and the processor communicate with each other through an internal connection path, the memory is used to store instructions, the processor is used to execute the instructions stored in the memory, and when the processor executes the instructions stored in the memory, the processor executes the method in any one of the above-mentioned embodiments.
[0027] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the method in any one of the above-mentioned embodiments is executed.
[0028] The advantages or beneficial effects of the above technical solution include at least:
[0029] The present invention integrates various airborne equipment on the aircraft. When flying according to the specified route, the aircraft simultaneously collects positioning data, three-dimensional point cloud data corresponding to the island and reef area, bathymetric echo data corresponding to the sea water area, and optical image data corresponding to the island and reef and surrounding areas, thereby solving the technical problem that traditional ship-borne surveying and mapping systems are difficult to achieve unmanned island measurement. The two-dimensional data and the three-dimensional point cloud are integrated and optimized by the SLAM algorithm to finally generate a three-dimensional integrated topographic map of the island and reef terrain and water depth, which significantly improves the accuracy, efficiency and comprehensiveness of the island and reef terrain and water depth surveying and mapping.
[0030] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present invention will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the multiple drawings represent the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed in the present invention and should not be regarded as limiting the scope of the present invention.
[0032] Figure 1 It is a schematic diagram of the process of the integrated surveying and mapping method of island and reef topography and water depth of the present invention;
[0033] Figure 2 This is a structural diagram of the integrated surveying and mapping system for island and reef topography and water depth of the present invention;
[0034] Figure 3 The structure block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0035] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present invention. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.
[0036] The airborne integrated surveying method of island and reef topography and water depth belongs to the category of marine surveying technology. With the development and utilization of global marine resources and the development demand of marine transportation, marine surveying technology is particularly important. Especially in some islands, reefs and shallow waters, traditional shipborne surveying methods have problems such as low efficiency, insufficient coverage and difficulty in operation. In the past, surveying and mapping island and reef topography and water depth mainly relied on traditional surveying ships and equipment. Surveying ships obtain underwater topographic data by carrying multi-beam sonar, single-beam sonar, side-scan sonar and other equipment. These methods work better in deep waters, but it is often difficult to ensure the accuracy and coverage of data in shallow waters and complex terrain conditions. In addition, although manual measurement and diving measurement can provide high-precision data, they are difficult to meet the needs of large-scale surveying and mapping due to cumbersome operation, low efficiency and limited coverage.
[0037] In order to solve the above problems, this embodiment provides an integrated surveying and mapping method for island reef topography and water depth, which can achieve high-precision measurement of island reef topography and water depth, such as Figure 1 As shown, the method specifically comprises the following steps:
[0038] Step S1: Acquire the collected data collected by the aircraft passing through the island reef terrain area, the collected data including positioning data, three-dimensional point cloud data corresponding to the island reef area, bathymetric echo data corresponding to the seawater area, and optical image data corresponding to the island reef and surrounding areas;
[0039] Step S2: fusing the collected data by using an extended Kalman filter algorithm to obtain fused data; extracting features from the fused data to obtain feature point data, the feature point data including point cloud feature points and image feature points;
[0040] Step S3: Match the currently observed feature point data with the previously observed feature points to obtain feature pairs, estimate the position and posture information of the aircraft based on the feature pairs, and update the map information based on the position and posture information to generate an island and reef terrain map.
[0041] refer to Figure 2As shown, the aircraft in this embodiment can be a manned aircraft or an unmanned aerial vehicle. The aircraft is a carrier for all airborne surveying and mapping equipment. A variety of airborne equipment is integrated on the aircraft, including a GPS / IMU positioning device, a lidar device, a green wave laser device, and an optical imaging device.
[0042] Among them, the GPS / IMU positioning device includes a GPS receiver and an inertial measurement unit (IMU), which can provide accurate positioning data. The positioning data includes position information and attitude information to ensure the accuracy of the surveying and mapping data. The lidar device includes a laser transmitter, a receiver and a scanning mechanism, which is mainly used to obtain high-precision three-dimensional point cloud data of island and reef terrain. The green wave laser device, including a green wave laser transmitter, a receiver and a signal processing unit, is mainly used to measure the bathymetric echo data in shallow waters, and calculate the water depth data using the bathymetric echo data. The optical imaging device includes a high-resolution camera and an image processing unit, which is used to obtain high-resolution optical imaging data of islands and reefs and surrounding areas.
[0043] The aircraft is also equipped with an integrated data storage and data processing unit, which processes and fuses the collected 3D point cloud data, positioning data, water depth data and optical image data in real time, and stores the collected and processed data. The wireless communication module on the aircraft transmits the data to the ground station in real time. After receiving the data, the ground station conducts further data analysis and processing to generate surveying and mapping results. The surveying and mapping results are used to draw topographic maps and water depth maps of islands and reefs, providing support for marine development and management.
[0044] In addition, the aircraft can also only carry out data collection work, and transmit the collected data to the ground station in real time. The server of the ground station will analyze and process the collected data and generate surveying and mapping results.
[0045] Before the surveying and mapping mission begins, the airborne lidar device, green wave laser device, optical imaging device and GPS / IMU positioning device are calibrated and checked to ensure the normal operation of the equipment.
[0046] During the data collection phase, the aircraft flies on a predetermined route and controls the laser radar device, green wave laser device and optical imaging device to synchronously collect terrain, water depth and image data. Specifically:
[0047] The laser transmitter of the airborne laser radar device emits a laser beam, which scans the island reef area. The laser beam is received by the receiver after encountering the terrain reflection. The receiver transmits the reflected signal to the data processing unit for 3D point cloud data processing. The laser radar device obtains the position information through the GPS / IMU positioning device, and corrects the geographic coordinates of the 3D point cloud data according to the position information, that is, converts the 3D point cloud data collected by the laser radar from the sensor coordinate system to the airborne platform coordinate system. Assume that the 3D point cloud data is PL , the transformation matrix from sensor to platform is T S→P , then the three-dimensional point cloud data is expressed in the platform coordinate system as:
[0048] P P =T S→P ·P L
[0049] 3D point cloud data processing also includes time synchronization and filtering. Time synchronization is to synchronize 3D point cloud data and IMU data based on timestamps. Filtering uses an outlier filtering algorithm to remove noise data. For example, a statistical filter is used to process 3D point cloud data. The formula is as follows:
[0050]
[0051] Among them, p i is a point in the point cloud, μ is the mean of all points, σ is the standard deviation, and k is the user-defined threshold.
[0052] The aircraft uses a green wave laser device to emit a green wave laser. The laser penetrates the water and is reflected by the seabed. The reflected signal is received by the green wave laser receiver. The receiver transmits the signal to the signal processing unit, and the water depth data is calculated based on the laser depth echo signal. Assuming that the laser propagation speed is c, the water depth measurement formula is:
[0053]
[0054] Where t is the time difference from laser emission to reception.
[0055] The green wave laser device obtains position information through the GPS / IMU positioning device and corrects the geographic coordinates of the water depth data. The correction method is the same as the coordinate conversion method of the three-dimensional unit data, which will not be repeated here.
[0056] The aircraft uses the high-resolution camera of the optical imaging device to capture optical images of the islands, reefs and surrounding areas, and uses the image processing unit to perform distortion correction and geometric alignment on the optical image data, and uses IMU data to perform attitude correction on the image to ensure accurate alignment of the image with the terrain data.
[0057] Distortion correction is mainly used to correct image distortion caused by the optical characteristics of the optical lens. This is mainly used to correct the phenomenon of curved lines near the center of the image:
[0058] x corr =x+(xx c )(k1r 2 +k2r 4 +k3r 6 )
[0059] y corr =y+(yy c )(k1r 2 +k2r 4 +k3r 6 )
[0060] Among them, x, y are the pixel coordinates of the original image, x corr ,y corr is the pixel coordinate after correction, k1, k2, k3 are radial distortion coefficients, p1, p2 are tangential distortion coefficients, r is the distance from the image center to the pixel, x c ,y c is the coordinate of the center point of the image.
[0061] Image geometric registration mainly uses the projective transformation method, that is, mapping an image to another image or geographic coordinate system based on several control points:
[0062]
[0063] Among them, C is the projection transformation matrix, which is a 3x3 matrix, x, y are the original image coordinates, and x′, y′ are the transformed image coordinates obtained by normalization.
[0064] The aircraft's GPS / IMU positioning device receives satellite signals through a GPS receiver, calculates the precise position of the carrier, measures the carrier's attitude changes through the IMU, and provides high-frequency position and attitude data; GPS and IMU data provide accurate position information and attitude information through a data fusion algorithm.
[0065] After the aircraft collects the above data, the optical image data is integrated with the three-dimensional point cloud data and water depth data to finally generate comprehensive surveying and mapping results.
[0066] The data fusion of this embodiment adopts the extended Kalman filter (EKF) algorithm, which is a filtering technology for nonlinear systems and extends the traditional Kalman filter by linearizing the nonlinear model. The EKF algorithm mainly includes two steps: a prediction step and an update step.
[0067] The prediction step includes: Step S21: pre-define the state vector x, including position, velocity and posture information;
[0068]
[0069] Among them, p is the position, v is the velocity, and q is the attitude quaternion.
[0070] Step S22: state prediction, that is, state prediction is performed based on the acceleration and angular velocity data in the IMU data. The state estimation formula at time k is:
[0071]
[0072] Among them, f is the state transfer function, u k is the IMU measurement value, x k-1 is the state estimate at time k-1.
[0073] Step S23: Covariance matrix prediction. In the prediction stage of each time step, the covariance matrix is used to estimate the uncertainty of the system state before the arrival of new observation data, as shown in the following formula:
[0074]
[0075] That is, using the partial derivative matrix F of the state variables in the state transfer equation k and the covariance matrix P of the previous moment k-1|k-1 , and the process noise covariance Q k To predict the covariance matrix P at the current moment k-1|k-1 ,in is the matrix F k The transpose of .
[0076] The updating step uses 3D point cloud data and water depth data to update observations, including:
[0077] Step S24: define the observation vector z, including three-dimensional point cloud data and water depth data.
[0078] Step S25: Establishing an observation model, that is, establishing an observation model h for the three-dimensional point cloud data L , describing how to get from the state vector x at time k k Predicted point cloud observation data; Establish observation model h for water depth data G , describing how to get from the state vector x k Predicted water depth observation data.
[0079] The observation model is usually expressed as:
[0080] z k =h(x k )+v k
[0081] Among them, z k is the observed data of the current time step, x k is the state estimate at time k (also called the state vector at time k), h is the observation function, and v k is the observation noise.
[0082] Step S26: Calculate the Jacobian matrix H, which is also called the observation matrix H, that is, calculate the Jacobian matrix H of the laser radar point cloud observation model L And calculate the Jacobian matrix H of the water depth data observation model G ; Jacobian matrix H L is the observation model h L The first-order partial derivative matrix about the state vector x, the Jacobian matrix H G is the observation model h G The matrix of first-order partial derivatives with respect to the state vector x.
[0083] Step S27: Observation update, for 3D point cloud data, calculate the residual y L and residual covariance S L ; For water depth data, calculate the residual y G and residual covariance S G , which can usually be calculated by the following formula:
[0084] S=HP k|k-1 H T +R
[0085] Where H is the Jacobian matrix, P k|k-1 is the prediction covariance matrix, and R is the observation noise covariance matrix.
[0086] Step S28: Since the 3D point cloud data and the water depth data are in the same coordinate system, the residuals and residual covariance errors of the two data are directly merged to form the fused residual y and residual covariance S. The fused residual covariance S is used to calculate the Kalman gain K, which determines the weight of the new observation data in the state update.
[0087]
[0088] Among them, K k is the Kalman gain, P k|k-1 is the prediction covariance matrix, H k is the observation matrix (which is the same concept as the Jacobian matrix of the aforementioned observation model), R k is the observation noise covariance matrix, For the matrix H k Transpose.
[0089] Step S29: Use the Kalman gain and residual to update the state vector x and the covariance matrix,
[0090]
[0091] P k|k =(IK k H k )k|k-1
[0092] in, is the updated state estimate, is the predicted state estimate, K k is the Kalman gain, z k is the observed data of the current time step, To predict the observed value, P k|k is the updated covariance matrix, H k is the observation matrix and I is the identity matrix.
[0093] In order to further improve the accuracy of terrain and water depth data, the simultaneous localization and mapping (SLAM) algorithm is used to optimize the above fused data.
[0094] SLAM front-end processing includes:
[0095] Feature extraction of fused data: extract feature points from 3D point cloud data and optical image data respectively to obtain point cloud feature points and image feature points; in 3D point cloud data of LiDAR, point cloud feature points usually refer to those points that can represent object boundaries, corners, surface changes or other geometric features. In optical images, image feature points are usually those points in the image with high texture changes, such as corners, edges or obvious texture patterns.
[0096] Among them, the scale-invariant feature transform SIFT (Scale-Invariant Feature Transform) algorithm can be used to extract image feature points:
[0097] D(x,y,σ)=(G(x,y,kσ)-G(x,y,σ))*L(x,y,σ)
[0098] Among them, D(x,y,σ) is the difference Gaussian function used to generate the scale space, G(x,y,σ) is the Gaussian blur function, L(x,y,σ) is the intensity of image x,y at scale σ, and k is a constant multiple between adjacent scales.
[0099] SLAM front-end processing also includes:
[0100] Feature matching is to match the currently observed feature point data with the previously observed feature points to estimate the change in the aircraft's posture. The iterative closest point (ICP) algorithm can be used to align the point cloud feature points collected at different time periods, match the point cloud feature points collected at different times, and obtain the feature pairs between the source point cloud and the target point cloud.
[0101] The ICP algorithm minimizes the point p in the source point cloud.i To the corresponding point q in the target point cloud i The distance is used to find the optimal rotation matrix R and translation vector t, and the corresponding formula is:
[0102]
[0103] Using matched feature point pairs to estimate the vehicle's pose can be done by solving a least squares problem or applying other geometric estimation methods.
[0104] SLAM front-end processing provides accurate initial estimates for the back-end optimization of the SLAM system, which is crucial for subsequent optimization and pose correction; through feature matching, the SLAM system can associate new observation data with existing maps to achieve data fusion and map updates; and good feature extraction and matching strategies can improve the robustness of the SLAM system to environmental changes, sensor noise and dynamic objects.
[0105] During the SLAM backend optimization process, the graph optimization steps are performed:
[0106] First, a graph-based SLAM optimization problem is constructed, and nodes and edges are defined; nodes represent the position and posture of the aircraft in different time periods, and edges represent the observation values of the onboard equipment on the aircraft, and the relationship between adjacent nodes observed by the onboard equipment.
[0107] Afterwards, the cost function is established and the node is represented as x i , represents the state (e.g., position and posture) at a specific time; the edge is represented by z ij , which means node x i and x j The observation value between ; the cost function is:
[0108]
[0109] in, represents the set of all constraints, Ω ij is the information matrix, which is used to weight different observation edges in the cost function. i ,x j ) According to x i ,x j The calculated predicted observations.
[0110] Using nonlinear optimization algorithms, Gauss-Newton or LM (Levenberg-Marquardt) algorithms are used to optimize the graph, minimize the cost function, and obtain the optimal position information. Both algorithms are iterative techniques for solving nonlinear least squares problems. Each time, the optimization variable (that is, the state of the node) is updated to reduce the value of the cost function. The general form of a nonlinear least squares problem is:
[0111]
[0112] Among them, r i (x) is the residual function, and x is the optimization variable.
[0113] Gauss-Newton algorithm:
[0114] J T JΔx=-J T r
[0115] Among them, J is the residual function r i (x) is the Jacobian matrix of x, and Δx is the increment of the optimization variable solved in each iteration.
[0116] The Gauss-Newton algorithm updates the increments of the optimization variables by solving the following linear system:
[0117] (J T J+λdiag(J T J))Δx=-J T r
[0118] Among them, r i (x) is the residual function, x is the optimization variable, and J is the residual function r i (x) is the Jacobian matrix of x, Δx is the increment of the optimization variable solved in each iteration, and λ is the tuning parameter in the Levenberg–Marquardt algorithm, which is used to control whether the algorithm is close to gradient descent or Gauss–Newton method.
[0119] The increment Δx obtained by solving the problem is used to update the current optimization variable (node state).
[0120] After each iteration, check whether the algorithm has converged to an acceptable solution. The convergence condition can be that the change in the increment is less than a certain threshold, or the decrease in the cost function is less than a certain threshold. Once the convergence condition is met, the algorithm terminates and the optimal location information and environment map are obtained.
[0121] The information provided by the feature pairs in this embodiment is used to optimize the estimation of nodes (i.e., postures) so that the difference between the predicted observations and the actual observations is minimized; through graph optimization, the constraints provided by all feature pairs are considered simultaneously to achieve a globally consistent solution, improving the accuracy and robustness of the overall SLAM system; once the algorithm converges, the optimized node states are obtained, which represent the precise position and posture of the aircraft at different time points. The feature pairs obtained by feature matching provide the necessary observation information for graph optimization, enabling the SLAM system to achieve more accurate and consistent state estimation and map construction through a global optimization process.
[0122] After SLAM algorithm optimization, the following data is obtained:
[0123] The optimized state vector contains the position and attitude information of the aircraft at different time steps;
[0124] Environmental feature points: stable feature points obtained through feature extraction and matching, such as corner points, edges or specific texture features;
[0125] Observation data: including point cloud data, water depth data, image data, etc. These data are fused with the state vector after the observation update step.
[0126] Combine the optimized state vector with the feature point data to ensure that all data are in the same coordinate system. Build a map based on the optimized feature points and pose information. For each feature point, use its corresponding pose information to transform the point from the sensor coordinate system to the global coordinate system. Use the transformed coordinates to draw the feature points on the map. These points can be connected into lines or surfaces to represent the structure of the environment. Use professional mapping software or tools, such as Python, MATLAB, GIS software, or custom visualization tools to create a visual representation of the map. Finally, generate an island and reef terrain map and output it in an appropriate format, which can be an image file, vector graphics, or a specific map data format.
[0127] The final island and reef topographic map is mainly generated by using the point cloud data collected by the lidar system (1550nm) when measuring the island topography to generate a terrain height model, namely a digital elevation model; and the green wave of the 532nm band emitted by the green wave laser device penetrates the water body to measure the underwater topography. These data are used to create underwater topographic maps or digital water depth models; the high-resolution images obtained from the airborne platform provide visual information of the ground, which helps to visually identify and classify terrain features, and finally generate a three-dimensional integrated topographic map of island and reef topography and water depth, which significantly improves the accuracy, efficiency and comprehensiveness of island and reef topography and water depth mapping.
[0128] An embodiment of the present invention provides an island and reef topography and water depth integrated surveying and mapping system, which executes an island and reef topography and water depth integrated surveying and mapping method as described above.
[0129] The functions of each module in the system of the embodiment of the present invention can be found in the corresponding description in the above method, which will not be repeated here.
[0130] An embodiment of the present invention further provides an electronic device, Figure 3 FIG. 2 shows a structural block diagram of an electronic device according to an embodiment of the present invention. Figure 3 As shown, the electronic device includes: a memory 100 and a processor 200, wherein the memory 100 stores a computer program that can be run on the processor 200. When the processor 200 executes the computer program, the island reef topography and water depth integrated mapping method in the above embodiment is implemented. The number of the memory 100 and the processor 200 can be one or more.
[0131] The electronic device also includes:
[0132] The communication interface 300 is used to communicate with external devices and perform data exchange transmission.
[0133] If the memory 100, the processor 200 and the communication interface 300 are implemented independently, the memory 100, the processor 200 and the communication interface 300 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0134] Optionally, in a specific implementation, if the memory 100, the processor 200 and the communication interface 300 are integrated on a chip, the memory 100, the processor 200 and the communication interface 300 can communicate with each other through an internal interface.
[0135] An embodiment of the present invention provides a computer-readable storage medium storing a computer program, which implements the method provided in the embodiment of the present invention when executed by a processor.
[0136] An embodiment of the present invention further provides a chip, which includes a processor for calling and executing instructions stored in the memory from the memory, so that a communication device equipped with the chip executes the method provided by the embodiment of the present invention.
[0137] An embodiment of the present invention also provides a chip, including: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method provided by the embodiment of the invention.
[0138] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor supporting the advanced RISC machines (ARM) architecture.
[0139] Further, optionally, the above-mentioned memory may include a read-only memory and a random access memory, and may also include a non-volatile random access memory. The memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may include a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may include a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct rambus RAM (DR RAM).
[0140] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
[0141] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.
[0142] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
[0143] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of various changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.
Claims
1. A method for integrated surveying and mapping of island and reef topography and water depth, characterized in that: include: Acquire the collected data collected by the aircraft when passing through the island and reef terrain area, the collected data includes positioning data, three-dimensional point cloud data corresponding to the island and reef area, bathymetric echo data corresponding to the seawater area, and optical image data corresponding to the island and reef and surrounding areas; The collected data are fused by an extended Kalman filter algorithm to obtain fused data; feature extraction is performed on the fused data to obtain feature point data, wherein the feature point data includes point cloud feature points and image feature points; The currently observed feature point data is matched with the previously observed feature points to obtain feature pairs, the position and posture information of the aircraft is estimated based on the feature pairs, and the map information is updated based on the position and posture information to generate an island and reef terrain map.
2. The integrated surveying and mapping method of island and reef topography and water depth according to claim 1 is characterized in that: The collected data is synchronously collected by airborne equipment integrated on the aircraft, and the airborne equipment includes a GPS / IMU positioning device, a laser radar device, a green wave laser device and an optical imaging device.
3. The integrated surveying and mapping method of island and reef topography and water depth according to claim 1 is characterized in that: The step of fusing the pre-processed collected data by using an extended Kalman filter algorithm to obtain fused data includes: Calculate the predicted state vector and the predicted covariance matrix corresponding to the current state based on the state vector at the previous moment and the positioning data based on the state transfer function; Based on the observation function, state estimation is updated according to the three-dimensional point cloud data and the bathymetric echo data to obtain an observation matrix and an observation noise covariance matrix; The Kalman gain is calculated according to the prediction covariance matrix, the observation matrix and the observation noise covariance matrix, and the prediction state is adjusted by the Kalman gain and the residual to obtain the fusion data corresponding to the current state estimation.
4. The integrated surveying and mapping method of island and reef topography and water depth according to claim 1 is characterized in that: The extracting features from the fused data comprises: Extracting feature points from the optical image data based on a SIFT algorithm to obtain the image feature points; Feature extraction is performed on the three-dimensional point cloud data to obtain the point cloud feature points.
5. The integrated surveying and mapping method of island and reef topography and water depth according to claim 1 is characterized in that: The matching of the currently observed feature point data with the previously observed feature points includes: The ICP algorithm is used to align the feature points of the point cloud collected in different time periods to obtain the feature pairs between the source point cloud and the target point cloud.
6. The integrated surveying and mapping method of island and reef topography and water depth according to claim 1 is characterized in that: The estimating the position and posture information of the aircraft according to the feature pair comprises: A cost function is defined based on the feature pair, and a nonlinear optimization algorithm is used to minimize the cost function to obtain the optimal posture information.
7. The integrated surveying and mapping method of island and reef topography and water depth according to claim 1 is characterized in that: Also includes: Preprocessing the three-dimensional point cloud data by using a statistical filter to obtain point cloud data; Calculate the water depth value according to the bathymetric echo data to obtain water depth data; Performing posture correction on the optical image data using the positioning data to obtain image data; The point cloud data, the water depth data and the image data are fused based on the extended Kalman filter algorithm to obtain fused data.
8. An integrated surveying and mapping system for island and reef topography and water depth, characterized in that: Execute the integrated surveying and mapping method of island and reef topography and water depth as described in any one of claims 1 to 7.
9. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores instructions, and the instructions are loaded and executed by the processor to implement the integrated surveying and mapping method of island and reef topography and water depth as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for integrated surveying and mapping of island and reef topography and water depth as described in any one of claims 1 to 7 is implemented.
Citation Information
Cited By
Island three-dimensional live-action surveying and mapping method based on unmanned equipment
CN121883754A
Island reef three-dimensional real scene surveying and mapping method based on unmanned equipment
CN121883754B
