Three-dimensional space modeling method, system and storage medium based on drone mapping
By segmenting the surveying and mapping areas and optimizing the flight path and attitude parameters of the drone, the problem of insufficient accuracy caused by the drone's photos taken due to the influence of environmental and flight parameters is solved, and the accuracy and accuracy of three-dimensional spatial modeling are improved.
Patent Information
- Application Number
- CN202410503686.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-25
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-04-25
AI Technical Summary
Due to environmental factors, flight parameters and coverage, the surface imaging accuracy is insufficient, affecting the accuracy and accuracy of three-dimensional spatial modeling.
By dividing the surveying and mapping area into sub-regions, the drone equipped with sensor equipment performs orderly imaging, identifying image clarity coefficients and environmental change index, generating correction strategies, optimizing flight paths and attitude parameters, performing secondary imaging and three-dimensional modeling, Includes data registration, filtering and reconstruction.
It improves the accuracy and clarity of surface imaging, reduces the impact of environmental factors on imaging quality, improves the accuracy and accuracy of three-dimensional spatial modeling, and ensures the smooth completion of aerial photography tasks.
Smart Images

Figure CN118424230B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of unmanned aerial vehicle surveying and mapping, and in particular to a three-dimensional space modeling method, system and storage medium based on unmanned aerial vehicle surveying and mapping. Background Art
[0002] Surveying and mapping is an important means of obtaining surface geographic information, and its applications cover many fields such as geological exploration, urban planning, land use, and environmental protection. Through surveying and mapping, we can obtain information such as the topography, landforms, and vegetation coverage of the surface, providing basic data support for the planning and implementation of various engineering projects. The main surveying and mapping methods include manual measurement, ground measurement tools, and drone aerial photography technology surveying and mapping methods. Drone aerial photography is not restricted by terrain, and the aerial photography path and height can be flexibly adjusted. Aerial photography tasks can be carried out anytime and anywhere. It has extremely high flexibility and convenience and is widely used in the surveying and mapping process.
[0003] In the process of surveying and mapping, compared with traditional two-dimensional maps, three-dimensional space modeling provides richer data, can contain more dimensions and information, and provide a more comprehensive basis for planning, design, and decision-making analysis. In the traditional three-dimensional space modeling process, in order to obtain accurate information about the surface, drones are usually required for aerial photography. However, due to environmental factors, flight parameters, and coverage, photos taken by drones may have problems such as offset and blur, resulting in insufficient surface imaging accuracy, which in turn affects the precision and accuracy of three-dimensional space modeling. Therefore, how to overcome the limitations of drone photos and improve the accuracy and clarity of surface imaging has become a key issue that needs to be solved in the current field of three-dimensional space modeling. Summary of the invention
[0004] Technical issues solved
[0005] In view of the shortcomings of the prior art, the present invention provides a three-dimensional space modeling method, system and storage medium based on drone mapping, which helps to solve the problem that photos taken by drones may have offset, blur and other problems due to environmental factors, flight parameters and coverage, resulting in insufficient surface imaging accuracy, which in turn affects the precision and accuracy of three-dimensional space modeling.
[0006] Technical Solution
[0007] To achieve the above objectives, the present invention is implemented through the following technical solutions: A three-dimensional space modeling method based on drone mapping includes the following steps:
[0008] S1. Divide the surveying area into several sub-areas, deploy a drone equipped with sensor equipment in each area, plan the flight path for flight, image each sub-area in order, and construct a first modeling data set; identify the resolution of the imaging data and the image correlation R between adjacent nodes, construct the image clarity coefficient Tx of each area, and send a first warning command when the image clarity coefficient Tx is lower than the preset clarity threshold;
[0009] S2, receiving the first warning command, collecting environmental data of each sub-area in real time, including weather, light, wind speed, humidity and visibility data, establishing an environmental impact data set, and constructing an environmental change index Cvr of each sub-area based on the environmental impact data set. When the environmental change index Cvr is higher than the environmental impact threshold, sending a second warning command;
[0010] S3. When receiving the second warning command, avoid the sub-areas where the environmental change index Cvr is higher than the environmental impact threshold, give priority to the sub-areas where the environmental change index Cvr does not exceed the environmental impact threshold, prepare to periodically collect the flight altitude data, route coverage data and flight attitude parameters of several drones in each sub-area, establish a drone mass set, and analyze and calculate the drone mass set to obtain: coverage index Fgl and flight attitude coefficient Fxz;
[0011] S4, comparing the coverage index Fgl with a preset first threshold value to obtain a first evaluation result; comparing the flight attitude coefficient Fxz with a preset second threshold value to obtain a second evaluation result;
[0012] S5. After generating the first correction strategy and the second correction strategy based on the first evaluation result and the second evaluation result, the drone is subjected to secondary imaging after the correction, a second modeling data set is constructed, and three-dimensional modeling is performed based on the calibrated second modeling data set. The modeling includes data registration, filtering and reconstruction to generate final three-dimensional space modeling data.
[0013] Preferably, geographic data of the surveying area is collected, classified according to terrain features, and divided into several sub-areas. Aerial photography is carried out by using unmanned aerial vehicles carrying sensor equipment to obtain imaging data of the sub-areas and construct a first modeling data set; and based on the first modeling data set and geographic information, a primary three-dimensional space model is constructed using a three-dimensional reconstruction algorithm and point cloud processing technology.
[0014] Preferably, extracting any sub-region image A and adjacent node image B in the imaging data, analyzing and calculating the correlation R between image A and adjacent node image B, comprises the following steps: identifying and obtaining the imaging horizontal resolution spfb, the imaging vertical resolution czfb, the adjacent image difference value CyZ and the similarity I(x; y), wherein the adjacent image difference value CyZ is generated by the following formula:
[0015]
[0016] Where n represents the total number of pixels in the image, A(i,j) represents the pixel value of the i-th row and j-th column in image A; B(i,j) represents the pixel value of the i-th row and j-th column in image B;
[0017] Then the similarity I(X;Y) is calculated:
[0018]
[0019] Where I(X;Y) represents the mutual information between variables X and Y, p(x,y) represents the joint probability distribution of variables X and Y taking values of x and y at the same time; p(x) and p(y) represent the marginal probability distribution of variables X and Y respectively, where variable X represents the total pixel value in image A; variable Y represents the total number of pixels in image B;
[0020] The correlation degree R is obtained by dimensionlessly processing the difference value CyZ of adjacent images and the similarity I(X;Y), and then calculating the correlation degree R through the following correlation formula:
[0021] R=0(**CyZ+β*I(X;Y)
[0022] Among them, 0<α<1, 0<β<1, and α+β=1, α and β are weights, which are adjusted by the user;
[0023] The image clarity coefficient Tx is obtained by extracting the imaging horizontal resolution spfb, the imaging vertical resolution czfb and the correlation R, and after dimensionless processing, the image clarity coefficient Tx is obtained by the following formula:
[0024]
[0025] Wherein, C1 is the first constant correction coefficient, and ln 2 represents the logarithmic operation with base 2.
[0026] Preferably, when the image clarity coefficient Tx is lower than a preset clarity threshold, it indicates that the first imaging is unqualified, and a first warning command is sent;
[0027] When the image clarity coefficient Tx ≥ the clarity threshold, it means that the first imaging is qualified, and the first qualified image is classified as the first pending data set;
[0028] When receiving the first warning command, use a drone equipped with a meteorological sensor to collect the temperature value wdz, humidity value sdz, wind speed value fsz, light intensity gzz, and visibility njd of each sub-region in real time, establish an environmental impact data set, and after dimensionless processing, generate the environmental change index Cvr of each sub-region through the following formula:
[0029]
[0030] Among them, bz1 represents the preset temperature threshold, bz2 represents the preset humidity threshold, bz3 represents the preset wind speed threshold, bz4 represents the preset light threshold, bz5 represents the preset visibility threshold, 0 < A1 < 1, 0 < A2 < 1, 0 < A3 < 1, 0 < A4 < 1, 0 < A5 < 1, and A1 + A2 + A3 + A4 + A5 = 1. A1, A2, A3, A4, and A5 are weights, and their specific values are adjusted and set by the user. C2 is the second constant correction coefficient;
[0031] When the environmental change index Cvr is higher than the environmental impact threshold, send the second warning command, indicating that the current environment is unqualified and not suitable for collection, and list these sub-regions in the first pending collection area.
[0032] Preferably, for each sub-region where the environmental change index Cvr does not exceed the environmental impact threshold, prepare for periodic collection; and collect several drone flight altitude data, route coverage rate data, and flight attitude parameters of each sub-region in real time to establish a drone quality set;
[0033] The drone quality set includes the following data: flight altitude value gdz, flight risk avoidance altitude difference bhcz, route coverage area fgz, flight roll angle hgj, flight pitch angle fyj, flight yaw angle phj, flight speed fxsd; after dimensionless processing, generate the coverage rate index Fgl and the flight attitude coefficient Fxz through the following consensus:
[0034]
[0035] Among them, bz6 represents the preset drone flight altitude threshold, bz7 represents the preset flight risk avoidance altitude difference threshold, bz8 represents the preset flight coverage area threshold, 0 < A6 < 1, 0 < A7 < 1, 0 < A8 < 1, and A6 + A7 + A8 = 1. A6, A7, and A8 are weights, and their specific values are adjusted and set by the user. C3 is the third constant correction coefficient;
[0036]
[0037] Among them, ln 3 represents the logarithmic operation with base 3 respectively.
[0038] Preferably, the coverage index Fgl is compared with a preset first threshold value to obtain a first evaluation result, including:
[0039] When the coverage index Fgl is less than the preset first threshold, it indicates that the UAV flight coverage rate does not meet the standard; a first correction strategy is generated;
[0040] When the coverage index Fgl ≥ the preset first threshold, it means that the UAV flight coverage rate meets the standard;
[0041] The flight attitude coefficient Fxz is compared with a preset second threshold value to obtain a second evaluation result, including:
[0042] When the flight attitude coefficient Fxz> the preset second threshold, it means that the flight attitude of the UAV does not meet the standard, which means that it deviates from the expected range and there is a safety risk, and the first correction strategy is generated;
[0043] When the flight attitude coefficient Fxz≤the preset second threshold, it means that the flight attitude of the UAV meets the standard.
[0044] Preferably, the first correction strategy includes: replanning the flight path of the drone, focusing on covering uncovered areas to ensure that the coverage rate meets the standard, and in areas where the coverage rate does not meet the standard, increasing the altitude of the drone by 20% to thereby improve the coverage range;
[0045] The second correction strategy includes: adjusting the flight attitude parameter data, including the flight roll angle hgj, the flight pitch angle fyj, the flight yaw angle phj and the flight speed fxsd, to avoid deviation from the expected range.
[0046] Preferably, after the first correction strategy and the second correction strategy are executed for correction, the drones in the plurality of sub-areas are re-imaged, and the first pending data set is associated with the first pending data set for fusion, and the second modeling data set is associated with the first pending data set for fusion, and the second modeling data set is constructed, and the primary three-dimensional space model is remodeled based on the calibrated second modeling data set, and the modeling includes data registration, filtering and reconstruction to generate the final three-dimensional space modeling data;
[0047] For the first pending collection area, after several consecutive sampling cycles, the real-time environment is re-collected, and when the environment change index Cvr does not exceed the environment impact threshold, steps S3-S5 are completed.
[0048] The three-dimensional space modeling system based on UAV mapping includes a region segmentation and UAV configuration module, an identification and judgment module, an environmental data acquisition module, an environmental analysis module, a UAV flight data acquisition module, a flight parameter analysis module, a correction strategy generation module, and a secondary imaging and modeling module;
[0049] The region segmentation and drone configuration module is used to segment the surveying and mapping area, configure a drone equipped with a sensor device in each sub-area, plan a flight path, ensure that each sub-area is imaged once in an orderly manner, and construct a first modeling data set;
[0050] The recognition and judgment module is used to identify the resolution of the imaging data and the image correlation R between adjacent nodes for the first modeling data set, construct the image clarity coefficient Tx of each area, and send a first warning command when the image clarity does not meet the standard;
[0051] The environmental data collection module is used to collect environmental data of each sub-area in real time, including weather, light, wind speed, humidity and visibility, and establish an environmental impact data set;
[0052] The environmental analysis module is used to construct an environmental change index Cvr for each sub-area according to the environmental impact data set, and send a second warning command when the environmental change index is higher than a threshold;
[0053] The UAV flight data collection module is used to preferentially select sub-areas whose environmental change index Cvr does not exceed the environmental impact threshold for periodic collection; collect UAV flight altitude data, route coverage data and flight attitude parameters of each sub-area in real time to establish a UAV quality set;
[0054] The flight parameter analysis module is used to analyze and calculate the drone mass set to obtain a coverage index Fgl and a flight attitude coefficient Fxz; compare the coverage index Fgl with a preset first threshold to obtain a first evaluation result; and compare the flight attitude coefficient Fxz with a preset second threshold to obtain a second evaluation result;
[0055] The correction strategy generation module is used to generate a first correction strategy and a second correction strategy according to the first evaluation result and the second evaluation result, and execute them;
[0056] The secondary imaging and modeling module is used to perform secondary imaging based on the corrected UAV, construct a second modeling data set, and perform three-dimensional modeling based on the calibrated second modeling data set, including data alignment, filtering and reconstruction, to generate final three-dimensional space modeling data.
[0057] A storage medium, wherein the storage medium is used to store program instructions of the three-dimensional space modeling method based on drone mapping mentioned in the above specification.
[0058] Beneficial Effects
[0059] The present invention provides a three-dimensional space modeling method, system and storage medium based on drone mapping. It has the following beneficial effects:
[0060] (1) By identifying the resolution of imaging data and the image correlation R between adjacent nodes, the system constructs the image clarity coefficient Tx of each area, and can accurately evaluate the clarity level of the photo. It also collects environmental data of each sub-area in real time, including weather, light, wind speed, humidity and visibility data, and establishes an environmental impact data set, which helps to accurately evaluate the impact of the environment on the quality of the photo.
[0061] Through real-time collection and analysis of environmental data, as well as monitoring and evaluation of drone flight parameters, aerial photography strategies can be optimized to avoid areas with greater environmental impacts and prioritize areas with good environmental conditions for aerial photography. This helps improve aerial photography efficiency, reduces the impact of environmental factors on imaging quality, and thus improves the precision and accuracy of 3D spatial modeling.
[0062] (2) By real-time monitoring of image clarity coefficient Tx, environmental change index Cvr, and UAV flight parameters, it is possible to promptly detect and warn of possible problems, such as insufficient image clarity and significant environmental impact. This helps to timely adjust flight strategies and corrective measures to ensure the smooth completion of aerial photography missions and avoid surveying and mapping failures or quality degradation due to unexpected situations.
[0063] (3) By collecting and analyzing the flight altitude data, route coverage data, and flight attitude parameters of the UAV, obtaining the coverage index Fgl and the flight attitude coefficient Fxz, and performing response evaluation, the system can more accurately evaluate the quality of aerial photography, thereby improving the data quality and the accuracy of three-dimensional modeling. Based on the first evaluation result and the second evaluation result, a correction strategy is generated, and the system can make timely corrections to problems in the aerial photography process, further improving the data quality and modeling accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0064] Figure 1 A schematic diagram of the steps of a three-dimensional space modeling method based on drone mapping of the present invention;
[0065] Figure 2 The figure is a flowchart diagram of the three-dimensional space modeling system based on drone mapping of the present invention. DETAILED DESCRIPTION
[0066] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0067] Example 1
[0068] See also Figure 1The present invention provides a three-dimensional space modeling method based on drone mapping, comprising the following steps:
[0069] S1. Divide the surveying area into several sub-areas, deploy a drone equipped with sensor equipment in each area, plan the flight path for flight, image each sub-area in order, and construct a first modeling data set; identify the resolution of the imaging data and the image correlation R between adjacent nodes, construct the image clarity coefficient Tx of each area, and send a first warning command when the image clarity coefficient Tx is lower than the preset clarity threshold;
[0070] S2, receiving the first warning command, collecting environmental data of each sub-area in real time, including weather, light, wind speed, humidity and visibility data, establishing an environmental impact data set, and constructing an environmental change index Cvr of each sub-area based on the environmental impact data set. When the environmental change index Cvr is higher than the environmental impact threshold, sending a second warning command;
[0071] S3. When receiving the second warning command, avoid the sub-areas where the environmental change index Cvr is higher than the environmental impact threshold, give priority to the sub-areas where the environmental change index Cvr does not exceed the environmental impact threshold, prepare to periodically collect the flight altitude data, route coverage data and flight attitude parameters of several drones in each sub-area, establish a drone mass set, and analyze and calculate the drone mass set to obtain: coverage index Fgl and flight attitude coefficient Fxz;
[0072] S4, comparing the coverage index Fgl with a preset first threshold value to obtain a first evaluation result; comparing the flight attitude coefficient Fxz with a preset second threshold value to obtain a second evaluation result;
[0073] S5. After generating the first correction strategy and the second correction strategy based on the first evaluation result and the second evaluation result, the drone is subjected to secondary imaging after the correction, a second modeling data set is constructed, and three-dimensional modeling is performed based on the calibrated second modeling data set. The modeling includes data registration, filtering and reconstruction to generate final three-dimensional space modeling data.
[0074] In this embodiment, by identifying the resolution of imaging data and the image correlation R between adjacent nodes, constructing the image clarity coefficient Tx of each area, and establishing an environmental impact data set, the accuracy and clarity of surface imaging can be effectively improved. By using the environmental impact data set to construct the environmental change index Cvr, areas with high environmental change index Cvr can be avoided, and drone aerial photography of areas with less environmental impact can be prioritized, thereby reducing the impact of environmental factors on imaging quality.
[0075] By collecting and analyzing UAV flight altitude data, route coverage data and flight attitude parameters, as well as calculating the coverage index Fgl and flight attitude coefficient Fxz, the quality of UAV aerial photography can be evaluated more accurately, thereby improving the precision and accuracy of three-dimensional space modeling.
[0076] Through real-time monitoring and analysis of the image clarity coefficient Tx, environmental change index Cvr, coverage index Fgl and flight attitude coefficient Fxz data, it is possible to timely discover and warn of possible problems in the drone aerial photography process, such as insufficient image clarity and large environmental impact, and then adjust the flight strategy and corrective measures to ensure the smooth completion of the aerial photography mission. Through automated data collection, analysis and correction processes, the efficiency and accuracy of surveying and mapping work can be improved, the investment in human resources and time costs can be reduced, and the possible errors and risks in the surveying and mapping process can be reduced, thereby saving resources and costs. By generating the final three-dimensional spatial modeling data, it can provide more accurate and comprehensive basic data support for the planning and implementation of various engineering projects, and provide a scientific basis for decision-making, planning and design, and engineering construction, thereby promoting the development and progress of urban planning, land use, resource exploration and other fields.
[0077] Example 2. This example is an explanation of Example 1. Specifically, geographic data of the surveying area is collected, classified according to terrain features, and divided into several sub-areas. Aerial photography is performed by using a drone carrying a sensor device to obtain imaging data of the sub-areas and construct a first modeling data set; and based on the first modeling data set and geographic information, a primary three-dimensional space model is constructed using a three-dimensional reconstruction algorithm and point cloud processing technology.
[0078] In this embodiment, the imaging data obtained by aerial photography is constructed as a first modeling data set, which provides a basis for subsequent three-dimensional space modeling. These data sets contain rich geographic information and provide important data support for building a three-dimensional space model.
[0079] Embodiment 3, this embodiment is an explanation of embodiment 1, specifically, extracting any sub-region image A and adjacent node image B in the imaging data, analyzing and calculating the correlation R between image A and adjacent node image B, including the following steps: identifying and obtaining the imaging horizontal resolution spfb, the imaging vertical resolution czfb, the adjacent image difference value CyZ and the similarity I(x; y), wherein the adjacent image difference value CyZ is generated by the following formula:
[0080]
[0081] Where n represents the total number of pixels in the image, A(i,j) represents the pixel value of the i-th row and j-th column in image A; B(i,j) represents the pixel value of the i-th row and j-th column in image B;
[0082] Then the similarity I(X;Y) is calculated:
[0083]
[0084] Where I(X;Y) represents the mutual information between variables X and Y, p(x,y) represents the joint probability distribution of variables X and Y taking values of x and y at the same time; p(x) and p(y) represent the marginal probability distribution of variables X and Y respectively, where variable X represents the total pixel value in image A; variable Y represents the total number of pixels in image B;
[0085] The correlation degree R is obtained by dimensionlessly processing the difference value CyZ of adjacent images and the similarity I(X;Y), and then calculating the correlation degree R through the following correlation formula:
[0086] R = α*CyZ + β*I(X;Y)
[0087] Among them, 0<α<1, 0<β<1, and α+β=1, α and β are weights, which are adjusted by the user;
[0088] The image clarity coefficient Tx is obtained by extracting the imaging horizontal resolution spfb, the imaging vertical resolution czfb and the correlation R, and after dimensionless processing, the image clarity coefficient Tx is obtained by the following formula:
[0089]
[0090] Wherein, C1 is the first constant correction coefficient, and ln 2 represents the logarithmic operation with base 2.
[0091] In this embodiment, by analyzing the correlation R between image A and image B between adjacent nodes, the system can quantitatively evaluate the correlation between imaging data, so as to better understand the similarities and differences between images. This helps to identify images with large differences or low similarity, and then take corresponding measures, such as optimizing the flight path, adjusting the photographic parameters, etc., to improve the imaging quality and clarity. The calculation of the image clarity coefficient Tx covers factors such as imaging horizontal resolution, imaging vertical resolution, and image correlation R, and comprehensively considers the resolution and correlation of the image. By calculating the image clarity coefficient Tx, the system can intuitively evaluate the clarity of each image, and then provide clear and high-quality imaging data for the modeling process, thereby improving the precision and accuracy of three-dimensional space modeling. In the calculation of the correlation R and the image clarity coefficient Tx, the user can adjust the weight according to specific needs and actual conditions, so as to flexibly control the degree of influence of correlation and clarity on the correlation and clarity coefficient. This flexibility enables the system to adapt to different scenarios and application requirements, and provide more personalized imaging analysis and processing solutions.
[0092] Example 4. This example is an explanatory description carried out in Example 1. Specifically, when the image clarity coefficient Tx is lower than the preset clarity threshold, it indicates that the first imaging is unqualified, and a first warning command is sent.
[0093] When the image clarity coefficient Tx ≥ the clarity threshold, it indicates that the first imaging is qualified, and the pictures with qualified first imaging are classified into the first pending data set.
[0094] When receiving the first warning command, the temperature value wdz, humidity value sdz, wind speed value fsz, light intensity gzz, and visibility njd of each sub-region are collected in real time by the unmanned aerial vehicle equipped with a meteorological sensor, and an environmental impact data set is established. After dimensionless processing, the environmental change index Cvr of each sub-region is generated through the following formula:
[0095]
[0096] where bz1 represents the preset temperature threshold, bz2 represents the preset humidity threshold, bz3 represents the preset wind speed threshold, bz4 represents the preset light threshold, bz5 represents the preset visibility threshold, 0 < A1 < 1, 0 < A2 < 1, 0 < A3 < 1, 0 < A4 < 1, 0 < A5 < 1, and A1 + A2 + A3 + A4 + A5 = 1. A1, A2, A3, A4, and A5 are weights, and their specific values are adjusted and set by the user. C2 is the second constant correction coefficient.
[0097] When the environmental change index Cvr is higher than the environmental impact threshold, a second warning command is sent, indicating that the current environment is unqualified and not suitable for collection, and these sub-regions are included in the first pending collection area.
[0098] In this example, the environmental data such as temperature, humidity, wind speed, light intensity, and visibility of each sub-region are collected in real time by the unmanned aerial vehicle equipped with a meteorological sensor. The system can monitor the environmental conditions of the surveying and mapping area in real time. This helps to timely detect and respond to environmental changes, ensure that the data collection work in the surveying and mapping process is carried out under suitable environmental conditions, and improve the effectiveness and accuracy of data collection. According to the collected environmental data, the system can calculate the environmental change index of each sub-region. The environmental change index comprehensively considers the influence of multiple environmental factors such as temperature, humidity, wind speed, light intensity, and visibility, and can objectively reflect the degree of environmental change. When the environmental change index Cvr is higher than the preset environmental impact threshold, the system will send a second warning command, indicating that the current environment is not suitable for data collection, thus avoiding the decline in data quality and the occurrence of risks caused by the harsh environment.
[0099] Example 5. This example is an explanatory description carried out in Example 1. Specifically, for each sub-region where the environmental change index Cvr does not exceed the environmental impact threshold, periodic collection is prepared; and several drone flight altitude data, route coverage rate data, and flight attitude parameters of each sub-region are collected in real time to establish a drone quality set;
[0100] The drone quality set includes the following data: flight altitude value gdz, flight hazard avoidance altitude difference bhcz, route coverage area fgz, flight roll angle hgj, flight pitch angle fyj, flight yaw angle phj, flight speed fxsd; after dimensionless processing, the coverage rate index Fgl and the flight attitude coefficient Fxz are generated through the following consensus:
[0101]
[0102] Among them, bz6 represents the preset drone flight altitude threshold, bz7 represents the preset flight hazard avoidance altitude difference threshold, bz8 represents the preset flight coverage area threshold, 0 < A6 < 1, 0 < A7 < 1, 0 < A8 < 1, and A6 + A7 + A8 = 1. A6, A7, and A8 are weights, and their specific values are adjusted and set by the user. C3 is the third constant correction coefficient;
[0103]
[0104] Among them, ln 3 represents the logarithmic operation with base 3 respectively.
[0105] In this example, the system preferentially selects sub-regions with less environmental impact for periodic data collection, which can maximize the use of limited resources and improve the efficiency and cost-effectiveness of data collection. Through intelligent scheduling and planning, the system can dynamically adjust the data collection strategy according to the real-time environmental conditions and requirements to ensure that the data collection work is carried out under the best conditions. By collecting the drone flight altitude data, route coverage rate data, and flight attitude parameters of each sub-region in real time, the system can establish a drone quality set, that is, evaluate the flight performance and attitude of the drone. This helps to timely discover and eliminate possible problems and risks during the drone flight process and ensure the safety and stability of data collection. According to the established drone quality set, the system can calculate the coverage rate index Fgl and the flight attitude coefficient Fxz, so as to evaluate the flight quality of the drone and the data collection effect. These indicators can provide users with a quantitative evaluation of the data collection process, help users better master the data collection situation, optimize the flight strategy and parameter settings, and improve the efficiency and quality of data collection.
[0106] Example 6: This example is an explanation of Example 1. Specifically, the coverage index Fgl is compared with a preset first threshold to obtain a first evaluation result, including:
[0107] When the coverage index Fgl is less than the preset first threshold, it indicates that the UAV flight coverage rate does not meet the standard; a first correction strategy is generated;
[0108] When the coverage index Fgl ≥ the preset first threshold, it means that the UAV flight coverage rate meets the standard;
[0109] The flight attitude coefficient Fxz is compared with a preset second threshold value to obtain a second evaluation result, including:
[0110] When the flight attitude coefficient Fxz> the preset second threshold, it means that the flight attitude of the UAV does not meet the standard, which means that it deviates from the expected range and there is a safety risk, and the first correction strategy is generated;
[0111] When the flight attitude coefficient Fxz≤the preset second threshold, it means that the flight attitude of the UAV meets the standard.
[0112] In this embodiment, by comparing the coverage index Fgl with the preset first threshold, the system can promptly find out whether the UAV flight coverage meets the standard. When the coverage index Fgl is lower than the preset first threshold, the system will generate a first correction strategy to ensure that the flight coverage can meet the modeling requirements. This helps to improve the comprehensiveness and accuracy of data collection and ensure the integrity and reliability of the modeling results.
[0113] By comparing the flight attitude coefficient Fxz with the preset second threshold, the system can evaluate whether the UAV's flight attitude meets the standard. When the flight attitude coefficient Fxz exceeds the preset second threshold, it indicates that the UAV's flight attitude deviates from the expected range and there may be safety risks. The system will generate a first correction strategy and take timely measures to adjust the flight attitude to ensure flight safety. This helps to reduce the occurrence of unexpected events and ensure the safety and stability of the data collection and modeling process. By evaluating the flight coverage and flight attitude, the three-dimensional space modeling system based on UAV mapping can promptly discover and solve problems that may exist during the flight of the UAV, improve the quality and efficiency of data collection and modeling, and ensure the smooth progress of the work.
[0114] Example 7. This example is an explanation of Example 1. Specifically, the first correction strategy includes: re-planning the flight path of the drone, focusing on covering the uncovered area to ensure that the coverage rate meets the standard, and in the area where the coverage rate does not meet the standard, increasing the altitude of the drone by 20%, thereby improving the coverage range; by re-planning the flight path of the drone and increasing the flight altitude, the system can ensure that the uncovered areas are covered with emphasis, thereby improving the coverage rate and ensuring that the standard is met. Increasing the flight altitude of the drone can expand the coverage range and further improve the efficiency and comprehensiveness of data collection. This helps to reduce missed measurements and duplicate coverage, and improves the integrity and accuracy of modeling data.
[0115] The second correction strategy includes: adjusting the flight attitude parameter data, including the flight roll angle hgj, the flight pitch angle fyj, the flight yaw angle phj and the flight speed fxsd, to avoid deviation from the expected range. By adjusting the flight attitude parameter data, including the roll angle, pitch angle, yaw angle and flight speed, the system can prevent the drone from deviating from the expected range and maintain the stability and accuracy of the flight. This helps to reduce attitude deviation during flight and improve the accuracy and reliability of data collection. At the same time, adjusting the flight speed can also optimize the aerial photography process and further improve the modeling efficiency.
[0116] In this embodiment, by implementing the first correction strategy and the second correction strategy, the three-dimensional space modeling system based on UAV mapping can timely adjust the flight plan and attitude parameters to ensure that the coverage rate meets the standard and the flight attitude is stable during the data collection process, thereby indirectly affecting the clarity of the imaging data. The second correction strategy is to maintain the stability and accuracy of the UAV by adjusting the flight attitude parameters, such as the flight roll angle hgj, the flight pitch angle fyj, the flight yaw angle phj and the flight speed fxsd, to avoid blurring or distortion of the image, thereby indirectly improving the clarity of the image.
[0117] Example 8. This example is an explanation of Example 1. Specifically, after the first correction strategy and the second correction strategy are executed for correction, the drones in several sub-areas are re-imaged and fused with the first pending data set to ensure the integrity and accuracy of the data. Through such processing, a second modeling data set is constructed, which contains corrected image data and related information.
[0118] Construct a second modeling data set, and remodel on the basis of the primary three-dimensional space model according to the calibrated second modeling data set, the modeling includes data registration, filtering and reconstruction, and generates the final three-dimensional space modeling data; after obtaining the second modeling data set, remodeling can be performed on the basis of the primary three-dimensional space model. This process includes steps such as data registration, filtering and reconstruction to ensure that the generated three-dimensional space model is more accurate and realistic. By registering and filtering the data, the accuracy and clarity of the model can be further improved, and more realistic three-dimensional space modeling data can be generated.
[0119] For the first pending acquisition area, after several consecutive sampling cycles, the real-time environment is re-collected, and when the environmental change index Cvr does not exceed the environmental impact threshold, steps S3-S5 are completed. For the first pending acquisition area, if the real-time environment change index does not exceed the environmental impact threshold after several consecutive sampling cycles, that is, the environmental conditions are suitable for acquisition, then steps S3-S5 will continue to be executed until completion. This processing method can ensure that more accurate data is obtained under suitable environmental conditions and improve the quality and reliability of three-dimensional space modeling.
[0120] Example 9, please refer to Figure 2 , a three-dimensional space modeling system based on UAV mapping, including region segmentation and UAV configuration module, identification and judgment module, environmental data acquisition module, environmental analysis module, UAV flight data acquisition module, flight parameter analysis module, correction strategy generation module and secondary imaging and modeling module;
[0121] The region segmentation and drone configuration module is used to segment the surveying and mapping area, configure a drone equipped with a sensor device in each sub-area, plan a flight path, ensure that each sub-area is imaged once in an orderly manner, and construct a first modeling data set;
[0122] The recognition and judgment module is used to identify the resolution of the imaging data and the image correlation R between adjacent nodes for the first modeling data set, construct the image clarity coefficient Tx of each area, and send a first warning command when the image clarity does not meet the standard;
[0123] The environmental data collection module is used to collect environmental data of each sub-area in real time, including weather, light, wind speed, humidity and visibility, and establish an environmental impact data set;
[0124] The environmental analysis module is used to construct an environmental change index Cvr for each sub-area according to the environmental impact data set, and send a second warning command when the environmental change index is higher than a threshold;
[0125] The UAV flight data collection module is used to preferentially select sub-areas whose environmental change index Cvr does not exceed the environmental impact threshold for periodic collection; collect UAV flight altitude data, route coverage data and flight attitude parameters of each sub-area in real time to establish a UAV quality set;
[0126] The flight parameter analysis module is used to analyze and calculate the drone mass set to obtain a coverage index Fgl and a flight attitude coefficient Fxz; compare the coverage index Fgl with a preset first threshold to obtain a first evaluation result; and compare the flight attitude coefficient Fxz with a preset second threshold to obtain a second evaluation result;
[0127] The correction strategy generation module is used to generate a first correction strategy and a second correction strategy according to the first evaluation result and the second evaluation result, and execute them;
[0128] The secondary imaging and modeling module is used to perform secondary imaging based on the corrected UAV, construct a second modeling data set, and perform three-dimensional modeling based on the calibrated second modeling data set, including data alignment, filtering and reconstruction, to generate final three-dimensional space modeling data.
[0129] In this embodiment, the system effectively solves the problem of insufficient surface imaging accuracy by identifying the clarity and environmental impact of imaging data, and performing steps such as correction strategy generation. The quality and clarity of surface imaging are improved by optimizing the flight path of the drone, adjusting the flight attitude parameters, and other methods. Photos taken by drones are affected by many factors such as environmental factors, flight parameters, and coverage, and are prone to problems such as offset and blur. Through modules such as environmental data collection and flight parameter analysis, the system overcomes the limitations of drone photos and improves the accuracy and clarity of surface imaging. By introducing improved surveying and mapping methods and techniques, as well as optimizing the generation of the first correction strategy and the second correction strategy, the system effectively improves the accuracy and precision of three-dimensional space modeling. This is of great significance to the fields of planning, design, decision analysis, etc., and can provide more reliable data support for surveying and mapping projects. In summary, the three-dimensional space modeling system based on drone surveying and mapping improves the quality and accuracy of modeling by solving the problems of insufficient surface imaging accuracy and overcoming the limitations of drone photos, and provides more reliable data support for various application scenarios.
[0130] A storage medium, wherein the storage medium is used to store program instructions of the three-dimensional space modeling method based on drone mapping mentioned in the above specification.
[0131] The storage medium is used to effectively store the program instructions of the three-dimensional space modeling method based on drone mapping, ensuring its long-term preservation and backup. This can prevent data loss or damage and ensure the security and integrity of the data. The program instructions stored in the storage medium can be used without a network connection. This is very useful for performing three-dimensional space modeling tasks in remote areas or scenarios with poor network environments.
[0132] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. Three-dimensional space modeling method based on drone mapping, Features: The following steps are included: S1. Divide the surveying area into several sub-areas, deploy a drone equipped with sensor equipment in each area, plan a flight path for flight, image each sub-area in an orderly manner, and construct a first modeling data set; And identify the resolution of the imaging data and the image correlation R between adjacent nodes, construct the image clarity coefficient Tx of each area, and send the first warning command when the image clarity coefficient Tx is lower than the preset clarity threshold; Extract any sub-region image A and adjacent node image B in the imaging data, analyze and calculate the correlation R between image A and adjacent node image B, including the following steps: identify and obtain the imaging horizontal resolution spfb, the imaging vertical resolution czfb, the adjacent image difference value CyZ and the similarity I(x; y), wherein the adjacent image difference value CyZ is generated by the following formula: Where n represents the total number of pixels in the image, A(i, j) represents the pixel value of the i-th row and j-th column in image A; B(i, j) represents the pixel value of the i-th row and j-th column in image B; Then the similarity I(X;Y) is calculated: Where I(X;Y) represents the mutual information between variables X and Y, p(x,y) represents the joint probability distribution of variables X and Y taking values of x and y at the same time; p(x) and p(y) represent the marginal probability distribution of variables X and Y respectively, where variable X represents the total pixel value in image A; variable Y represents the total number of pixels in image B; The correlation degree R is obtained by dimensionlessly processing the difference value CyZ of adjacent images and the similarity I(X;Y), and then calculating the correlation degree R through the following correlation formula: R = α**CyZ + β*I(X;Y) Wherein, 0<α<1, 0<β<1, and α+β=1, α and β are weights, which are adjusted and set by the user; The image clarity coefficient Tx is obtained by extracting the imaging horizontal resolution spfb, the imaging vertical resolution czfb and the correlation R, and after dimensionless processing, the image clarity coefficient Tx is obtained by the following formula: Among them, C 1 is the first constant correction coefficient, ln2 represents the logarithmic operation with base 2; S2, receiving the first warning command, collecting environmental data of each sub-area in real time, including weather, light, wind speed, humidity and visibility data, establishing an environmental impact data set, and constructing an environmental change index Cvr of each sub-area based on the environmental impact data set. When the environmental change index Cvr is higher than the environmental impact threshold, sending a second warning command; S3. When receiving the second warning command, avoid the sub-areas where the environmental change index Cvr is higher than the environmental impact threshold, give priority to the sub-areas where the environmental change index Cvr does not exceed the environmental impact threshold, prepare to periodically collect the flight altitude data, route coverage data and flight attitude parameters of several drones in each sub-area, establish a drone mass set, and analyze and calculate the drone mass set to obtain: coverage index Fgl and flight attitude coefficient Fxz; S4, comparing the coverage index Fgl with a preset first threshold value to obtain a first evaluation result; comparing the flight attitude coefficient Fxz with a preset second threshold value to obtain a second evaluation result; S5. After generating the first correction strategy and the second correction strategy based on the first evaluation result and the second evaluation result, the drone is subjected to secondary imaging after the correction, a second modeling data set is constructed, and three-dimensional modeling is performed based on the calibrated second modeling data set. The modeling includes data registration, filtering and reconstruction to generate final three-dimensional space modeling data.
2. The three-dimensional space modeling method based on drone mapping according to claim 1, Features: Collect geographic data of the surveying and mapping area, classify it according to terrain features, divide it into several sub-areas, use drones to carry sensor equipment to take aerial photos, obtain imaging data of the sub-areas, and construct a first modeling data set; Based on the first modeling data set and geographic information, a primary three-dimensional space model is constructed using a three-dimensional reconstruction algorithm and point cloud processing technology.
3. The three-dimensional space modeling method based on drone mapping according to claim 1, Features: When the image clarity coefficient Tx is lower than the preset clarity threshold, it means that the first imaging is unqualified, and the first warning command is sent; When the image clarity coefficient Tx ≥ the clarity threshold, it means that the first imaging is qualified, and the first qualified image is classified as the first pending data set; When the first warning command is received, the temperature value wdz, humidity value sdz, wind speed value fsz, light intensity gzz and visibility njd of each sub-area are collected in real time through the meteorological sensor carried by the drone, and the environmental impact data set is established. After dimensionless processing, the environmental change index Cvr of each sub-area is generated through the following formula: Wherein, bz1 represents the preset temperature threshold, bz2 represents the preset humidity threshold, bz3 represents the preset wind speed threshold, bz4 represents the preset light threshold, bz5 represents the preset visibility threshold, 0<A 1 <1,0<A 2 <1,0<A 3 <1,0 4 <1,0<A 5 <1, and A 1 +A 2 +A 3 +A 4 +A 5 =1, A 1 , A 2 , A 3 , A 4 and A 5 is the weight, and its specific value is set by the user. 2 is the second constant correction coefficient; When the environmental change index Cvr is higher than the environmental impact threshold, a second warning command is sent, indicating that the current environment is unqualified and unsuitable for collection, and these sub-areas are included in the first pending collection area.
4. The three-dimensional space modeling method based on drone mapping according to claim 1, Features: Prioritize the sub-areas where the environmental change index Cvr does not exceed the environmental impact threshold, and prepare for periodic data collection; collect the flight altitude data, route coverage data and flight attitude parameters of several drones in each sub-area in real time to establish a drone quality set; The drone quality set includes the following data: flight altitude value gdz, flight avoidance altitude difference value bhcz, route coverage area fgz, flight roll angle hgj, flight pitch angle fyj, flight yaw angle phj, and flight speed fxsd; after dimensionless processing, the coverage index Fgl and flight attitude coefficient Fxz are generated through the following consensus: Among them, bz6 represents the preset UAV wind altitude threshold, bz7 represents the preset flight risk avoidance altitude difference threshold, bz8 represents the preset flight coverage area threshold, 0<A 6 <1,0<A 7 <1,0<A 8 <1, and A 6 +A 7 +A 8 =1, A 6 , A 7 and A 8 is the weight, and its specific value is set by the user. 3 is the third constant correction coefficient; Wherein, ln3 represents the logarithm operation with base 3.
5. The three-dimensional space modeling method based on drone mapping according to claim 1, Features: Comparing the coverage index Fgl with a preset first threshold value to obtain a first evaluation result includes: When the coverage index Fgl is less than the preset first threshold, it indicates that the UAV flight coverage rate does not meet the standard; a first correction strategy is generated; When the coverage index Fgl ≥ the preset first threshold, it means that the UAV flight coverage rate meets the standard; The flight attitude coefficient Fxz is compared with a preset second threshold value to obtain a second evaluation result, including: When the flight attitude coefficient Fxz> the preset second threshold, it means that the flight attitude of the UAV does not meet the standard, which means that it deviates from the expected range and there is a safety risk, and the first correction strategy is generated; When the flight attitude coefficient Fxz≤the preset second threshold, it means that the flight attitude of the UAV meets the standard.
6. The three-dimensional space modeling method based on drone mapping according to claim 5, Features: The first correction strategy includes: replanning the flight path of the drone to focus on covering the uncovered area to ensure that the coverage rate meets the standard, and in the area where the coverage rate does not meet the standard, increasing the altitude of the drone by 20% to improve the coverage range; The second correction strategy includes: adjusting the flight attitude parameter data, including the flight roll angle hgj, the flight pitch angle fyj, the flight yaw angle phj and the flight speed fxsd, to avoid deviation from the expected range.
7. The three-dimensional space modeling method based on drone mapping according to claim 1, Features: After the first correction strategy and the second correction strategy are executed for correction, the drones in the plurality of sub-areas are re-imaged, and the first pending data set is associated with the first pending data set for fusion, and the second modeling data set is associated with the first pending data set for fusion, and the second modeling data set is re-modeled on the basis of the primary three-dimensional space model according to the calibrated second modeling data set, and the modeling includes data registration, filtering and reconstruction to generate final three-dimensional space modeling data; For the first pending collection area, after several consecutive sampling cycles, the real-time environment is re-collected, and when the environment change index Cvr does not exceed the environment impact threshold, steps S3-S5 are completed.
8. A three-dimensional space modeling system based on drone mapping, comprising the three-dimensional space modeling method based on drone mapping according to any one of claims 1 to 7, Features: It includes region segmentation and UAV configuration module, identification and judgment module, environmental data acquisition module, environmental analysis module, UAV flight data acquisition module, flight parameter analysis module, correction strategy generation module and secondary imaging and modeling module; The region segmentation and drone configuration module is used to segment the surveying and mapping area, configure a drone equipped with a sensor device in each sub-area, plan a flight path, ensure that each sub-area is imaged once in an orderly manner, and construct a first modeling data set; The recognition and judgment module is used to identify the resolution of the imaging data and the image correlation R between adjacent nodes for the first modeling data set, construct the image clarity coefficient Tx of each area, and send a first warning command when the image clarity does not meet the standard; The environmental data collection module is used to collect environmental data of each sub-area in real time, including weather, light, wind speed, humidity and visibility, and establish an environmental impact data set; The environmental analysis module is used to construct an environmental change index Cvr for each sub-area according to the environmental impact data set, and send a second warning command when the environmental change index is higher than a threshold; The UAV flight data collection module is used to preferentially select sub-areas whose environmental change index Cvr does not exceed the environmental impact threshold for periodic collection; collect UAV flight altitude data, route coverage data and flight attitude parameters of each sub-area in real time to establish a UAV quality set; The flight parameter analysis module is used to analyze and calculate the drone mass set to obtain a coverage index Fgl and a flight attitude coefficient Fxz; compare the coverage index Fgl with a preset first threshold to obtain a first evaluation result; and compare the flight attitude coefficient Fxz with a preset second threshold to obtain a second evaluation result; The correction strategy generation module is used to generate a first correction strategy and a second correction strategy according to the first evaluation result and the second evaluation result, and execute them; The secondary imaging and modeling module is used to perform secondary imaging based on the corrected UAV, construct a second modeling data set, and perform three-dimensional modeling based on the calibrated second modeling data set, including data alignment, filtering and reconstruction, to generate final three-dimensional space modeling data.
9. A storage medium, Features: The storage medium is used to store and execute program instructions of the three-dimensional space modeling method based on drone mapping as described in any one of claims 1 to 6.
