A method and platform for intelligent management of engineering surveying and mapping data
By collecting and integrating multi-source data in the intelligent management platform for engineering surveying and mapping data, and building dynamic models for spatial analysis, the problem that existing technology is difficult to meet the complex needs of disaster risk assessment is solved, and high-precision and credibility data management and Analytics enhances data sharing and interoperability.
Patent Information
- Application Number
- CN202410816253.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-24
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-06-24
AI Technical Summary
The existing intelligent management system for engineering surveying and mapping data is difficult to fully reflect multiple types of data in disaster risk assessment, especially complex spatial analysis and multivariate modeling requirements, and a single CAD data cannot meet the information needs of disaster risk assessment.
An intelligent management platform for engineering surveying and mapping data was designed, including multi-source data acquisition module, data quality management module, multi-source data fusion module, dynamic model construction module and spatial analysis module to collect and integrate surface data, meteorological data and hydrological data. Through dynamic model construction and spatial analysis, data integrity and accuracy indicators are calculated to provide comprehensive analysis results.
Improve the comprehensiveness and representativeness of the data, ensure high accuracy and availability of the data, fully reflect disaster risk information, enhance data sharing and interoperability through dynamic models and API interfaces, improve information readability and Practicality.
Smart Images

Figure CN118733998B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of surveying and mapping technology, and in particular to an intelligent management method and platform for engineering surveying and mapping data. Background Art
[0002] The background technology of the engineering surveying and mapping data intelligent platform is based on the development of modern surveying and mapping technology and information technology. Traditional surveying and mapping methods have problems such as cumbersome data processing, difficult to ensure accuracy and high labor costs. With the advancement of technologies such as GIS, remote sensing, GPS and LiDAR, the acquisition and processing of surveying and mapping data have become more efficient. However, the management and intelligent analysis of massive and multi-source data remain challenges. The intelligent platform integrates a variety of data acquisition, storage, analysis and visualization technologies to achieve efficient management and intelligent processing of data.
[0003] In the invention patent with application number 202310532394.4, the invention discloses an intelligent management system for engineering project surveying and mapping data, including: an acquisition unit, which obtains the engineering data model and the data surveying and mapping model; the model is CAD data; a classification unit, which obtains the model sub-area data information in the engineering data model and the data surveying and mapping model respectively; an analysis unit, which analyzes and judges the text, numbers and graphics in the surveying and mapping data, and then performs cross-level processing through the processing unit to generate corresponding signals, and a feedback unit, which obtains normal data signals, data verification signals and abnormal data signals. When the normal data signal is obtained, the abnormal part in the data surveying and mapping model is marked with red marking, and manual verification and calibration are performed; the present invention performs separate sub-area analysis on the surveying and mapping data, which is convenient for later data verification processing and judgment of test data to ensure the accuracy of surveying and mapping.
[0004] However, the above technical solutions still have some technical defects when applied to disaster risk assessment. However, in disaster risk assessment, multiple types of data are usually required, including remote sensing images, meteorological data, and hydrological data. Single CAD data cannot fully reflect all the information required for disaster risk. Moreover, disaster risk assessment involves complex spatial analysis and modeling, while the system mainly focuses on data classification and analysis and judgment of text, numbers, and graphics, which may not be sufficient to cope with complex spatial analysis and multivariate disaster model construction needs. Summary of the invention
[0005] Technical issues solved
[0006] In view of the deficiencies of the prior art, the present invention provides an intelligent management method and platform for engineering surveying and mapping data, which solves the problems encountered in the background technology.
[0007] Technical Solution
[0008] To achieve the above objectives, the present invention is implemented through the following technical solutions: an engineering surveying and mapping data intelligent management platform, including a multi-source data acquisition module, a data quality management module, a multi-source data fusion module, a dynamic model building module, a spatial analysis module and a data summary and intercommunication module;
[0009] The multi-source data acquisition module is used to collect surveying and mapping data used for disaster risk assessment in the region, including surface data, meteorological data and hydrological data, and to establish a surface data set, a meteorological data set and a hydrological data set respectively; and to pre-process all data at the same time;
[0010] The multi-source data fusion module is used to fuse data and analyze data integrity; obtain the data integrity index Wzzs by unifying and integrating data from different sources and then calculating; and evaluate the integrity index Wzzs using a data verification mechanism;
[0011] The data quality management module is used to clean and store surveying and mapping data; first, the surveying and mapping data is cleaned to eliminate errors and redundancies in the surveying and mapping data, and at the same time, the surveying and mapping data is analyzed and its data accuracy difference Szqx is calculated, and the data accuracy difference Szqx is evaluated through the data verification mechanism;
[0012] The dynamic model building module is used to build a model based on the fusion data; first determine the type of dynamic model to be built and the functional requirements, and after selecting the model, combine it, train and verify it and update it in real time;
[0013] The spatial analysis module is used to analyze data according to the dynamic model; through the dynamic model, the surface data, meteorological data and hydrological data are analyzed respectively;
[0014] The data summary and intercommunication module is used to display the data analysis results; and then use the open API interface to allow other systems to access the analysis results and data.
[0015] Preferably, the multi-source data acquisition module includes an acquisition unit and a preprocessing unit; the acquisition unit acquires surface data in the region through satellite remote sensing; acquires meteorological data by acquiring real-time meteorological data in the region and historical meteorological data in the past three years through a meteorological station; and acquires hydrological data in the region through a hydrological monitoring station;
[0016] The surface data include: vegetation coverage area Zbg, water volume Stj, bare land area Ldm, soil moisture Tsd and surface temperature Dbw;
[0017] The meteorological data include the monthly average precipitation Jsl, temperature Qw, cloud coverage Yfg and lightning frequency Ldp in the past three years;
[0018] The hydrological data include river flow velocity Hls, river flow Hll, water turbidity Szd and surface water temperature Dbs;
[0019] The preprocessing unit performs radiation correction and geometric correction preprocessing on the surface data collected by satellite remote sensing; and performs cleaning and noise removal preprocessing on the meteorological data and hydrological data.
[0020] Preferably, the multi-source data fusion module includes a data fusion unit and a first data analysis unit; the data fusion unit preprocesses the surveying and mapping data from multiple different sources, including denoising and removing redundant data, and then fuses the preprocessed data; the first data analysis unit constructs a complete surveying and mapping data set by extracting the fused data and performing dimensionless processing; the complete surveying and mapping data set includes a data source index Sjy, a collection space coverage area Kjmj, a data location accuracy Wzjd, and a data signal-to-noise ratio Sxzb.
[0021] Preferably, the surveying and mapping complete data set is obtained by extracting the data source index Sjy, the acquisition space coverage area Kjmj, the data location accuracy Wzjd and the data signal-to-noise ratio Sxzb, and calculating the data complete difference Swcz by the following formula:
[0022]
[0023] Wherein, w1, w2, w3 and w4 represent the weight values of data source index Sjy, acquisition space coverage area Kjmj, data location accuracy Wzjd and data signal-to-noise ratio Sxzb respectively, and 0≤w1<1, 0≤w2<1, 0≤w3<1, 0≤w4<1, w1+w2+w3+w4=1;
[0024] Sj x 、Kjmj x 、Wzjd x and Sxzb x They represent the data source index Sjy, the acquisition space coverage area Kjmj, the data location accuracy Wzjd and the data signal-to-noise ratio Sxzb at point x respectively; Kjmj max Indicates the maximum spatial coverage area of the target acquisition area; Wzjd min Indicates the accuracy of a certain reference position, taking the minimum accuracy value; Sxzb min represents a certain reference signal-to-noise ratio, taking the minimum signal-to-noise ratio value; x represents the integral variable, and dx represents a small increment of the integral variable x;
[0025] The first data analysis unit generates the following evaluation scheme by comparing the preset data integrity threshold Y and the data integrity difference Swcz:
[0026] If the data integrity threshold Y ≥ the data integrity difference Swcz, it means that the current data integrity is qualified, the difference is normal and within the fault tolerance range;
[0027] If the data integrity threshold Y is less than the data integrity difference Swcz, it means that the current data integrity is unqualified, the difference is abnormal and exceeds the fault tolerance range, and the missing data is supplemented at this time.
[0028] Preferably, the data quality management module includes a data preprocessing unit and a second data analysis unit; the data preprocessing unit standardizes the data format, unit and time in a sequential and step-by-step manner, and then geometrically fuses the data; the data analysis unit collects the sampling point density Cmd, the data acquisition frequency Scp, the data delay time Syc and the data repetition value Scf, and constructs an accurate surveying and mapping data set after dimensionless processing.
[0029] Preferably, the surveying and mapping accurate data set is obtained by extracting the sampling point density Cmd, the data acquisition frequency Scp, the data delay time Syc and the data repetition value Scf, and calculating the data accurate difference Szqx. The specific formula is as follows:
[0030]
[0031] Wherein, q1, q2, q3 and q4 represent the weight values of sampling point density Cmd, data acquisition frequency Scp, data delay time Syc and data repetition value Scf respectively, and 0≤q1<1, 0≤q2<1, 0≤q3<1, 0≤q4<1, q1+q2+q3+q4=1;
[0032] Cmd max Indicates the maximum value of sampling point density; Scp max Indicates the maximum value of data collection frequency; Syc max Indicates the maximum allowable value of data delay time; Scf max Indicates the maximum permissible value of data duplication;
[0033] The second data analysis unit generates the following evaluation scheme by comparing the preset data accuracy threshold Z with the data accuracy difference Szqx:
[0034] If the data accuracy threshold Z ≥ the data accuracy difference Szqx, it means that the current data accuracy is qualified, the difference is normal and within the fault tolerance range;
[0035] If the data accuracy threshold Z is less than the data accuracy difference Szqx, it means that the current data accuracy is unqualified, the difference is abnormal and exceeds the fault tolerance range. At this time, the data should be re-collected or corrected.
[0036] Preferably, the dynamic model construction module includes a model selection unit and a model training unit; the model selection unit is used to select a dynamic model for real-time monitoring and prediction of changes; the model training unit divides all data into training sets, validation sets and test sets in proportion through surface data sets, meteorological data sets and hydrological data sets; the training set is then used to train the model, adjust model parameters and hyperparameters, and the validation set is used to evaluate the model performance, and finally, based on the verification results, the model parameters are optimized and the model performance is improved; finally, cloud computing technology is used to embed the model into the surveying and mapping data intelligent management platform to monitor the surveying and mapping data in real time.
[0037] Preferably, the spatial analysis module extracts the surface data set, the meteorological data set and the hydrological data set respectively, normalizes the data, and calculates the surface index Dbzs, the meteorological index Qxzs and the hydrological index Swzs respectively by the following formulas:
[0038]
[0039] Swzs = Hls*Hll*Szd*Dbs;
[0040] The spatial analysis module generates the following analysis results by comparing the surface index Dbzs, the meteorological index Qxzs and the hydrological index Swzs:
[0041] If the surface index Dbzs>meteorological index Qxzs>hydrological index Swzs, this means that surface conditions, including vegetation cover, soil moisture and surface temperature, have the most significant impact on disaster risk assessment; followed by meteorological factors, and finally hydrological factors have the least impact;
[0042] If the meteorological index Qxzs> the hydrological index Swzs> the surface index Dbzs, this means that meteorological factors, including precipitation, temperature, cloud cover and lightning frequency, have the most significant impact on disaster risk assessment; followed by hydrological factors, and finally surface conditions have the least impact;
[0043] If the hydrological index Swzs> surface index Dbzs> meteorological index Qxzs, this means that hydrological factors, including river velocity, flow, water turbidity and surface water temperature, have the most significant impact on disaster risk assessment; followed by surface conditions, and finally meteorological factors have the least impact;
[0044] If the surface index Dbzs = meteorological index Qxzs = hydrological index Swzs, this means that the impacts of surface conditions, meteorological factors and hydrological factors on the study area are relatively balanced, and no one factor is significantly ahead of other factors in terms of impact.
[0045] Preferably, the data summary and intercommunication module obtains data through a data quality management module, a multi-source data fusion module and a spatial analysis module; and then obtains the latest data analysis results or queries data sets in real time by calling an API interface.
[0046] A method for intelligent management of engineering surveying and mapping data comprises the following steps:
[0047] Step 1: The multi-source data acquisition module is used to collect surveying and mapping data used for disaster risk assessment in the region, including surface data, meteorological data and hydrological data, and establish a surface data set, a meteorological data set and a hydrological data set respectively; and pre-process all data at the same time;
[0048] Step 2: The multi-source data fusion module fuses the data and analyzes the data integrity; obtains the data integrity index Wzzs by unifying and integrating the data from different sources and then calculating; and evaluates the integrity index Wzzs using the data verification mechanism;
[0049] Step 3: The data quality management module cleans and stores the surveying and mapping data; first, the surveying and mapping data is cleaned to eliminate errors and redundancies in the surveying and mapping data, and at the same time, the surveying and mapping data is analyzed and its data accuracy difference Szqx is calculated, and the data accuracy difference Szqx is evaluated through the data verification mechanism;
[0050] Step 4: The dynamic model building module builds the model by fusing the data; first determine the type of dynamic model to be built and the functional requirements, then select the model, combine it, train and verify it, and update it in real time;
[0051] Step 5: The spatial analysis module analyzes the data through a dynamic model; through the dynamic model, the surface data, meteorological data and hydrological data are analyzed respectively;
[0052] Step 6: The data summary intercommunication module is used to display the data analysis results; and then use the open API interface to allow other systems to access the analysis results and data.
[0053] Beneficial Effects
[0054] The present invention provides an intelligent management method and platform for engineering surveying and mapping data, which has the following beneficial effects:
[0055] (1) This intelligent management method and platform for engineering surveying and mapping data establishes three independent data sets by collecting surface data, meteorological data and hydrological data, covering multiple data sources and improving the comprehensiveness and representativeness of the data; preprocesses and integrates the collected data, calculates and evaluates the data integrity index Wzzs to quantify the data integrity; then calculates the data accuracy difference Szqx and evaluates the data accuracy through a verification mechanism to ensure the high accuracy and availability of the data, eliminate errors and redundancy in surveying and mapping data, improve the quality and credibility of the data, and fully reflect all the information required for disaster risks.
[0056] (2) This is an intelligent management method and platform for engineering surveying and mapping data. It monitors the space in real time through a dynamic model building module. It then uses a spatial analysis module to conduct a comprehensive analysis of surface data, meteorological data, and hydrological data. It calculates and evaluates the surface index Dbzs, meteorological index Qxzs, and hydrological index Swzs, and sorts and compares them to intuitively understand the impact of different factors on disaster risks. Through an open API interface, it allows other systems to access the analysis results and data, thereby enhancing the sharing and interoperability of data. Finally, the data analysis results are displayed, allowing decision makers to directly understand and use the information, thereby improving the readability and practicality of the information. BRIEF DESCRIPTION OF THE DRAWINGS
[0057] Figure 1 This is a schematic diagram of the framework structure of an engineering surveying and mapping data intelligent management platform of the present invention;
[0058] Figure 2 The present invention is a schematic diagram of the process structure of an intelligent management method for engineering surveying and mapping data. DETAILED DESCRIPTION
[0059] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0060] Example 1
[0061] See also Figure 1 , the present invention provides an engineering surveying and mapping data intelligent management platform, including a multi-source data acquisition module, a data quality management module, a multi-source data fusion module, a dynamic model building module, a spatial analysis module and a data summary and intercommunication module;
[0062] The multi-source data acquisition module is used to collect surveying and mapping data used for disaster risk assessment in the region, including surface data, meteorological data and hydrological data, and to establish a surface data set, a meteorological data set and a hydrological data set respectively; and to pre-process all data at the same time;
[0063] The multi-source data fusion module is used to fuse data and analyze data integrity; obtain the data integrity index Wzzs by unifying and integrating data from different sources and then calculating; and evaluate the integrity index Wzzs using a data verification mechanism;
[0064] The data quality management module is used to clean and store surveying and mapping data; first, the surveying and mapping data is cleaned to eliminate errors and redundancies in the surveying and mapping data, and at the same time, the surveying and mapping data is analyzed and its data accuracy difference Szqx is calculated, and the data accuracy difference Szqx is evaluated through the data verification mechanism;
[0065] The dynamic model building module is used to build a model based on the fusion data; first determine the type of dynamic model to be built and the functional requirements, and after selecting the model, combine it, train and verify it and update it in real time;
[0066] The spatial analysis module is used to analyze data according to the dynamic model; through the dynamic model, the surface data, meteorological data and hydrological data are analyzed respectively;
[0067] The data summary and intercommunication module is used to display the data analysis results; and then use the open API interface to allow other systems to access the analysis results and data.
[0068] In this embodiment, the multi-source data acquisition module is responsible for collecting and establishing data sets, and preprocessing all collected data; the data quality management module is responsible for analyzing surveying and mapping data and calculating its data accuracy difference Szqx, and evaluating the data accuracy difference Szqx through the data verification mechanism to ensure the accuracy of the data; the multi-source data fusion module is responsible for unified integration of data from different sources, and calculating the evaluation data integrity index Wzzs to ensure the integrity of all data; the dynamic model construction module is responsible for determining the type and functional requirements of the dynamic model to be constructed according to the needs of disaster risk assessment; the spatial analysis module is responsible for analyzing surface data, meteorological data and hydrological data respectively based on the dynamic model; the data summary and intercommunication module is responsible for displaying the data analysis results so that decision makers can intuitively understand and use this information.
[0069] Example 2
[0070] See also Figure 1The multi-source data acquisition module includes an acquisition unit and a preprocessing unit; the acquisition unit acquires surface data in the region through satellite remote sensing; acquires meteorological data through a meteorological station that acquires real-time meteorological data in the region and historical meteorological data in the past three years; and acquires hydrological data in the region through a hydrological monitoring station;
[0071] The surface data include: vegetation coverage area Zbg, water volume Stj, bare land area Ldm, soil moisture Tsd and surface temperature Dbw;
[0072] The meteorological data include the monthly average precipitation Jsl, temperature Qw, cloud coverage Yfg and lightning frequency Ldp in the past three years;
[0073] The hydrological data include river flow velocity Hls, river flow Hll, water turbidity Szd and surface water temperature Dbs;
[0074] The preprocessing unit performs radiation correction and geometric correction preprocessing on the surface data collected by satellite remote sensing; and performs cleaning and noise removal preprocessing on the meteorological data and hydrological data.
[0075] In this embodiment, the vegetation coverage area Zbg is used to evaluate the ecological environment and soil conservation capacity in the region. Vegetation coverage can slow down soil erosion and reduce the risk of landslides and mudslides. The water volume Stj is used to evaluate the distribution of water resources and its impact on regional ecosystems and human activities. Changes in water volume may indicate flood or drought risks. The bare land area Ldm is used to evaluate soil erosion and surface water flow paths. Large bare land areas may increase soil erosion risks and affect flood flow paths. Soil moisture Tsd is used to evaluate soil moisture conditions, which is very important for agricultural production and landslide risk assessment. Soils with high moisture are more prone to landslides. The surface temperature Dbw is used to monitor regional temperature changes and evaluate the heat island effect and its impact on regional climate and ecosystems.
[0076] Precipitation Jsl is used to assess regional precipitation patterns and flood risks. Changes in precipitation directly affect flood and drought risks. Temperature Qw is used to assess regional climate change and heat wave risks. Changes in temperature have important impacts on agriculture, ecosystems, and human health. Cloud coverage Yfg is used to assess regional sunshine duration and climate change. Cloud coverage affects surface temperature and precipitation. Lightning frequency Ldp is used to assess lightning disaster risks. Areas with high lightning frequencies are more likely to experience lightning strikes, affecting building and human safety.
[0077] River flow velocity Hls is used to assess the hydrodynamic characteristics and flood risks of rivers. Changes in flow velocity can reflect the hydrological dynamics of rivers and potential flood risks. River discharge Hll is used to assess changes in river water volume and predict floods and dry seasons. Discharge is an important indicator of river hydrological conditions and directly affects floods and water supply capacity. Water turbidity Szd is used to assess water quality and sediment transport. High water turbidity may indicate water pollution or high sediment content, affecting aquatic ecosystems and human water safety. Surface water temperature Dbs is used to assess the impact of water temperature changes on ecosystems. Water temperature changes affect the living environment of aquatic organisms and river water quality.
[0078] Example 3
[0079] See also Figure 1 The multi-source data fusion module includes a data fusion unit and a first data analysis unit; the data fusion unit pre-processes the surveying and mapping data from multiple different sources, including denoising and removing redundant data, and then fuses the pre-processed data; the first data analysis unit constructs a complete surveying and mapping data set by extracting the fused data and performing dimensionless processing; the complete surveying and mapping data set includes a data source index Sjy, a collection space coverage area Kjmj, a data location accuracy Wzjd, and a data signal-to-noise ratio Sxzb.
[0080] The complete surveying and mapping data set is obtained by extracting the data source index Sjy, the acquisition space coverage area Kjmj, the data location accuracy Wzjd and the data signal-to-noise ratio Sxzb, and calculating the data complete difference Swcz by the following formula:
[0081]
[0082] Wherein, w1, w2, w3 and w4 represent the weight values of data source index Sjy, acquisition space coverage area Kjmj, data location accuracy Wzjd and data signal-to-noise ratio Sxzb respectively, and 0≤w1<1, 0≤w2<1, 0≤w3<1, 0≤w4<1, w1+w2+w3+w4=1;
[0083] Sj x 、Kjmj x 、Wzjd x and Sxzb x They represent the data source index Sjy, the acquisition space coverage area Kjmj, the data location accuracy Wzjd and the data signal-to-noise ratio Sxzb at point x respectively; Kjmj max Indicates the maximum spatial coverage area of the target acquisition area; Wzjd min Indicates the accuracy of a certain reference position, taking the minimum accuracy value; Sxzb minrepresents a certain reference signal-to-noise ratio, taking the minimum signal-to-noise ratio value; x represents the integral variable, and dx represents a small increment of the integral variable x;
[0084] The first data analysis unit generates the following evaluation scheme by comparing the preset data integrity threshold Y and the data integrity difference Swcz:
[0085] If the data integrity threshold Y ≥ the data integrity difference Swcz, it means that the current data integrity is qualified, the difference is normal and within the fault tolerance range;
[0086] If the data integrity threshold Y is less than the data integrity difference Swcz, it means that the current data integrity is unqualified, the difference is abnormal and exceeds the fault tolerance range, and the missing data is supplemented at this time.
[0087] In this embodiment, by calculating the complete difference Swcz of the evaluation data, the missing data is completed to ensure the integrity of the data and improve the overall performance of the intelligent management platform for surveying and mapping data; the data source index Sjy represents the diversity and authority of the data source, which directly affects the credibility of the data. Reliable data sources can improve the quality and credibility of the data; the acquisition space coverage area Kjmj is used to understand the coverage of the data in the geographic space to ensure that the data can fully reflect the situation of the target area. The larger the coverage area, the more comprehensive the regional information that the data can reflect, which is helpful for comprehensive evaluation and analysis; the data position accuracy Wzjd represents the position accuracy, which directly affects the use effect and analysis results of the data. Higher spatial positioning accuracy improves the reliability and accuracy of the data. In disaster risk assessment, accurate location information is an important basis for accurate analysis and decision-making; the data signal-to-noise ratio Sxzb is used to evaluate the signal quality of the data. Data with a high signal-to-noise ratio has better quality and is used to provide more accurate surveying and mapping information. A higher signal-to-noise ratio indicates that the proportion of useful signals in the data is higher and the noise is less.
[0088] Example 4
[0089] See also Figure 1 The data quality management module includes a data preprocessing unit and a second data analysis unit; the data preprocessing unit standardizes the data format, unit and time in a sequential and step-by-step manner, and then geometrically fuses the data; the data analysis unit collects the sampling point density Cmd, the data acquisition frequency Scp, the data delay time Syc and the data repetition value Scf, and constructs an accurate surveying and mapping data set after dimensionless processing.
[0090] The surveying and mapping accurate data set is obtained by extracting the sampling point density Cmd, the data acquisition frequency Scp, the data delay time Syc and the data repetition value Scf, and calculating the data accurate difference Szqx. The specific formula is as follows:
[0091]
[0092] Wherein, q1, q2, q3 and q4 represent the weight values of sampling point density Cmd, data acquisition frequency Scp, data delay time Syc and data repetition value Scf respectively, and 0≤q1<1, 0≤q2<1, 0≤q3<1, 0≤q4<1, q1+q2+q3+q4=1;
[0093] Cmd max Indicates the maximum value of sampling point density; Scp max Indicates the maximum value of data collection frequency; Syc max Indicates the maximum allowable value of data delay time; Scf max Indicates the maximum permissible value of data duplication;
[0094] The second data analysis unit generates the following evaluation scheme by comparing the preset data accuracy threshold Z with the data accuracy difference Szqx:
[0095] If the data accuracy threshold Z ≥ the data accuracy difference Szqx, it means that the current data accuracy is qualified, the difference is normal and within the fault tolerance range;
[0096] If the data accuracy threshold Z is less than the data accuracy difference Szqx, it means that the current data accuracy is unqualified, the difference is abnormal and exceeds the fault tolerance range. At this time, the data should be re-collected or corrected.
[0097] In this embodiment, the sampling point density Cmd refers to the number of sampling points per unit area. The higher the sampling point density, the more detailed and precise the data collection in the area. The uniformly distributed high-density sampling points more comprehensively reflect the situation in the area and reduce data blind spots. The data collection frequency Scp refers to the number of times data collection is performed per unit time. The higher the frequency, the more timely the data update and the more real-time the situation reflected. High-frequency collection is used to provide continuous time series data to avoid data loss. The data delay time Syc refers to the time interval from data collection to data availability. The shorter the delay time, the faster the data processing and transmission, and the more timely the data. The delay time reflects the efficiency of data from collection to transmission and processing, which helps to optimize the data flow. The data repetition value Scf refers to the number of data items that appear repeatedly in the data set. The fewer the repetition values, the higher the uniqueness and validity of the data. Reducing the data repetition value ensures that each piece of data is independent and valid, avoids data redundancy, and optimizes data storage and processing.
[0098] Example 5
[0099] See also Figure 1The dynamic model construction module includes a model selection unit and a model training unit; the model selection unit is used to select a dynamic model for real-time monitoring and prediction of changes; the model training unit divides all data into training sets, validation sets and test sets in proportion through surface data sets, meteorological data sets and hydrological data sets; the training set is then used to train the model, adjust model parameters and hyperparameters, and the validation set is used to evaluate the model performance, and finally, according to the verification results, the model parameters are optimized and the model performance is improved; finally, cloud computing technology is used to embed the model into the surveying and mapping data intelligent management platform to monitor the surveying and mapping data in real time.
[0100] In this embodiment, through the dynamic model, the platform can monitor the surface, meteorological and hydrological data in real time, and promptly discover potential risks and abnormal situations; by training and optimizing the model, the platform can provide accurate data analysis and prediction results to support scientific decision-making and emergency management; by using cloud computing technology and cross-validation methods, it is ensured that the model has high performance and high stability, and can effectively respond to various complex data; through the construction and deployment of dynamic models, the platform realizes the intelligent management of surveying and mapping data, and improves the efficiency and accuracy of data processing and analysis.
[0101] Example 6
[0102] The spatial analysis module extracts the surface data set, meteorological data set and hydrological data set respectively, normalizes the data, and calculates the surface index Dbzs, meteorological index Qxzs and hydrological index Swzs respectively through the following formulas:
[0103]
[0104] Swzs = Hls*Hll*Szd*Dbs;
[0105] The spatial analysis module generates the following analysis results by comparing the surface index Dbzs, the meteorological index Qxzs and the hydrological index Swzs:
[0106] If the surface index Dbzs>meteorological index Qxzs>hydrological index Swzs, this means that surface conditions, including vegetation cover, soil moisture and surface temperature, have the most significant impact on disaster risk assessment; followed by meteorological factors, and finally hydrological factors have the least impact;
[0107] If the meteorological index Qxzs> the hydrological index Swzs> the surface index Dbzs, this means that meteorological factors, including precipitation, temperature, cloud cover and lightning frequency, have the most significant impact on disaster risk assessment; followed by hydrological factors, and finally surface conditions have the least impact;
[0108] If the hydrological index Swzs> surface index Dbzs> meteorological index Qxzs, this means that hydrological factors, including river velocity, flow, water turbidity and surface water temperature, have the most significant impact on disaster risk assessment; followed by surface conditions, and finally meteorological factors have the least impact;
[0109] If the surface index Dbzs = meteorological index Qxzs = hydrological index Swzs, this means that the impacts of surface conditions, meteorological factors and hydrological factors on the study area are relatively balanced, and no one factor is significantly ahead of other factors in terms of impact.
[0110] In this embodiment, when the surface index Dbzs>meteorological index Qxzs>hydrological index Swzs, this situation usually occurs in areas with dense vegetation, moist surface and suitable temperature; the quality of surface conditions directly affects soil stability and vegetation protection, and has a significant effect on preventing disasters such as landslides and mud-rock flows; although meteorological factors also have an impact, they are relatively small, and the impact of hydrological factors is the weakest;
[0111] When the meteorological index Qxzs> hydrological index Swzs> surface index Dbzs, this situation usually occurs in areas with drastic climate change or frequent extreme weather. Meteorological factors such as rainfall and temperature have a significant triggering effect on disasters, including floods and landslides caused by heavy rains; hydrological factors also have a greater impact in this case, because precipitation directly increases the amount and flow rate of rivers; the impact of surface conditions is relatively small;
[0112] When the hydrological index Swzs> the surface index Dbzs> the meteorological index Qxzs, this situation usually occurs in areas with large river water volume and turbulent water flow; hydrological factors have a significant impact on disasters such as floods and riverbank erosion, especially when the river water speed and flow are large; surface conditions also have a certain impact, because vegetation and soil conditions can alleviate the impact of floods; meteorological factors have less impact in this case;
[0113] When the surface index Dbzs = meteorological index Qxzs = hydrological index Swzs, this situation usually occurs in areas where the comprehensive impact of various environmental factors on disaster risks is equal; this may be because the surface conditions, meteorological conditions and hydrological conditions in the region are in a relatively stable state, with no obvious prominent influencing factors; in this state of equilibrium, various factors work together and make certain contributions to the triggering and impact of disasters.
[0114] Example 7
[0115] See also Figure 1 The data summary and communication module obtains data through the data quality management module, the multi-source data fusion module and the spatial analysis module; and then obtains the latest data analysis results or queries the data set in real time by calling the API interface.
[0116] In this embodiment, through the functions of the data summary and intercommunication module, efficient acquisition, integration and transmission of data are achieved, providing convenient data services for users, while also promoting data sharing and utilization, and improving the overall value and application efficiency of the system.
[0117] Example 8
[0118] A method for intelligent management of engineering surveying and mapping data, see Figure 2 , including the following steps:
[0119] Step 1: The multi-source data acquisition module is used to collect surveying and mapping data used for disaster risk assessment in the region, including surface data, meteorological data and hydrological data, and establish a surface data set, a meteorological data set and a hydrological data set respectively; and pre-process all data at the same time;
[0120] Step 2: The multi-source data fusion module fuses the data and analyzes the data integrity; obtains the data integrity index Wzzs by unifying and integrating the data from different sources and then calculating; and evaluates the integrity index Wzzs using the data verification mechanism;
[0121] Step 3: The data quality management module cleans and stores the surveying and mapping data; first, the surveying and mapping data is cleaned to eliminate errors and redundancies in the surveying and mapping data, and at the same time, the surveying and mapping data is analyzed and its data accuracy difference Szqx is calculated, and the data accuracy difference Szqx is evaluated through the data verification mechanism;
[0122] Step 4: The dynamic model building module builds the model by fusing the data; first determine the type of dynamic model to be built and the functional requirements, then select the model, combine it, train and verify it, and update it in real time;
[0123] Step 5: The spatial analysis module analyzes the data through a dynamic model; through the dynamic model, the surface data, meteorological data and hydrological data are analyzed respectively;
[0124] Step 6: The data summary intercommunication module is used to display the data analysis results; and then use the open API interface to allow other systems to access the analysis results and data.
[0125] In this embodiment, the ability to comprehensively assess regional disaster risks is achieved through a multi-source data acquisition module, a multi-source data fusion module, and a spatial analysis module; first, surface data, meteorological data, and hydrological data are acquired through the multi-source data acquisition module, and data quality is ensured during the preprocessing process; secondly, the multi-source data fusion module integrates data and calculates the data integrity index to ensure the comprehensiveness and consistency of the data; the data quality management module cleans and stores data, and evaluates data accuracy to ensure data credibility; the dynamic model construction module uses the fused data to establish a dynamic model, and continuously optimizes model performance through real-time training and verification; the spatial analysis module analyzes surface data, meteorological data, and hydrological data based on the dynamic model to provide a scientific basis for disaster risk assessment; finally, the data summary and intercommunication module displays the data analysis results to the external system through the API interface, thereby realizing the effective sharing and utilization of data; this method combines data science and intelligent technology to provide an efficient and accurate solution for engineering surveying and mapping management.
[0126] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. An intelligent management platform for engineering surveying and mapping data, characterized by: It includes multi-source data acquisition module, data quality management module, multi-source data fusion module, dynamic model building module, spatial analysis module and data summary and communication module; The multi-source data acquisition module is used to collect surveying and mapping data used for disaster risk assessment in the region, including surface data, meteorological data and hydrological data, and to establish a surface data set, a meteorological data set and a hydrological data set respectively; and to pre-process all data at the same time; The multi-source data fusion module is used to fuse data and analyze data integrity; by unifying and integrating data from different sources and then calculating, the data integrity index Wzzs is obtained; Evaluate the complete index Wzzs using data verification mechanism; The data quality management module is used to clean and store surveying and mapping data; first, the surveying and mapping data is cleaned to eliminate errors and redundancies in the surveying and mapping data, and at the same time, the surveying and mapping data is analyzed and its data accuracy difference Szqx is calculated, and the data accuracy difference Szqx is evaluated through the data verification mechanism; The dynamic model building module is used to build a model based on the fusion data; first determine the type of dynamic model to be built and the functional requirements, and after selecting the model, combine it, train and verify it and update it in real time; The spatial analysis module is used to analyze data according to the dynamic model; through the dynamic model, the surface data, meteorological data and hydrological data are analyzed respectively; The data summary and intercommunication module is used to display the data analysis results; and then use the open API interface to allow other systems to access the analysis results and data; The multi-source data acquisition module includes an acquisition unit and a pre-processing unit; the acquisition unit acquires surface data in the region through satellite remote sensing; Obtain meteorological data through the meteorological station to collect real-time meteorological data in the region and historical meteorological data in the past three years; Collect hydrological data in the region through hydrological monitoring stations; The surface data include: vegetation coverage area Zbg, water volume Stj, bare land area Ldm, soil moisture Tsd and surface temperature Dbw; The meteorological data include the monthly average precipitation Jsl, temperature Qw, cloud coverage Yfg and lightning frequency Ldp in the past three years; The hydrological data include river flow velocity Hls, river flow Hll, water turbidity Szd and surface water temperature Dbs; The preprocessing unit performs radiation correction and geometric correction preprocessing on the surface data collected by satellite remote sensing; and performs cleaning and noise removal preprocessing on the meteorological data and hydrological data; The multi-source data fusion module includes a data fusion unit and a first data analysis unit; the data fusion unit pre-processes the surveying and mapping data from multiple different sources, including denoising and removing redundant data, and then fuses the pre-processed data; the first data analysis unit extracts the fused data and constructs a complete surveying and mapping data set after dimensionless processing; the complete surveying and mapping data set includes a data source index Sjy, a collection space coverage area Kjmj, a data location accuracy Wzjd, and a data signal-to-noise ratio Sxzb; The complete surveying and mapping data set is obtained by extracting the data source index Sjy, the acquisition space coverage area Kjmj, the data location accuracy Wzjd and the data signal-to-noise ratio Sxzb, and calculating the data complete difference Swcz by the following formula: Where w1, w2, w3 and w4 represent the weight values of data source index Sjy, acquisition space coverage area Kjmj, data location accuracy Wzjd and data signal-to-noise ratio Sxzb, respectively, and 0≤w1<1, 0≤w2<1, 0≤w3<1, 0≤w4<1, w1+w2+w3+w4=1; Sj x 、Kjmj x 、Wzjd x and Sxzb x They represent the data source index Sjy, the acquisition space coverage area Kjmj, the data location accuracy Wzjd and the data signal-to-noise ratio Sxzb at point x respectively; Kjmj max Indicates the maximum spatial coverage area of the target acquisition area; Wzjd min Indicates the accuracy of a certain reference position, taking the minimum accuracy value; Sxzb min represents a certain reference signal-to-noise ratio, taking the minimum signal-to-noise ratio value; x represents the integral variable, and dx represents a small increment of the integral variable x; The first data analysis unit generates the following evaluation scheme by comparing the preset data integrity threshold Y and the data integrity difference Swcz: If the data integrity threshold Y ≥ the data integrity difference Swcz, it means that the current data integrity is qualified, the difference is normal and within the fault tolerance range; If the data integrity threshold Y is less than the data integrity difference Swcz, it means that the current data integrity is unqualified, the difference is abnormal and exceeds the fault tolerance range, and the missing data is supplemented at this time; The data quality management module includes a data preprocessing unit and a second data analysis unit; the data preprocessing unit performs format standardization, unit standardization and time standardization on the data in order and then performs geometric fusion on the data; the data analysis unit collects the sampling point density Cmd, the data acquisition frequency Scp, the data delay time Syc and the data repetition value Scf, and constructs an accurate surveying and mapping data set after dimensionless processing; The surveying and mapping accurate data set is obtained by extracting the sampling point density Cmd, the data acquisition frequency Scp, the data delay time Syc and the data repetition value Scf, and calculating the data accurate difference Szqx. The specific formula is as follows: Where q1, q2, q3 and q4 represent the weight values of sampling point density Cmd, data acquisition frequency Scp, data delay time Syc and data repetition value Scf respectively, and 0≤q1<1, 0≤q2<1, 0≤q3<1, 0≤q4<1, q1+q2+q3+q4=1; Cmd max Indicates the maximum value of sampling point density; Scp max Indicates the maximum value of data collection frequency; Syc max Indicates the maximum allowable value of data delay time; Scf max Indicates the maximum permissible value of data duplication; The second data analysis unit generates the following evaluation scheme by comparing the preset data accuracy threshold Z with the data accuracy difference Szqx: If the data accuracy threshold Z ≥ the data accuracy difference Szqx, it means that the current data accuracy is qualified, the difference is normal and within the fault tolerance range; If the data accuracy threshold Z is less than the data accuracy difference Szqx, it means that the current data accuracy is unqualified, the difference is abnormal and exceeds the fault tolerance range. At this time, the data should be re-collected or corrected.
2. The intelligent management platform for engineering surveying and mapping data according to claim 1, characterized in that: The dynamic model construction module includes a model selection unit and a model training unit; the model selection unit is used to select a dynamic model for real-time monitoring and prediction of changes; the model training unit divides all data into training sets, validation sets and test sets in proportion through surface data sets, meteorological data sets and hydrological data sets; the training set is then used to train the model, adjust model parameters and hyperparameters, and the validation set is used to evaluate the model performance, and finally, based on the verification results, the model parameters are optimized and the model performance is improved; finally, cloud computing technology is used to embed the model into the surveying and mapping data intelligent management platform to monitor the surveying and mapping data in real time.
3. The intelligent management platform for engineering surveying and mapping data according to claim 1, characterized in that: The spatial analysis module extracts the surface data set, meteorological data set and hydrological data set respectively, normalizes the data, and calculates the surface index Dbzs, meteorological index Qxzs and hydrological index Swzs respectively through the following formulas: The spatial analysis module generates the following analysis results by comparing the surface index Dbzs, the meteorological index Qxzs and the hydrological index Swzs: If the surface index Dbzs>meteorological index Qxzs>hydrological index Swzs, this means that surface conditions, including vegetation cover, soil moisture and surface temperature, have the most significant impact on disaster risk assessment; followed by meteorological factors, and finally hydrological factors have the least impact; If the meteorological index Qxzs> the hydrological index Swzs> the surface index Dbzs, this means that meteorological factors, including precipitation, temperature, cloud cover and lightning frequency, have the most significant impact on disaster risk assessment; followed by hydrological factors, and finally surface conditions have the least impact; If the hydrological index Swzs> surface index Dbzs> meteorological index Qxzs, this means that hydrological factors, including river velocity, flow, water turbidity and surface water temperature, have the most significant impact on disaster risk assessment; followed by surface conditions, and finally meteorological factors have the least impact; If the surface index Dbzs=meteorological index Qxzs=hydrological index Swzs, this means that the impacts of surface conditions, meteorological factors and hydrological factors on the study area are relatively balanced, and no one factor is significantly ahead of other factors in impact.
4. The intelligent management platform for engineering surveying and mapping data according to claim 1, characterized in that: The data summary and communication module obtains data through the data quality management module, the multi-source data fusion module and the spatial analysis module; Then, by calling the API interface, you can obtain the latest data analysis results or query data sets in real time.
5. A method for intelligent management of engineering surveying and mapping data, according to any one of the intelligent management platforms for engineering surveying and mapping data according to claims 1 to 4, characterized in that: The following steps are involved: Step 1: The multi-source data acquisition module is used to collect surveying and mapping data used for disaster risk assessment in the region, including surface data, meteorological data and hydrological data, and establish a surface data set, a meteorological data set and a hydrological data set respectively; and pre-process all data at the same time; Step 2: The multi-source data fusion module fuses the data and analyzes the data integrity; the data from different sources are unified and integrated and then calculated to obtain the data integrity index Wzzs; Evaluate the complete index Wzzs using data verification mechanism; Step 3: The data quality management module cleans and stores the surveying and mapping data; first, the surveying and mapping data is cleaned to eliminate errors and redundancies in the surveying and mapping data, and at the same time, the surveying and mapping data is analyzed and its data accuracy difference Szqx is calculated, and the data accuracy difference Szqx is evaluated through the data verification mechanism; Step 4: The dynamic model building module builds the model by fusing the data; first determine the type of dynamic model to be built and the functional requirements, then select the model, combine it, train and verify it, and update it in real time; Step 5: The spatial analysis module analyzes the data through a dynamic model; through the dynamic model, the surface data, meteorological data and hydrological data are analyzed respectively; Step 6: The data summary intercommunication module is used to display the data analysis results; and then use the open API interface to allow other systems to access the analysis results and data.
Citation Information
Patent Citations
Engineering project surveying and mapping data intelligent management system
CN116302624A
Three-dimensional topographic surveying and mapping method and system
CN117152371A
Urban underground space intelligent surveying and mapping method and system
CN117272191A
Meteorological big data fusion method based on deep learning
US20230351164A1
