A land surveying and mapping data management method and system based on data error analysis
By constructing a surveying data tower, a retrospective data tower, and a personnel file tower, three-dimensional spatial coordinate system mapping and error repair are carried out, and layered data storage and error processing are performed. This solves the problems of chaotic data storage and difficulty in error tracing in land surveying data management, and achieves high-precision and reliable data management.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-30
- Publication Date
- 2026-03-24
AI Technical Summary
Existing land surveying data management methods and systems are susceptible to the effects of equipment status, environmental factors, and personnel operation. They lack a hierarchical processing mechanism for systematic and random errors and a full-process traceability mechanism, resulting in chaotic data storage and making it difficult to trace the source of errors and control data quality.
Construct a surveying data tower, a retrospective data tower, and a personnel file tower. Through three-dimensional spatial coordinate system mapping and error repair reference line segment analysis, perform multi-dimensional data storage and association, conduct primary and fine error processing, set error reduction rate thresholds for hierarchical storage, and associate error analysis process information with personnel file information for data reconstruction.
It enables the systematic storage and association of multi-dimensional data, improves the standardization and traceability of data management, reduces data collection errors, improves data accuracy and flexibility, and enhances data reliability and decision support capabilities.
Smart Images

Figure CN120523806B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of data processing technology, specifically to a land surveying data management method and system based on data error analysis. Background Technology
[0002] With the continuous development of land surveying technology, the accuracy and reliability of land surveying data have become particularly important. However, due to factors such as surveying equipment, environmental factors, and human operation, errors inevitably occur in land surveying data.
[0003] Existing land surveying data management methods and systems based on data error analysis are susceptible to errors caused by equipment status, environmental factors, and human operation. They lack hierarchical processing and full-process traceability mechanisms for systematic and random errors, and also lack multi-dimensional data correlation, resulting in chaotic data storage and making it difficult to trace the source of errors and control data quality. Therefore, it is necessary to provide a land surveying data management method and system based on data error analysis to solve the above-mentioned problems. Summary of the Invention
[0004] To address the aforementioned technical problems, this paper provides a land surveying data management method and system based on data error analysis. This technical solution solves the problems mentioned in the background section, such as the lack of hierarchical processing and full-process traceability mechanism for systematic and random errors in existing technologies, as well as the lack of multi-dimensional data correlation, which leads to chaotic data storage and makes it difficult to trace the source of errors and control data quality.
[0005] To achieve the above objectives, the technical solution adopted by the present invention is as follows:
[0006] A land surveying data management method based on data error analysis includes:
[0007] Determine the location information of the management target, and construct a surveying data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target;
[0008] Acquire the original surveying data, original equipment status data, and original environmental data corresponding to the location information of the management target;
[0009] Based on the management target location information, raw surveying data, raw equipment status data, and raw environmental data, the raw surveying data is stored in the surveying data tower;
[0010] Error analysis is performed on the raw surveying data of the surveying data tower to obtain information on the error analysis process and the error analysis results.
[0011] Based on the error analysis results, the original surveying and mapping data are processed in layers and simultaneously stored in the surveying and mapping data tower.
[0012] The error analysis process information is filtered, and the filtered error analysis process information is stored in the backtracking data tower;
[0013] Based on the surveying data tower, retrospective data tower, and personnel file tower, the data loop in the surveying data tower is reconstructed to obtain the standard surveying data tower.
[0014] In an optional embodiment, determining the location information of the management target and constructing a mapping data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target specifically includes:
[0015] Based on the location information of the management target, obtain the personnel file information for the surveying and mapping of the management target location;
[0016] Obtain the historical operation error rate corresponding to the personnel file information of the surveying and mapping team, and establish personnel skill files;
[0017] At least three hierarchical databases are constructed based on PostgreSQL and PostGIS. These hierarchical databases are named to obtain the surveying data tower, the retrospective data tower, and the personnel file tower.
[0018] The surveying data tower is divided into layers 1 to C. The first layer is the raw data layer, the second layer is the basic processing layer, the third layer is the result data layer, the fourth layer is the application service layer, and layers 5 to C are all version data management layers. The personnel file tower is used to store personnel skill files and personnel file information.
[0019] In an optional embodiment, storing the original surveying data in the surveying data tower based on the management target location information, original surveying data, original equipment status data, and original environmental data specifically includes:
[0020] Based on the location information of the management target, a graphic of the management target area is constructed, and the geometric centroid position of the graphic of the management target area is obtained simultaneously;
[0021] A three-dimensional spatial coordinate system is established with the geometric centroid of the target area graphic as the origin to obtain the acquisition location of the original surveying data;
[0022] The original survey data acquisition location is simultaneously mapped to a three-dimensional spatial coordinate system to obtain the coordinates of the original survey data acquisition location in the three-dimensional spatial coordinate system, which are denoted as the original survey mapping coordinates.
[0023] Acquire the original surveying data, original equipment status data, and original environmental data corresponding to the original surveying mapping coordinates, and simultaneously acquire the original equipment type information of the original surveying data corresponding to the original surveying mapping coordinates;
[0024] Based on the original equipment type information, original equipment status data, and original environmental data, the first data error impact matrix is determined.
[0025] Based on the first data error influence matrix, the management target area graphic is divided into management target area sub-graphics;
[0026] Select at least one point in the sub-graphics of the management target area. And obtain the original surveying data, original equipment status data and original environmental data corresponding to the coordinates of the point, and record them as the first original surveying data, the first original equipment status data and the first original environmental data;
[0027] Determine the points within the region corresponding to the sub-graphic of the management target area. Points on the same reference frame and obtain points The corresponding original surveying data, original equipment status data, and original environmental data are denoted as the second original surveying data, the second original equipment status data, and the second original environmental data.
[0028] Points in a three-dimensional coordinate system and points Connect the lines to obtain the first error repair reference line segment, and obtain the length of the first error repair reference line segment;
[0029] Synchronously acquire mapping information that maps the acquisition location of the original survey data to the three-dimensional spatial coordinate system;
[0030] Determine the reference line segment corresponding to the first error correction reference line segment in the management target location, and re-map the reference line segment to obtain standard mapping data;
[0031] Obtain the coordinate information corresponding to the first error correction reference line segment in the three-dimensional spatial coordinate system, and correct the mapping information of the acquisition position of the original survey data to the three-dimensional spatial coordinate system by combining it with the standard survey data to obtain the standard mapping information;
[0032] Using standard mapping information, the acquisition location of the original surveying data is remapped to a three-dimensional spatial coordinate system, and metadata corresponding to the original surveying data is generated synchronously, including the coordinates of the original surveying data in the three-dimensional spatial coordinate system and standard mapping information. The standard mapping information includes projection method, scale and mapping date.
[0033] Metadata is used as the data header, and raw surveying data, raw equipment status data, and raw environmental data are used as the data body and stored in the surveying data tower. Each piece of raw surveying data is stored in a surveying data ring in the surveying data tower.
[0034] In an optional embodiment, the step of performing error analysis on the raw surveying data of the surveying data tower to obtain error analysis process information and error analysis result information specifically includes:
[0035] The original surveying data within the surveying data loop in the surveying data tower are extracted sequentially, and the original surveying data undergoes primary error processing, including systematic error elimination and random error elimination.
[0036] The original mapping data that has undergone primary error processing is then subjected to fine error processing, and error analysis process information of primary and fine error processing is generated simultaneously.
[0037] Based on the error analysis process information, record the error analysis results.
[0038] In an optional embodiment, the step of performing layered processing on the original surveying and mapping data based on error analysis results and simultaneously storing it in the surveying and mapping data tower specifically includes:
[0039] Based on the error analysis results, trace the error analysis process information corresponding to the original surveying and mapping data;
[0040] If the original surveying data in the error analysis process information has undergone primary error processing and then fine error processing, then the original surveying data will be stored in the result data layer of the surveying data tower.
[0041] If the original surveying data in the error analysis process information has undergone primary error processing but not fine error processing, then the original surveying data will be stored in the basic processing layer of the surveying data tower.
[0042] After all the original surveying data have undergone primary error processing and fine error processing, the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower is obtained, and the error reduction rate threshold is set simultaneously.
[0043] If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower is greater than the error reduction rate threshold, then the surveying data will be stored in the application service layer of the surveying data tower.
[0044] In an optional embodiment, the step of filtering the error analysis process information and storing the filtered error analysis process information in the backtracking data tower specifically includes:
[0045] Obtain the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower. If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower exists and is not 0, then store the error analysis process information of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower into the retrospective data tower. If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower does not exist, then do not store the error analysis process information of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower into the retrospective data tower.
[0046] In an optional embodiment, the reconstruction of the data loop in the surveying data tower based on the surveying data tower, the retrospective data tower, and the personnel file tower to obtain a standard surveying data tower specifically includes:
[0047] Sequentially acquire the surveying data rings in the surveying data tower, and simultaneously acquire the metadata corresponding to the surveying data rings;
[0048] Associate the error analysis process information in the retrospective data tower with the metadata corresponding to the surveying data in the surveying data tower;
[0049] The personnel file information corresponding to the surveying data in the personnel file tower and the surveying data ring is stored in the metadata, and the data ring in the surveying data tower is reconstructed to obtain the standard surveying data tower.
[0050] Furthermore, a land surveying and mapping data management system based on data error analysis is proposed to implement any of the management methods described above, including:
[0051] The acquisition module is used to determine the location information of the management target and to acquire the original surveying data, original equipment status data and original environmental data corresponding to the location information of the management target.
[0052] The management module is used to construct a surveying data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target, and to manage the surveying data tower, the retrospective data tower, and the personnel file tower. It is also used to reconstruct the data loop in the surveying data tower based on the surveying data tower, the retrospective data tower, and the personnel file tower to obtain a standard surveying data tower.
[0053] The data processing module is used to perform error analysis on the original surveying data of the surveying data tower, obtain error analysis process information and error analysis result information, perform hierarchical processing on the original surveying data based on the error analysis result information, and synchronously store it in the surveying data tower. It is used to filter the error analysis process information and store the filtered error analysis process information in the backtracking data tower.
[0054] The display module is used to present the land surveying data management process and results to the user.
[0055] In an optional embodiment, the management module includes:
[0056] A data tower construction unit, which is used to construct a mapping data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target;
[0057] The data tower management unit is used to manage the surveying data tower, the retrospective data tower, and the personnel file tower.
[0058] The data tower reconstruction unit is used to reconstruct the data loop in the surveying data tower based on the surveying data tower, the retrospective data tower, and the personnel file tower, so as to obtain a standard surveying data tower.
[0059] In an optional embodiment, the data processing module includes:
[0060] An error processing unit is used to perform error analysis on the raw surveying data of the surveying data tower to obtain error analysis process information and error analysis result information.
[0061] A hierarchical processing unit is used to perform hierarchical processing on the original surveying and mapping data based on error analysis results, and simultaneously store the data in the surveying and mapping data tower.
[0062] An error filtering unit is used to filter error analysis process information and store the filtered error analysis process information in a backtracking data tower.
[0063] Compared with the prior art, the beneficial effects of the present invention are:
[0064] This solution proposes a land surveying data management method based on data error analysis. By constructing a surveying data tower, a retrospective data tower, and a personnel file tower and managing them in a hierarchical manner, it realizes the systematic storage and association of multi-dimensional data. Its advantage lies in the ability to clearly trace the relationship between personnel skills, equipment status, and data errors, thereby improving the standardization and traceability of data management.
[0065] This solution proposes a land surveying data management method based on data error analysis. Through mapping and error repair reference line segment analysis based on a three-dimensional spatial coordinate system, it achieves accurate positioning and mapping correction of the original surveying data acquisition location. Its advantage lies in reducing data acquisition errors from a spatial dimension and improving the spatial coordinate accuracy of the original data.
[0066] This solution proposes a land surveying data management method based on data error analysis. By performing primary error processing (elimination of systematic and random errors) and fine error processing on the original surveying data, it achieves hierarchical analysis and targeted elimination of errors. Its advantage lies in constructing a complete error control chain from basic processing to output, thereby improving data accuracy.
[0067] This solution proposes a land surveying data management method based on data error analysis. By setting an error reduction rate threshold and storing data in layers (raw data layer, result data layer, application service layer, etc.), it achieves hierarchical data management according to accuracy. The advantage is that it meets the differentiated data accuracy requirements of different application scenarios and enhances the flexibility of data application.
[0068] This solution proposes a land surveying data management method based on data error analysis. By associating error analysis process information, personnel file information, and data ring metadata, data reconstruction is achieved, realizing the generation of a standard surveying data tower. Its advantage lies in integrating multi-source data to form standardized results, improving data reliability and decision support capabilities. Attached Figure Description
[0069] Figure 1 This is a flowchart of a land surveying data management method based on data error analysis proposed in this invention;
[0070] Figure 2 This is a flowchart of the process for obtaining the first data error influence matrix in this invention;
[0071] Figure 3 This is a flowchart of storing raw surveying data into a surveying data tower in this invention;
[0072] Figure 4 This is a system framework diagram of a land surveying and mapping data management system based on data error analysis proposed in this invention. Detailed Implementation
[0073] The following description is intended to disclose the invention and enable those skilled in the art to implement it. The preferred embodiments described below are merely examples, and other obvious variations will occur to those skilled in the art.
[0074] Reference Figure 1 - Figure 4 As shown, a land surveying data management method based on data error analysis includes:
[0075] Determine the location information of the management target, and construct a surveying data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target;
[0076] Acquire the original surveying data, original equipment status data, and original environmental data corresponding to the location information of the management target;
[0077] Based on the management target location information, raw surveying data, raw equipment status data, and raw environmental data, the raw surveying data is stored in the surveying data tower;
[0078] Error analysis is performed on the raw surveying data of the surveying data tower to obtain information on the error analysis process and the error analysis results.
[0079] Based on the error analysis results, the original surveying and mapping data are processed in layers and simultaneously stored in the surveying and mapping data tower.
[0080] The error analysis process information is filtered, and the filtered error analysis process information is stored in the backtracking data tower;
[0081] Based on the surveying data tower, retrospective data tower, and personnel file tower, the data loop in the surveying data tower is reconstructed to obtain the standard surveying data tower.
[0082] Furthermore, the location information of the management target is determined, and a surveying data tower, a retrospective data tower, and a personnel file tower are constructed based on the location information of the management target, specifically including:
[0083] Based on the location information of the management target, obtain the personnel file information for the surveying and mapping of the management target location;
[0084] Obtain the historical operation error rate corresponding to the personnel file information of the surveying and mapping team, and establish personnel skill files;
[0085] At least three hierarchical databases are constructed based on PostgreSQL and PostGIS. These hierarchical databases are named to obtain the surveying data tower, the retrospective data tower, and the personnel file tower.
[0086] The surveying data tower is divided into layers 1 to C. The first layer is the raw data layer, the second layer is the basic processing layer, the third layer is the result data layer, the fourth layer is the application service layer, and layers 5 to C are all version data management layers. The personnel file tower is used to store personnel skill files and personnel file information.
[0087] Specifically, the management target location is an area within land surveying operations, where corresponding personnel are assigned for surveying management. The management target location information refers to the specific geospatial location information requiring land surveying and data management, serving as the core benchmark for the entire management methodology. By linking the management target location information to personnel scheduling records for surveying projects, basic information (such as name, employee ID, and position), qualification certificates (such as surveying operation certificate number and professional level), and project experience (such as names of similar projects participated in) of personnel involved in surveying the area are extracted from the human resource management system or project archives. Layers 5 to C of the surveying data tower store different versions of surveying data, with each layer supporting independent version management (e.g., V1.0, V2.0). The retrospective data tower specifically stores error analysis process information (such as error correction records and quality inspection reports) for subsequent auditing or problem tracing. The personnel file tower stores personnel skill files and is linked to work records in the surveying data tower (e.g., the measurement of a land boundary point was completed by "Zhang San," with an error rate of 2%).
[0088] Understandably, this step, through the digitization of personnel files, the structuring of error data, and the hierarchical design of the database, has constructed a comprehensive management system encompassing "people, machines, materials, methods, and environment." This not only solves the core problems of "unclear personnel responsibilities, difficulty in tracing errors, and chaotic data versions" in traditional surveying and mapping data management, but also lays the data foundation for intelligent surveying and mapping (such as AI-assisted error prediction and personnel skill profiling).
[0089] Furthermore, based on the management target location information, raw surveying data, raw equipment status data, and raw environmental data, the raw surveying data is stored in the surveying data tower, specifically including:
[0090] Based on the location information of the management target, a graphic of the management target area is constructed, and the geometric centroid position of the graphic of the management target area is obtained simultaneously;
[0091] A three-dimensional spatial coordinate system is established with the geometric centroid of the target area graphic as the origin to obtain the acquisition location of the original surveying data;
[0092] The original survey data acquisition location is simultaneously mapped to a three-dimensional spatial coordinate system to obtain the coordinates of the original survey data acquisition location in the three-dimensional spatial coordinate system, which are denoted as the original survey mapping coordinates.
[0093] Acquire the original surveying data, original equipment status data, and original environmental data corresponding to the original surveying mapping coordinates, and simultaneously acquire the original equipment type information of the original surveying data corresponding to the original surveying mapping coordinates;
[0094] Based on the original equipment type information, original equipment status data, and original environmental data, the first data error impact matrix is determined.
[0095] Based on the first data error influence matrix, the management target area graphic is divided into management target area sub-graphics;
[0096] Select at least one point in the sub-graphics of the management target area. And obtain the original surveying data, original equipment status data and original environmental data corresponding to the coordinates of the point, and record them as the first original surveying data, the first original equipment status data and the first original environmental data;
[0097] Determine the points within the region corresponding to the sub-graphic of the management target area. Points on the same reference frame and obtain points The corresponding original surveying data, original equipment status data, and original environmental data are denoted as the second original surveying data, the second original equipment status data, and the second original environmental data.
[0098] Points in a three-dimensional coordinate system and points Connect the lines to obtain the first error repair reference line segment, and obtain the length of the first error repair reference line segment;
[0099] Synchronously acquire mapping information that maps the acquisition location of the original survey data to the three-dimensional spatial coordinate system;
[0100] Determine the reference line segment corresponding to the first error correction reference line segment in the management target location, and re-map the reference line segment to obtain standard mapping data;
[0101] Obtain the coordinate information corresponding to the first error correction reference line segment in the three-dimensional spatial coordinate system, and correct the mapping information of the acquisition position of the original survey data to the three-dimensional spatial coordinate system by combining it with the standard survey data to obtain the standard mapping information;
[0102] Using standard mapping information, the acquisition location of the original surveying data is remapped to a three-dimensional spatial coordinate system, and metadata corresponding to the original surveying data is generated synchronously, including the coordinates of the original surveying data in the three-dimensional spatial coordinate system and standard mapping information. The standard mapping information includes projection method, scale and mapping date.
[0103] Metadata is used as the data header, and raw surveying data, raw equipment status data, and raw environmental data are used as the data body and stored in the surveying data tower. Each piece of raw surveying data is stored in a surveying data ring in the surveying data tower.
[0104] Specifically, when constructing the graphics and coordinate system of the management target area, polygons, rectangles, and other graphics of the management target area are drawn in GIS software based on the location information of the management target (such as administrative boundaries and land parcel red lines). Geometric algorithms (such as centroid calculation) are used to obtain the geometric centroid position of the graphics, which is used as the origin of the three-dimensional spatial coordinate system (X-axis is eastward, Y-axis is northward, and Z-axis is elevation).
[0105] During the spatial mapping and error matrix construction of the original data, the original coordinates (latitude and longitude / planar coordinates) collected by devices such as GPS and total stations are converted into three-dimensional coordinates (original surveying and mapping coordinates) with the geometric centroid as the origin. The original data is associated with the device type (e.g., Trimble R10), device status (e.g., battery level, number of satellites), and environmental data (e.g., temperature, wind speed), and a matrix algorithm is used to generate the first data error influence matrix (rows: error factors, columns: error values). By using a three-dimensional coordinate system with the geometric centroid as the origin, original data collected by different devices at different times are converted into a unified spatial reference, solving the problem of inconsistent coordinates among multi-source data (e.g., the conversion error between GPS WGS84 coordinates and local coordinate systems). The first data error influence matrix integrates device status (e.g., total station distance measurement error) and environmental factors (e.g., the influence of temperature on steel tape distance measurement), quantifying the contribution of each factor to the data error and providing a scientific basis for regional division. For example, in mountainous areas (complex environment), high-error sub-maps are defined, increasing the number of observations; in plains areas (stable environment), low-error sub-maps are defined, using a rapid surveying mode.
[0106] When dividing the area and generating the error correction reference line segment, the management target area is divided into several sub-shapes (such as high error areas and low error areas) according to the error influence matrix. Feature points (such as boundary points and terrain abrupt change points) are selected in each sub-shape, and corresponding points on the same reference object (such as two measurement points at the same corner of a building) are found. The line connecting these two points forms the first error correction reference line segment. For example, if the sub-shape is a street block, street corner point A (original coordinates) and review point A' (standard coordinates) are selected, and the line AA' is drawn as the error correction reference line segment.
[0107] During mapping information correction and data storage, reference line segments are re-surveyed to obtain standard mapping data. The original mapped coordinates are compared with the standard coordinates, and spatial mapping parameters (such as translation, rotation, and scaling factors) are corrected to generate standard mapping information (including projection method, scale, etc.). The original data is stored in the mapping data ring of the mapping data tower according to the "metadata (data header) + data body" structure, with each data ring corresponding to an independent storage unit. Through the process of "feature point selection → reference line segment generation → standard data comparison", a physical reference for error correction is established. For example, reference line segments with known accuracy (such as calibrated baselines) are used to correct the original mapping parameters, reducing systematic errors (such as instrument axis errors). Each original mapping data is stored independently in the form of a mapping data ring, containing complete metadata (coordinates, projection, acquisition time) and data body (original observation values, equipment status), which facilitates tracing the original acquisition environment during subsequent error analysis.
[0108] The advantages are as follows: By unifying spatial benchmarks, quantifying error analysis, and structuring data storage, a comprehensive quality control system is constructed, encompassing the entire process from raw data acquisition to standardized storage. This transforms error control from "post-event quality inspection" to "prevention + in-process correction," while simultaneously enhancing the spatial intelligence of data management through a three-dimensional coordinate system and error impact matrix, laying the foundation for subsequent hierarchical processing, backtracking analysis, and personnel performance evaluation. In practical applications, IoT technology can be combined to collect real-time equipment status and environmental data, further improving the dynamism and accuracy of the error matrix.
[0109] Furthermore, error analysis is performed on the raw surveying data of the surveying data tower to obtain error analysis process information and error analysis result information, specifically including:
[0110] The original surveying data within the surveying data loop in the surveying data tower are extracted sequentially, and the original surveying data undergoes primary error processing, including systematic error elimination and random error elimination.
[0111] The original mapping data that has undergone primary error processing is then subjected to fine error processing, and error analysis process information of primary and fine error processing is generated simultaneously.
[0112] Based on the error analysis process information, record the error analysis results.
[0113] Specifically, during raw data extraction and initial error processing, raw surveying data (such as GPS observations and raw coordinates of UAV imagery) are extracted sequentially from the raw data layer (layer 1) of the surveying data tower, according to time sequence or spatial region, within each surveying data loop. Systematic error elimination addresses errors with known patterns (such as instrument fixation errors and atmospheric refraction errors) and corrects them using mathematical models. For example, i-angle correction is applied to leveling data, and ionospheric delay correction is applied to GPS data. For random error elimination, methods such as least squares adjustment and averaging multiple observations can be used to reduce the impact of random noise. For example, three observations are performed on the same boundary point, and the average value is taken as the initial processing result.
[0114] During the fine error processing and process information generation, the data after primary processing undergoes fine error processing, employing advanced algorithms such as robust adjustment and Kalman filtering to further reduce gross and residual errors. Error analysis process information for each step is recorded synchronously, including: the processing algorithm name (e.g., "robust adjustment algorithm"), parameter settings (e.g., "iteration count = 5"), comparison data before and after error correction (e.g., plane error reduced from 8cm to 3cm), and metadata such as operator and processing time. Finally, the results are recorded and stored. Based on the error analysis process information, error analysis result information is generated, including: final error indicators (e.g., plane accuracy, elevation accuracy); data quality level (e.g., "qualified" or "rework required"). The processed data is stored in the corresponding level of the surveying data tower (e.g., basic processing layer or result data layer), and the error analysis process information and result information are synchronously stored in the backtracking data tower. The advantages are: 1. Layered error control improves data accuracy. Primary error processing: quickly eliminates systematic biases and significant random errors, ensuring data accuracy meets basic industry requirements (e.g., cadastral boundary point error ≤ ±5cm). 1. **Precise Error Handling:** Deep correction is performed for complex error scenarios (such as multipath effects and terrain occlusion) to meet high-precision application requirements (e.g., engineering layout error ≤ ±2cm). 2. **Full-Process Traceable Error Management:** By recording error analysis process information (such as the correction model used and adjustment parameters), the processing chain from raw data to output data is traceable. For example, if the output data exceeds the error limit, it can be traced back to the initial processing stage to check whether the system error correction is complete, or whether the algorithm parameters in the fine processing stage are set incorrectly. 3. **Quantitative Assessment of Data Quality:** Error analysis results provide clear quality indicators (such as mean square error and error distribution histograms) to provide a basis for hierarchical data storage (such as the basic processing layer and the output data layer) and application decisions (such as whether to use it for real estate registration).
[0115] Furthermore, based on the error analysis results, the original surveying and mapping data are processed in layers and simultaneously stored in the surveying and mapping data tower, specifically including:
[0116] Based on the error analysis results, trace the error analysis process information corresponding to the original surveying and mapping data;
[0117] If the original surveying data in the error analysis process information has undergone primary error processing and then fine error processing, then the original surveying data will be stored in the result data layer of the surveying data tower.
[0118] If the original surveying data in the error analysis process information has undergone primary error processing but not fine error processing, then the original surveying data will be stored in the basic processing layer of the surveying data tower.
[0119] After all the original surveying data have undergone primary error processing and fine error processing, the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower is obtained, and the error reduction rate threshold is set simultaneously.
[0120] If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower is greater than the error reduction rate threshold, then the surveying data will be stored in the application service layer of the surveying data tower.
[0121] Specifically, based on the error analysis results (such as final error indicators and quality levels), the corresponding error analysis process information (including primary and fine error processing records) in the data tower is linked back using a unique data loop identifier (such as a UUID). Verification of whether the original surveying data has completed the prescribed processing procedures includes: Primary error processing: whether systematic error elimination (such as coordinate transformation and instrument calibration correction) and random error elimination (such as least squares adjustment) have been performed. Fine error processing: whether robust adjustment, Kalman filtering, and other advanced algorithms have been used to further correct errors.
[0122] Understandably, the data layered storage logic includes conditional judgment and layered storage: The entry condition for the result data layer (layer 3) is that the raw data must undergo both primary and fine error processing simultaneously, and the final error index must meet industry standards (e.g., boundary point error ≤ ±5cm). The entry condition for the basic processing layer (layer 2) is that only primary error processing has been completed, without fine error processing (e.g., due to the large amount of data requiring phased processing), and it serves as temporary storage for intermediate results.
[0123] When calculating the error reduction rate and applying the service layer's access criteria, the formula for calculating the error reduction rate is: (Original data error value - Processed data error value) / Original data error value × 100%. For example, if the original planar error is 10cm and the processed error is 3cm, the error reduction rate is 70%. A threshold is set (e.g., 60%, which can be set by experienced personnel). When the error reduction rate of the result data layer exceeds the threshold, it is determined to be "high-precision usable data" and stored in the application service layer (layer 4) for front-end display or business system calls.
[0124] Its advantages lie in its three-tiered control system of process verification, hierarchical storage, and quantitative evaluation, which enables end-to-end quality control of land surveying data from "processing" to "application." Its core value lies in transforming abstract error control objectives into actionable technical standards (such as mandatory verification of processing steps and error reduction rate thresholds), while simultaneously enhancing the flexibility and usability of data management through hierarchical storage.
[0125] Furthermore, the error analysis process information is filtered, and the filtered error analysis process information is stored in the backtracking data tower, specifically including:
[0126] Obtain the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower. If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower exists and is not 0, then store the error analysis process information of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower into the retrospective data tower. If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower does not exist, then do not store the error analysis process information of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower into the retrospective data tower.
[0127] Specifically, this step achieves "precise" management of the backtracking data tower through error reduction rate threshold control and selective storage strategies. It balances data integrity and storage efficiency, ensuring the backtracking mechanism focuses on high-value error processing information while providing efficient support for data quality analysis, process optimization, and compliance auditing.
[0128] Furthermore, based on the surveying data tower, retrospective data tower, and personnel record tower, the data loops in the surveying data tower are reconstructed to obtain a standard surveying data tower, specifically including:
[0129] Sequentially acquire the surveying data rings in the surveying data tower, and simultaneously acquire the metadata corresponding to the surveying data rings;
[0130] Associate the error analysis process information in the retrospective data tower with the metadata corresponding to the surveying data in the surveying data tower;
[0131] The personnel file information corresponding to the surveying data in the personnel file tower and the surveying data ring is stored in the metadata, and the data ring in the surveying data tower is reconstructed to obtain the standard surveying data tower.
[0132] Specifically, the process involves acquiring surveying data loops and their metadata. This involves traversing all surveying data loops within the surveying data tower (each loop corresponds to a single original surveying data entry and its processed version). Using a unique identifier (e.g., data loop ID), the original surveying data, processed results, and associated metadata (including coordinates, projection method, scale, mapping date, etc.) within each data loop are extracted. When associating error analysis information from the retrospective data tower, the corresponding error analysis process information (e.g., primary processing records, fine-processing algorithm parameters, error reduction rate) is retrieved from the retrospective data tower based on the data loop ID and embedded into the metadata of the surveying data loop using a foreign key association (e.g., data_id). Finally, when integrating operator information from the personnel file tower, the corresponding personnel file information (including name, employee ID, historical operation error rate, and skill level) is retrieved from the personnel file tower using the operator ID (e.g., operator_id) in the data loop and added to the metadata. When reconstructing the data ring to generate a standard surveying and mapping data tower, the integrated metadata (including error analysis and personnel information) is repackaged with the original data and processing results into a complete data ring, which is then stored in the standard surveying and mapping data tower according to the hierarchy (original layer, processing layer, etc.) to form the final usable standardized dataset.
[0133] The advantages are: by integrating multi-source data and reconstructing metadata, information scattered across three data towers is merged into a standardized dataset with complete lifecycle records. This addresses the core problems of traditional surveying and mapping data management, such as "data silos, ambiguous responsibilities, and inefficient traceability," while laying the foundation for high-quality data applications (such as intelligent decision-making, compliance auditing, and product development).
[0134] Furthermore, a land surveying and mapping data management system based on data error analysis is proposed to implement any of the management methods described above, including:
[0135] The data acquisition module is used to determine the location information of the management target and to acquire the original surveying data, original equipment status data and original environmental data corresponding to the location information of the management target.
[0136] The management module is used to construct surveying data towers, retrospective data towers, and personnel file towers based on the location information of the management target, and to manage the surveying data towers, retrospective data towers, and personnel file towers. It is also used to reconstruct the data loops in the surveying data towers based on the surveying data towers, retrospective data towers, and personnel file towers to obtain standard surveying data towers.
[0137] The data processing module is used to perform error analysis on the raw surveying data of the surveying data tower, obtain error analysis process information and error analysis result information, perform layered processing on the raw surveying data based on the error analysis result information, and synchronously store it in the surveying data tower. It is used to filter the error analysis process information and store the filtered error analysis process information in the backtracking data tower.
[0138] The display module is used to present the land surveying data management process and results to the user.
[0139] Furthermore, the management module includes:
[0140] The data tower construction unit is used to construct surveying data towers, retrospective data towers, and personnel file towers based on the location information of management objectives.
[0141] The data tower management unit is used to manage the surveying data tower, retrospective data tower, and personnel file tower.
[0142] The data tower reconstruction unit is used to reconstruct the data loop in the surveying data tower based on the surveying data tower, the retrospective data tower, and the personnel file tower, so as to obtain a standard surveying data tower.
[0143] Furthermore, the data processing module includes:
[0144] The error processing unit is used to perform error analysis on the raw surveying data of the surveying data tower to obtain error analysis process information and error analysis result information.
[0145] The hierarchical processing unit is used to perform hierarchical processing on the original surveying and mapping data based on the error analysis results, and simultaneously store the data in the surveying and mapping data tower.
[0146] The error filtering unit is used to filter information in the error analysis process and store the filtered error analysis process information in the backtracking data tower.
[0147] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the claimed invention. The scope of protection claimed by the appended claims and their equivalents is defined.
Claims
1. A land surveying data management method based on data error analysis, characterized in that, include: Determine the location information of the management target, and construct a surveying data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target; Acquire the original surveying data, original equipment status data, and original environmental data corresponding to the location information of the management target; Based on the management target location information, raw surveying data, raw equipment status data, and raw environmental data, the raw surveying data is stored in the surveying data tower; Error analysis is performed on the raw surveying data of the surveying data tower to obtain information on the error analysis process and the error analysis results. Based on the error analysis results, the original surveying and mapping data are processed in layers and simultaneously stored in the surveying and mapping data tower. The error analysis process information is filtered, and the filtered error analysis process information is stored in the backtracking data tower; Based on the surveying data tower, retrospective data tower, and personnel file tower, the data loop in the surveying data tower is reconstructed to obtain the standard surveying data tower. The process of determining the location information of the management target and constructing a surveying data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target specifically includes: Based on the location information of the management target, obtain the personnel file information for the surveying and mapping of the management target location; Obtain the historical operation error rate corresponding to the personnel file information of the surveying and mapping team, and establish personnel skill files; At least three hierarchical databases are constructed based on PostgreSQL and PostGIS. The hierarchical databases are named to obtain the surveying data tower, the retrospective data tower, and the personnel file tower. The surveying data tower is divided into layers 1 to C. The first layer is the raw data layer, the second layer is the basic processing layer, the third layer is the result data layer, the fourth layer is the application service layer, and layers 5 to C are all version data management layers. The personnel file tower is used to store personnel skill files and personnel file information. The mapping data tower includes mapping data rings, and each mapping data ring corresponds to an independent storage unit; The process of performing layered processing on the original surveying and mapping data based on error analysis results and simultaneously storing it in the surveying and mapping data tower specifically includes: Based on the error analysis results, trace the error analysis process information corresponding to the original surveying and mapping data; If the original surveying data in the error analysis process information has undergone primary error processing and then fine error processing, then the original surveying data will be stored in the result data layer of the surveying data tower. If the original surveying data in the error analysis process information has undergone primary error processing but not fine error processing, then the original surveying data will be stored in the basic processing layer of the surveying data tower. After all the original surveying data have undergone primary error processing and fine error processing, the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower is obtained, and the error reduction rate threshold is set simultaneously. If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower is greater than the error reduction rate threshold, then the surveying data will be stored in the application service layer of the surveying data tower. The process involves reconstructing the data loops within the surveying data tower, based on the surveying data tower, retrospective data tower, and personnel file tower, to obtain a standard surveying data tower. Specifically, this includes: Sequentially acquire the surveying data rings in the surveying data tower, and simultaneously acquire the metadata corresponding to the surveying data rings; Associate the error analysis process information in the retrospective data tower with the metadata corresponding to the surveying data in the surveying data tower; The personnel file information corresponding to the surveying data in the personnel file tower and the surveying data ring is stored in the metadata, and the data ring in the surveying data tower is reconstructed to obtain the standard surveying data tower.
2. The land surveying data management method based on data error analysis according to claim 1, characterized in that, The process of storing the original surveying data into the surveying data tower based on the management target location information, original surveying data, original equipment status data, and original environmental data specifically includes: Based on the location information of the management target, a graphic of the management target area is constructed, and the geometric centroid position of the graphic of the management target area is obtained simultaneously; A three-dimensional spatial coordinate system is established with the geometric centroid of the target area graphic as the origin to obtain the acquisition location of the original surveying data; The original survey data acquisition location is simultaneously mapped to a three-dimensional spatial coordinate system to obtain the coordinates of the original survey data acquisition location in the three-dimensional spatial coordinate system, which are denoted as the original survey mapping coordinates. Acquire the original surveying data, original equipment status data, and original environmental data corresponding to the original surveying mapping coordinates, and simultaneously acquire the original equipment type information of the original surveying data corresponding to the original surveying mapping coordinates; Based on the original equipment type information, original equipment status data, and original environmental data, the first data error impact matrix is determined. Based on the first data error influence matrix, the management target area graphic is divided into management target area sub-graphics; Select at least one point in the sub-graphics of the management target area. And obtain the original surveying data, original equipment status data and original environmental data corresponding to the coordinates of the point, and record them as the first original surveying data, the first original equipment status data and the first original environmental data; Determine the points within the region corresponding to the sub-graphic of the management target area. Points on the same reference frame and obtain points The corresponding original surveying data, original equipment status data, and original environmental data are denoted as the second original surveying data, the second original equipment status data, and the second original environmental data. Connect the points in the three-dimensional coordinate system to obtain the first error repair reference line segment, and obtain the length of the first error repair reference line segment; Synchronously acquire mapping information that maps the acquisition location of the original survey data to the three-dimensional spatial coordinate system; Determine the reference line segment corresponding to the first error correction reference line segment in the management target location, and re-map the reference line segment to obtain standard mapping data; Obtain the coordinate information corresponding to the first error correction reference line segment in the three-dimensional spatial coordinate system, and correct the mapping information of the acquisition position of the original survey data to the three-dimensional spatial coordinate system by combining it with the standard survey data to obtain the standard mapping information; Using standard mapping information, the acquisition location of the original surveying data is remapped to a three-dimensional spatial coordinate system, and metadata corresponding to the original surveying data is generated synchronously, including the coordinates of the original surveying data in the three-dimensional spatial coordinate system and standard mapping information. The standard mapping information includes projection method, scale and mapping date. Metadata is used as the data header, and raw surveying data, raw equipment status data, and raw environmental data are used as the data body and stored in the surveying data tower. Each piece of raw surveying data is stored in a surveying data ring in the surveying data tower.
3. The land surveying data management method based on data error analysis according to claim 1, characterized in that, The process of performing error analysis on the raw surveying data of the surveying data tower to obtain error analysis process information and error analysis result information specifically includes: The original surveying data within the surveying data loop in the surveying data tower are extracted sequentially, and the original surveying data undergoes primary error processing, including systematic error elimination and random error elimination. The original mapping data that has undergone primary error processing is then subjected to fine error processing, and error analysis process information of primary and fine error processing is generated simultaneously. Based on the error analysis process information, record the error analysis results.
4. The land surveying data management method based on data error analysis according to claim 1, characterized in that, The process of filtering error analysis process information and storing the filtered error analysis process information in the backtracking data tower specifically includes: Obtain the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower. If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower exists and is not 0, then store the error analysis process information of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower into the retrospective data tower. If the error reduction rate of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower does not exist, then do not store the error analysis process information of the surveying data corresponding to the result data layer and the original data layer of the surveying data tower into the retrospective data tower.
5. A land surveying and mapping data management system based on data error analysis, used to implement the management method as described in any one of claims 1-4, characterized in that, include: The acquisition module is used to determine the location information of the management target and to acquire the original surveying data, original equipment status data and original environmental data corresponding to the location information of the management target. The management module is used to construct a surveying data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target, and to manage the surveying data tower, the retrospective data tower, and the personnel file tower. It is also used to reconstruct the data loop in the surveying data tower based on the surveying data tower, the retrospective data tower, and the personnel file tower to obtain a standard surveying data tower. The data processing module is used to perform error analysis on the original surveying data of the surveying data tower, obtain error analysis process information and error analysis result information, perform hierarchical processing on the original surveying data based on the error analysis result information, and synchronously store it in the surveying data tower. It is used to filter the error analysis process information and store the filtered error analysis process information in the backtracking data tower. The display module is used to present the land surveying data management process and results to the user.
6. A land surveying and mapping data management system based on data error analysis according to claim 5, characterized in that, The management module includes: A data tower construction unit, which is used to construct a mapping data tower, a retrospective data tower, and a personnel file tower based on the location information of the management target; The data tower management unit is used to manage the surveying data tower, the retrospective data tower, and the personnel file tower. The data tower reconstruction unit is used to reconstruct the data loop in the surveying data tower based on the surveying data tower, the retrospective data tower, and the personnel file tower, so as to obtain a standard surveying data tower.
7. A land surveying and mapping data management system based on data error analysis according to claim 5, characterized in that, The data processing module includes: An error processing unit is used to perform error analysis on the raw surveying data of the surveying data tower to obtain error analysis process information and error analysis result information. A hierarchical processing unit is used to perform hierarchical processing on the original surveying and mapping data based on error analysis results, and simultaneously store the data in the surveying and mapping data tower. An error filtering unit is used to filter error analysis process information and store the filtered error analysis process information in the backtracking data tower.
Citation Information
Patent Citations
Surveying and mapping geographic data management method and system based on cloud computing
CN118796838A
Flight simulator data packet processing system
CN119271848A