Spatial three-dimensional model data loading method and system and electronic equipment

By performing abnormal detection and pre-processing of spatial three-dimensional model data, combined with S3M mode conversion and compression algorithm, the data mottled problem caused by tilt photography modeling data is solved, the data loading and rendering efficiency is improved, and it is suitable for multi-field applications.

CN118941719APending Publication Date: 2024-11-12河北省自然资源信息中心
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411164870.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-23
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The spatial three-dimensional model data abnormality caused by different tilt photography modeling data generation software leads to the problem of mottled data display in the GIS display platform.

Method used

By obtaining the exception score of the original space three-dimensional model data, if the score is greater than the preset threshold, preprocessing is performed to eliminate the exception. Otherwise, the S3M mode conversion tool is used to process it directly, and the data is compressed using the preset compression algorithm and loaded to GIS display. platform.

Benefits of technology

The loading and rendering efficiency of spatial three-dimensional model data is optimized, data mottled is avoided, system stability and reliability are improved, data volume and memory usage are significantly reduced, and it is suitable for smart cities, transportation planning and other fields.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118941719A_ABST
    Figure CN118941719A_ABST
Patent Text Reader

Abstract

The invention provides a spatial three-dimensional model data loading method, a spatial three-dimensional model data loading system and electronic equipment. The loading method comprises the following steps: integrating a plurality of oblique photography modeling data to obtain original spatial three-dimensional model data; obtaining an abnormal score of the original spatial three-dimensional model data, if the abnormal score is greater than a preset score threshold, preprocessing the original spatial three-dimensional model data to obtain preprocessed spatial three-dimensional model data, and processing the preprocessed spatial three-dimensional model data by using an S3M mode conversion tool to obtain S3M mode data, otherwise, processing the original spatial three-dimensional model data by using an S3M mode conversion tool to obtain S3M mode data, wherein the original spatial three-dimensional model data adopts an LOD-based multi-detail hierarchical architecture; performing compression processing on the S3M mode data by adopting a preset compression algorithm; and loading the compressed S3M mode data on the GIS display platform. According to the invention, the problem of mottle data of the displayed picture is solved, and the loading and rendering efficiency of the spatial three-dimensional model data is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of spatial three-dimensional model data processing, and in particular to a spatial three-dimensional model data loading method, system and electronic equipment. Background Art

[0002] In Geographic Information System (GIS) projects, large-scale spatial 3D model data needs to be stored, loaded, and rendered (visualized). Large-scale spatial 3D model data is loaded through GIS display platforms (such as Cesium platform) combined with WebGL plug-ins for rendering and visualization. In order to improve the efficiency of data storage, exchange and rendering, the S3M mode conversion tool has been integrated into the GIS display platform in existing products. The S3M mode conversion tool converts the original spatial 3D model data into the S3M (Spatial 3D Model) mode for storage, exchange and rendering.

[0003] Since most of the original spatial 3D model data are obtained by integrating multiple oblique photography modeling data. Although multiple oblique photography modeling data are in the same format, such as OSGB format data, they may be generated by different oblique photography modeling data production software, such as ContextCapture, Pix4D, DP-Smart, Mirauge3D, 3DMAX, etc., the integrated original spatial 3D model data has bounding box anomalies, triangulated network anomalies, texture anomalies, etc. Although the S3M mode conversion tool can eliminate some anomalies, when the anomalies are more serious, the data display will still be mottled in the visualization results of the GIS display platform. Figure 2 and Figure 3 Demonstrates the existing technology of data display mottled ( Figure 2 and Figure 3 The image in the indicator box is similar to a "snowflake" diagram. If the S3M mode conversion tool is used to convert the original space 3D model data, the abnormal preprocessing is performed before the S3M mode conversion tool is used to convert the original space 3D model data. On the one hand, the abnormal processing capability of the S3M mode conversion tool is wasted, and on the other hand, the processing time is increased, and the loading and rendering efficiency is reduced. Summary of the invention

[0004] The present invention aims to at least solve the current technical problem that the original spatial three-dimensional model data is abnormal due to different oblique photography modeling data generation software, resulting in data patchiness when the spatial three-dimensional model data is displayed on a GIS display platform, and provides a spatial three-dimensional model data loading method, system and electronic equipment.

[0005] In order to achieve the above-mentioned purpose of the present invention, according to the first aspect of the present invention, the present invention provides a method for loading spatial three-dimensional model data, including: integrating multiple oblique photography modeling data to obtain original spatial three-dimensional model data; obtaining the anomaly score of the original spatial three-dimensional model data, if the anomaly score is greater than a preset score threshold, preprocessing the original spatial three-dimensional model data to obtain preprocessed spatial three-dimensional model data, using an S3M mode conversion tool to process the preprocessed spatial three-dimensional model data to obtain S3M mode data, otherwise using the S3M mode conversion tool to process the original spatial three-dimensional model data to obtain S3M mode data, wherein the original spatial three-dimensional model data adopts a multi-detail level architecture based on LOD; using a preset compression algorithm to compress the S3M mode data; and loading the compressed S3M mode data on a GIS display platform.

[0006] In order to achieve the above-mentioned purpose of the present invention, according to the second aspect of the present invention, the present invention provides a spatial three-dimensional model data loading system, which is used to implement a spatial three-dimensional model data loading method described in the first aspect of the present invention, and the system includes: an integration module, which integrates multiple oblique photography modeling data to obtain original spatial three-dimensional model data; an S3M mode data acquisition module, which obtains the abnormality score of the original spatial three-dimensional model data, and if the abnormality score is greater than a preset score threshold, the original spatial three-dimensional model data is pre-processed to obtain pre-processed spatial three-dimensional model data, and the pre-processed spatial three-dimensional model data is processed using an S3M mode conversion tool to obtain S3M mode data, otherwise the original spatial three-dimensional model data is processed using an S3M mode conversion tool to obtain S3M mode data, wherein the original spatial three-dimensional model data adopts a multi-detail level architecture based on LOD; a compression module, which compresses the S3M mode data using a preset compression algorithm; and a display module, which loads the compressed S3M mode data on a GIS display platform.

[0007] In order to achieve the above-mentioned purpose of the present invention, according to the third aspect of the present invention, the present invention provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute a spatial three-dimensional model data loading method as described in the first aspect of the present invention.

[0008] After integrating multiple oblique photography modeling data to obtain original spatial three-dimensional model data, the present invention first compares the abnormality score of the original spatial three-dimensional model data with the size of a preset score threshold. When the abnormality score is greater than the preset score threshold, it is considered that the abnormality of the original spatial three-dimensional model data is relatively serious, and preprocessing is required to eliminate the abnormality. Then, the S3M mode data is obtained through the S3M mode conversion tool to avoid data mottle in the display screen of the GIS display platform, which affects the user experience. If the abnormality score is less than or equal to the preset score threshold, it is considered that the abnormality is relatively minor and can be eliminated through the S3M mode conversion tool without the need for a preprocessing step, thereby avoiding preprocessing each time, and optimizing the loading and rendering efficiency of the spatial three-dimensional model data while ensuring that the display screen does not appear data mottle. In addition, the present invention upgrades the original spatial three-dimensional model data to the latest S3M mode through the S3M mode conversion tool, and republishes it, thereby improving the stability and reliability of the system; the S3M mode data is compressed and optimized by using a preset compression algorithm, which significantly reduces the data volume and memory occupancy, and improves the loading speed and rendering efficiency; the original spatial three-dimensional model data loading method provided by the present invention is widely used and can be used in smart cities, traffic planning, geological exploration and other fields. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 It is a schematic flow chart of a method for loading spatial three-dimensional model data in a preferred embodiment of the present invention;

[0010] Figure 2 It is the data patchiness phenomenon in the display screen of the existing GIS display platform;

[0011] Figure 3 yes Figure 2 Middle partial enlarged picture;

[0012] Figure 4 It is a structural block diagram of a spatial three-dimensional model data loading system in a preferred embodiment of the present invention;

[0013] Figure 5 It is a schematic structural diagram of an electronic device in a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0014] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0015] In the description of the present invention, it should be understood that the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship are based on the orientation or position relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the referred system or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0016] In the description of the present invention, unless otherwise specified and limited, it should be noted that the terms "installed", "connected" and "connected" should be understood in a broad sense. For example, it can be a mechanical connection or an electrical connection, or it can be the internal connection between two components. It can be a direct connection or an indirect connection through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms can be understood according to the specific circumstances.

[0017] The execution subject of the spatial three-dimensional model data loading method includes but is not limited to at least one of the electronic devices such as a server, a terminal, etc. that can be configured to execute the method provided in the embodiment of the present application. In other words, the spatial three-dimensional model data loading method can be executed by software or hardware installed on a terminal device or a server device. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc. The server can be an independent server, or it can be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.

[0018] The present invention discloses a method for loading spatial three-dimensional model data. In a preferred embodiment, referring to Figure 1 , the method comprising:

[0019] Step S1, integrating multiple oblique photography modeling data to obtain original space three-dimensional model data.

[0020] Step S2, obtaining an abnormality score of the original spatial three-dimensional model data, if the abnormality score is greater than a preset score threshold, preprocessing the original spatial three-dimensional model data to obtain preprocessed spatial three-dimensional model data, using the S3M mode conversion tool to process the preprocessed spatial three-dimensional model data to obtain S3M mode data, otherwise using the S3M mode conversion tool to process the original spatial three-dimensional model data to obtain S3M mode data, wherein the original spatial three-dimensional model data adopts a multi-level of detail architecture based on LOD;

[0021] Step S3, compressing the S3M mode data using a preset compression algorithm;

[0022] Step S4, loading the compressed S3M model data on the GIS display platform.

[0023] In this embodiment, in step S1, multiple oblique photography modeling data can be generated by oblique photography modeling data production software such as ContextCapture, Pix4D, DP-Smart, Mirauge3D, 3DMAX, etc. The spatial three-dimensional model of a GIS project is decomposed into multiple parts, each of which has an oblique photography modeling data. The integration process of multiple oblique photography modeling data specifically includes unifying the coordinate system, unifying the data format into the OSGB format, and splicing multiple oblique photography modeling data using a splicing tool, preferably but not limited to the existing splicing tools in Pix4D, ContextCapture, and Agisoft Metashape.

[0024] In this embodiment, the original spatial three-dimensional model data adopts a multi-detail hierarchical architecture of LOD (Level of Detail). LOD technology is used to manage the representation of spatial three-dimensional model data according to the complexity of the spatial three-dimensional model and the required rendering quality, representing the level of detail of the model at different observation distances or resolutions. Using a hierarchical structure, in this embodiment, the first detail level, the second detail level, the third detail level, the fourth detail level... have increasing requirements for the geometric details and texture details of the model. Therefore, models of different detail levels have different levels of detail and can be rendered in layers. When rendering, select the appropriate level for rendering based on the observation distance and performance requirements. Each detail level has a triangulated mesh representing the geometric structure of the three-dimensional model, and each triangulated mesh has a texture image. Texture images are used to map the triangulated mesh to the model. Figure 3 The triangulated mesh is used to simulate the detailed features of the model at the detail level. The higher the level of detail, the finer and more triangulated mesh, and the higher the resolution of the corresponding texture image. The spatial 3D model data of each level also includes one or more bounding boxes (Bounding Box, referred to as BBox), which are cubes or other geometric shapes, used to tightly surround the 3D object model. In scenarios such as collision detection, spatial query, and rendering culling, it can simplify the processing and calculation of the 3D object model and improve the efficiency of the algorithm. At each level of detail, each bounding box corresponds to an object model.

[0025] In this embodiment, the S3M mode conversion tool is preferably but not limited to the existing OSGBLab and ConvertTool. In step S3, the preset compression algorithm may be a Draco compression algorithm and a MeshOPT compression algorithm. Preferably, the preset compression algorithm is a MeshOPT compression algorithm, which can perform triangular mesh (TMN) indexing, vertex cache optimization, and lossless compression of vertex and index data. The S3M mode data is compressed and optimized, which significantly reduces the amount of data and memory usage, and improves loading speed and rendering efficiency. At the same time, the MeshOPT compression algorithm has excellent decompression performance, and can achieve fast loading and smooth rendering on various terminals.

[0026] In this embodiment, the GIS display platform is preferably but not limited to Cesium. Cesium is a widely used 3D earth and map visualization framework. It combines with the SuperMap WebGL plug-in to provide powerful support for loading and rendering of spatial 3D model data of 3D geographic information systems. SuperMap desktop software (such as SuperMap iDesktop) can be integrated on it for preprocessing. Preferably, the preprocessing process of the original spatial 3D model data includes:

[0027] For bounding box anomalies, adjust the object model scale when integrating oblique photography modeling data. You can use the model checking tool in SuperMap Desktop Software to fix bounding box anomalies.

[0028] For triangulated network anomalies, delete duplicate triangulated networks, isolated vertices, and simplify triangulated networks in over-subdivided areas. You can use the model checking tool in the SuperMap desktop software to repair triangulated network anomalies.

[0029] For texture redundancy exceptions, delete the redundant texture images. At this time, there are multiple texture images pointing to the same map file (such as triangulated mesh). You can merge the redundant texture images through the material editor in the SuperMap desktop software.

[0030] For corrupted files, delete the corrupted files. Delete the corrupted files directly or replace the corrupted files with normal files. Corrupted files are files that cannot be loaded or opened or have abnormal attributes and sizes.

[0031] For texture size anomalies, adjust the resolution of the texture size anomaly image based on the corresponding triangulation size of the texture size anomaly image. You can directly use the SuperMap desktop software to adjust the resolution.

[0032] In this embodiment, the preprocessing needs to check and process the problems one by one, which is time-consuming. For the original spatial 3D model data with small or non-serious anomalies, preprocessing will increase the processing time and reduce the processing efficiency. Therefore, it is very important to accurately identify the degree of anomaly of the original spatial 3D model data. Preferably, the process of obtaining the anomaly score of the original spatial 3D model data includes:

[0033] Step S21, determining at least two of the five scores of the original spatial three-dimensional model data, namely, a bounding box anomaly score, a triangulated network anomaly score, a texture redundancy score, a damaged file score, and a texture size anomaly score.

[0034] Step S22, obtaining a weighted sum of the at least two determined scores, and using the weighted sum as the abnormality score.

[0035] That is, the anomaly score of the original spatial 3D model data is the weighted sum of any two scores, any three scores, any four scores, or any five scores among the five scores of bounding box anomaly score, triangulated network anomaly score, texture redundancy score, damaged file score, and texture size anomaly score. The weight of each score can be preset. If the anomaly score includes five scores, the weight of each score is evenly set to 0.2.

[0036] In order to more comprehensively reflect the degree of triangulated network anomaly, it is further preferred that the triangulated network anomaly score includes at least one of the overlap score, the breakpoint score and the over-refinement score, or the sum of at least two of them.

[0037] In a preferred embodiment, the bounding box anomaly refers to the fact that some bounding boxes in the original spatial 3D model data do not meet the requirements. If the number of bounding boxes that do not meet the requirements is different, the degree of bounding box anomaly is considered to be different, and the corresponding bounding box anomaly score is different, so that the bounding box anomaly score is more accurate. Specifically, determining the bounding box anomaly score of the original spatial 3D model data includes:

[0038] Step a1, counting the number of bounding boxes that do not meet the requirements in all detail levels of the original spatial three-dimensional model data, and obtaining the total number of abnormal bounding boxes N1.

[0039] Among them, for each bounding box in each detail level, if the bounding box completely encloses its corresponding object model (the three-dimensional model of the object), and the maximum gap between the bounding box and the outer contour of the corresponding object model is less than or equal to the preset gap threshold, then the bounding box is considered to meet the requirements, otherwise it is considered that the bounding box does not meet the requirements. Each bounding box corresponds to an object three-dimensional model, and the bounding box is used to tightly wrap the corresponding object three-dimensional model. Complete encirclement means that the object model corresponding to the bounding box is completely contained in the bounding box. The gap threshold can be determined in advance according to the design requirements of the bounding box.

[0040] Step a2, calculating the ratio K1 of the total number of abnormal bounding boxes N1 to the total number of bounding boxes N2 in all detail levels of the original spatial three-dimensional model data, and obtaining the bounding box anomaly score based on the ratio K1 according to the bounding box anomaly mapping relationship.

[0041] In this embodiment, the bounding box anomaly mapping relationship is: if the ratio K1 is greater than or equal to the first demarcation threshold (value between 0 and 100%, such as 98%), the bounding box anomaly score is assigned to 0, which is considered normal; if the ratio K1 is greater than or equal to the second demarcation threshold (value between 0 and 100%, such as 90%) and less than the first demarcation threshold, the bounding box anomaly score is assigned to 1, which is considered slightly abnormal; if the ratio K1 is greater than or equal to the third demarcation threshold (value between 0 and 100%, such as 70%) and less than the second demarcation threshold, the bounding box anomaly score is assigned to 2, which is considered seriously abnormal; if the ratio K1 is less than the third demarcation threshold, the bounding box anomaly score is assigned to 3, which is considered extremely seriously abnormal. This embodiment realizes the rapid evaluation of the bounding box anomaly score. The first demarcation threshold> the second demarcation threshold> the third demarcation threshold.

[0042] In a preferred embodiment, texture redundancy anomaly refers to the presence of multiple texture images in the original spatial three-dimensional data that are associated with the same map file, such as a triangulated network. The texture redundancy score is calculated as follows:

[0043] The number of triangulated networks N3 and the number of texture images N4 are extracted from the original three-dimensional spatial data, the ratio K2 of the number of texture images N3 to the number of triangulated networks N4 is calculated, and the texture redundancy score is obtained based on the ratio K2 according to the texture redundancy anomaly mapping relationship.

[0044] In this embodiment, the texture redundancy abnormality mapping relationship is: if the ratio K2 is greater than or equal to the first demarcation threshold (value between 0 and 100%, such as 98%), the texture redundancy score is assigned to 0, which is considered normal; if the ratio K2 is greater than or equal to the second demarcation threshold (value between 0 and 100%, such as 90%) and less than the first demarcation threshold, the texture redundancy score is assigned to 1, which is considered slightly abnormal; if the ratio K2 is greater than or equal to the third demarcation threshold (value between 0 and 100%, such as 70%) and less than the second demarcation threshold, the texture redundancy score is assigned to 2, which is considered seriously abnormal; if the ratio K2 is less than the third demarcation threshold, the texture redundancy score is assigned to 3, which is considered extremely seriously abnormal. This embodiment realizes the rapid evaluation of the texture redundancy score. The first demarcation threshold> the second demarcation threshold> the third demarcation threshold.

[0045] In a preferred embodiment, texture size anomaly refers to the mismatch between the size of the texture image and the size of its corresponding map file (such as a triangulated network), and the non-overlap between the two indicates that the two do not match (if the overlapping contours of the two account for less than or equal to 90% of the total contours, it is considered a mismatch). The calculation process of the texture size anomaly score is:

[0046] The number of texture images N5 that do not match the corresponding triangulated mesh size in all detail levels of the original spatial three-dimensional data is obtained, and the ratio K3 of the number of texture images N5 to the total number of texture images N4 at all detail levels of the original spatial three-dimensional data is calculated, and the texture size anomaly score is obtained based on the ratio K3 according to the texture size anomaly mapping relationship. In the original spatial three-dimensional data, in the absence of texture redundancy, one triangulated mesh corresponds to one texture image, and when rendering, the corresponding texture image is attached to the triangulated mesh.

[0047] In this embodiment, the texture size anomaly mapping relationship is: if the ratio K3 is greater than or equal to the first demarcation threshold (value between 0 and 100%, such as 98%), the texture size anomaly score is assigned to 0, which is considered normal; if the ratio K3 is greater than or equal to the second demarcation threshold (value between 0 and 100%, such as 90%) and less than the first demarcation threshold, the texture size anomaly score is assigned to 1, which is considered slightly abnormal; if the ratio K3 is greater than or equal to the third demarcation threshold (value between 0 and 100%, such as 70%) and less than the second demarcation threshold, the texture size anomaly score is assigned to 2, which is considered seriously abnormal; if the ratio K3 is less than the third demarcation threshold, the texture size anomaly score is assigned to 3, which is considered extremely seriously abnormal. This embodiment realizes the rapid evaluation of the texture size anomaly score. The first demarcation threshold> the second demarcation threshold> the third demarcation threshold.

[0048] In a preferred embodiment, the overlap score in the triangulated network anomaly score is used to evaluate the number of duplicate triangulated networks with the same three vertices in the original spatial three-dimensional model data, the breakpoint score is used to evaluate the number of isolated vertices (vertices that do not form a triangulated network) in the original spatial three-dimensional model data, and the over-refinement score is used to evaluate the redundancy of the triangulated network and whether there are triangulated networks with too much redundancy.

[0049] In this implementation, preferably, the calculation process of the overlap score is:

[0050] Step b1, obtaining the number N3 of triangulated networks in the original three-dimensional space data.

[0051] Step b2, extracting the vertex coordinates of all triangulated networks from the original three-dimensional space data, the three vertex coordinates of each triangulated network form a coordinate group, deleting duplicate coordinate groups, and obtaining a non-duplicate coordinate group set. There are no identical coordinate groups in the non-duplicate coordinate group set. For two coordinate groups, even if the order of their three vertex coordinates is different, the two coordinate groups are considered to be the same, and one coordinate group needs to be deleted.

[0052] Step b3, calculate the ratio K4 of the number of coordinate groups in the non-repeated coordinate group set to the number of triangulated networks N3, and if the ratio K4 is less than or equal to the first ratio threshold, assign the overlap score to a first value, otherwise assign the overlap score to 0. The first value is preferably, but not limited to, 1. The first ratio threshold is in the range of [0.5, 0.9], preferably 0.8.

[0053] In this embodiment, further preferably, the calculation process of the breakpoint score is:

[0054] Step c1, obtaining the total number of vertices N6 of the original three-dimensional space data;

[0055] Step c2, obtaining the number N7 of non-repeated vertices included in the non-repeated coordinate set;

[0056] Step c3, calculate the ratio K5 of the number of non-repeated vertices N7 to the total number of vertices N6. If the ratio K5 is less than or equal to the second ratio threshold, the breakpoint score is assigned a second value, otherwise the breakpoint score is assigned 0. The second value is preferably, but not limited to, 1. The second ratio threshold is in the range of [0.5, 0.9], preferably 0.8. The larger the ratio K5, the fewer the number of breakpoints.

[0057] In this embodiment, further preferably, the over-refinement score calculation process is:

[0058] Set the first variable, initialize the first variable and the over-refinement score to 0;

[0059] Starting from the first subdivision level, an accumulation step is performed on each triangulated mesh of the first subdivision level. The accumulation step is: obtain the normal vectors of all triangulated meshes in the space corresponding to the triangulated mesh at the second subdivision level. If the angles of any two or more normal vectors of all triangulated meshes are less than or equal to the angle threshold, the first variable is accumulated by 1. If the value of the first variable is greater than the preset value threshold, the over-refinement score is assigned a third value; the third value ranges from 1 to 3.

[0060] If the value of the first variable is less than or equal to the preset value threshold after all triangulated meshes of the first subdivision level have executed the accumulation step, then starting from the second subdivision level, the accumulation step is executed for each triangulated mesh of the second subdivision level, and the accumulation step is: obtaining the normal vectors of all triangulated meshes in the space corresponding to the triangulated mesh at the third subdivision level, if the angles of any two or more normal vectors of all triangulated meshes are less than or equal to the angle threshold, then 1 is accumulated to the first variable, and if the value of the first variable is greater than the preset value threshold, the over-refinement score is assigned a third value;

[0061] If after all triangulated meshes of the second subdivision level have executed the accumulation step, the value of the first variable is less than or equal to the preset numerical threshold, then starting from the third subdivision level, the accumulation step is executed for each triangulated mesh of the third subdivision level, and so on, until all triangulated meshes of the second to last subdivision level of the original three-dimensional space data have executed the accumulation step, at which time the over-refinement score is still 0, or until the value of the first variable is greater than the preset numerical threshold, at which time the over-refinement score is assigned a third numerical value.

[0062] In this embodiment, preferably, calculation is performed layer by layer starting from the first detail level. The number of triangulated meshes in the first detail level is the least. As the detail levels progress, the number of triangulated meshes in each layer increases, which will also lead to an increase in the amount of calculation. Therefore, the accumulation step is performed starting from the first detail level, and the accumulation step can be performed in parallel for multiple triangulated meshes in each detail level, which can improve the calculation efficiency and the speed of obtaining over-refinement scores. At the same time, the position correlation of the triangulated meshes between levels in the physical three-dimensional space is utilized. The triangulated mesh of the previous level is larger than the triangulated mesh of the next level, and there are more than one more subdivided triangulated meshes at the spatial position corresponding to the triangulated mesh of the next level. The accumulation step can quickly and accurately determine whether there is an over-refinement anomaly. The value of the first variable is accumulated by 1 when the over-refinement anomaly is detected once. Therefore, the value of the first variable can reflect the severity of the overall over-refinement anomaly of the original spatial three-dimensional model data.

[0063] In a preferred embodiment, in order to more accurately evaluate the abnormal score of the original spatial three-dimensional model data, and at the same time, due to the small number of spatial three-dimensional model data samples, it is impossible to assign weights to each score based on a large number of samples according to statistical methods, this embodiment designs a weight assignment method.

[0064] In this embodiment, the abnormality score S of the original spatial three-dimensional model data is:

[0065] S=ρ1S1+ρ2S2+ρ3S3+ρ4S4

[0066] Among them, ρ1 represents the bounding box anomaly weight, S1 represents the bounding box anomaly score; ρ2 represents the triangulated network anomaly weight, S2 represents the triangulated network anomaly score; ρ3 represents the texture redundancy weight, S3 represents the texture redundancy score; ρ4 represents the texture size anomaly weight, S4 represents the texture size anomaly score.

[0067] In this embodiment, the method for obtaining the bounding box abnormality weight ρ1, the triangulated network abnormality weight ρ2, the texture redundancy weight ρ3 and the texture size abnormality weight ρ4 is:

[0068] Step d1, obtaining the original spatial 3D model data for testing, recorded as test data, the test data simultaneously has bounding box anomalies, triangulated network anomalies, texture redundancy and texture size anomalies at the preset subdivision level. The preset subdivision level can be the final subdivision level or an intermediate subdivision level.

[0069] Step d2, directly converting, compressing and displaying the test data in S3M mode without preprocessing to obtain an initial display screen of a preset subdivision level, picking up the area of ​​the mottled region in the initial display screen, and recording it as the initial mottled region area A0.

[0070] Step d3, performing a first preprocessing on the test data, wherein the first preprocessing only processes the bounding box anomalies of a preset subdivision level, obtaining first preprocessed data, performing S3M mode conversion, compression, and display on the first preprocessed data to obtain a first display screen of a preset subdivision level, and picking up the area of ​​the mottled region in the first display screen, which is recorded as the first mottled region area A1;

[0071] Perform a second preprocessing on the test data, the second preprocessing only processes the triangulated network anomalies of the preset subdivision level, obtains the second preprocessed data, performs S3M mode conversion, compression, and display on the second preprocessed data to obtain a second display screen of the preset subdivision level, picks up the mottled area in the second display screen, and records it as the second mottled area A2;

[0072] Performing a third preprocessing on the test data, wherein the third preprocessing only processes texture redundancy at a preset subdivision level, obtaining third preprocessed data, performing S3M mode conversion, compression, and display on the third preprocessed data to obtain a third display screen at a preset subdivision level, and picking up the area of ​​the mottled region in the third display screen, which is recorded as the third mottled region area A3;

[0073] Performing a fourth preprocessing on the test data, the fourth preprocessing only processes the texture size anomaly at a preset subdivision level, obtaining fourth preprocessed data, performing S3M mode conversion, compression, and display on the fourth preprocessed data to obtain a fourth display screen at a preset subdivision level, picking up the mottled area in the fourth display screen, and recording it as the fourth mottled area A4;

[0074] Step d5, referring to the method in the above step S21, obtain the bounding box anomaly score SS1, triangulated network anomaly score SS2, texture redundancy score SS3 and texture size anomaly score SS4 of the test data at the preset subdivision level. When calculating the bounding box anomaly score SS1, triangulated network anomaly score SS2 and texture size anomaly score SS4, replace the original spatial three-dimensional model data in the method in the above step S21 with the model data of the preset subdivision level in the test data, that is, calculate based on the model data of the preset subdivision level in the test data. When calculating the over-refinement score of the texture redundancy score SS3 of the preset subdivision level, the previous level of the preset subdivision level is included in the calculation as the new first subdivision level, and the accumulation step is performed only on all triangulated networks of the new first subdivision level. I will not go into details here.

[0075] In step d5, the initial weights of the four anomalies are:

[0076]

[0077]

[0078]

[0079]

[0080] Normalized to get:

[0081]

[0082]

[0083]

[0084]

[0085] In this embodiment, performing S3M mode conversion, compression, and display to obtain an initial display screen of a preset subdivision level refers to executing: converting the test data / first preprocessed data / second preprocessed data / third preprocessed data / fourth preprocessed data into S3M mode data through an S3M mode conversion tool, compressing the S3M mode data using a preset compression algorithm, and loading the compressed S3M mode data on a GIS display platform to obtain a display screen, such as Figure 2 and Figure 3 The above is an example display screen. The initial mottled area A0, the first mottled area A1, the second mottled area A2, the third mottled area A3, and the fourth mottled area A4 are preferably the number of pixels in the corresponding area at the same display interface resolution.

[0086] In this implementation, original spatial three-dimensional model data having four anomalies at a preset subdivision level are selected as test samples, and the initial weight of each anomaly is obtained by taking the ratio of the reduced patchy area after preprocessing and repair of each anomaly to the score of each anomaly at the preset subdivision level. This reduces the impact of the different severity of the four anomalies in the preset subdivision level of the test data on the size of the reduced patchy area, so that the weight can more accurately reflect the degree of influence of various anomalies on data patchiness, and finally the initial weight is normalized to obtain the final weight.

[0087] The present invention also discloses a spatial three-dimensional model data loading system, which is used to implement a spatial three-dimensional model data loading method according to the first aspect of the present invention. In a preferred embodiment, Figure 4 As shown, the system comprises:

[0088] Integration module, integrating multiple oblique photography modeling data to obtain original spatial three-dimensional model data;

[0089] An S3M mode data acquisition module is used to obtain an abnormality score of the original spatial three-dimensional model data. If the abnormality score is greater than a preset score threshold, the original spatial three-dimensional model data is preprocessed to obtain preprocessed spatial three-dimensional model data, and the preprocessed spatial three-dimensional model data is processed by an S3M mode conversion tool to obtain S3M mode data. Otherwise, the original spatial three-dimensional model data is processed by an S3M mode conversion tool to obtain S3M mode data, wherein the original spatial three-dimensional model data adopts a multi-level of detail architecture based on LOD;

[0090] The compression module compresses the S3M mode data using a preset compression algorithm;

[0091] Display module, loads compressed S3M model data on the GIS display platform.

[0092] In this embodiment, the integration module, S3M mode data acquisition module, compression module and display module correspond to step S1, step S2, step S3 and step S4 of the above method respectively, and are not described again here.

[0093] The present invention also discloses an electronic device. In one embodiment, the electronic device includes at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute a spatial three-dimensional model data loading method provided by the present invention.

[0094] like Figure 5, which is a schematic diagram of the structure of an electronic device for a spatial three-dimensional model data loading method provided by an embodiment of the present invention. The electronic device may include a processor 10, a memory 11, a communication bus 12, and a communication interface 13, and may also include a computer program stored in the memory 11 and executable on the processor 10, such as a spatial three-dimensional model data loading method program.

[0095] In some embodiments, the processor 10 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips. The processor 10 is the control core (Control Unit) of the electronic device, and uses various interfaces and lines to connect various components of the entire electronic device, and executes or executes programs or modules stored in the memory 11 (for example, executing a spatial three-dimensional model data loading method, etc.), and calls data stored in the memory 11 to execute various functions of the electronic device and process data.

[0096] The memory 11 includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a mobile hard disk, a multimedia card, a card-type memory (for example, an SD or DX memory, etc.), a magnetic memory, a disk, an optical disk, etc. In some embodiments, the memory 11 may be an internal storage unit of an electronic device, such as a mobile hard disk of the electronic device. In other embodiments, the memory 11 may also be an external storage device of an electronic device, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Further, the memory 11 may also include both an internal storage unit of the electronic device and an external storage device. The memory 11 can not only be used to store application software and various types of data installed in the electronic device, such as the code of a spatial three-dimensional model data loading method program, but also can be used to temporarily store data that has been output or is to be output.

[0097] The communication bus 12 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is configured to realize connection and communication between the memory 11 and at least one processor 10, etc.

[0098] The communication interface 13 is used for communication between the above-mentioned electronic device and other devices, including a network interface and a user interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is generally used to establish a communication connection between the electronic device and other electronic devices. The user interface may be a display (Display), an input unit (such as a keyboard (Keyboard)), and optionally, the user interface may also be a standard wired interface, a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, and an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, etc. Among them, the display may also be appropriately referred to as a display screen or a display unit, which is used to display information processed in the electronic device and to display a visual user interface.

[0099] Figure 5 Only an electronic device with components is shown, and those skilled in the art will understand that Figure 5 The structure shown does not constitute a limitation on the electronic device, and may include fewer or more components than shown, or combine certain components, or arrange components differently. For example, although not shown, the electronic device may also include a power supply (such as a battery) for powering each component, and preferably, the power supply may be logically connected to at least one processor 10 through a power management system, so as to implement functions such as charging management, discharge management, and power consumption management through the power management system. The power supply may also include any components such as one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, etc. The electronic device may also include a variety of sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

[0100] It should be understood that the embodiment is for illustration only and the scope of the patent application is not limited by this structure.

[0101] Furthermore, if the module / unit integrated in the electronic device 1 is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. The computer-readable storage medium can be volatile or non-volatile. For example, the computer-readable medium can include: any entity or system capable of carrying the computer program code, a recording medium, a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, and a read-only memory (ROM).

[0102] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", "an implementation", "a preferred implementation" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0103] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. A method for loading spatial three-dimensional model data, characterized in that: include: Integrate multiple oblique photography modeling data to obtain original spatial three-dimensional model data; Obtain an anomaly score of the original spatial three-dimensional model data. If the anomaly score is greater than a preset score threshold, preprocess the original spatial three-dimensional model data to obtain preprocessed spatial three-dimensional model data, and use an S3M mode conversion tool to process the preprocessed spatial three-dimensional model data to obtain S3M mode data. Otherwise, use the S3M mode conversion tool to process the original spatial three-dimensional model data to obtain S3M mode data, wherein the original spatial three-dimensional model data adopts a multi-level of detail architecture based on LOD; Use the preset compression algorithm to compress the S3M mode data; Load the compressed S3M model data on the GIS display platform.

2. The spatial three-dimensional model data loading method according to claim 1, characterized in that: The obtaining of the abnormality score of the original spatial three-dimensional model data includes: Determine at least two of the five scores of the bounding box anomaly score, triangulated network anomaly score, texture redundancy score, damaged file score, and texture size anomaly score of the original spatial three-dimensional model data; Calculating a weighted sum of the at least two determined scores, and using the weighted sum as an abnormality score; The triangulated network anomaly score includes at least one of an overlap score, a breakpoint score, and an over-refinement score, or the sum of at least two of the three.

3. The spatial three-dimensional model data loading method according to claim 2, characterized in that: Determine the bounding box anomaly score of the original spatial 3D model data, including: Count the number of bounding boxes that do not meet the requirements in all detail levels of the original spatial 3D model data to obtain the total number of abnormal bounding boxes; Calculate the ratio of the total number of abnormal bounding boxes to the total number of bounding boxes in all detail levels of the original spatial three-dimensional model data, and obtain a bounding box anomaly score based on the ratio according to the bounding box anomaly mapping relationship; Among them, for each bounding box in each detail level, if the bounding box completely encloses its corresponding object model, and the maximum gap between the bounding box and the outer contour of the corresponding object model is less than or equal to the preset gap threshold, then the bounding box is considered to meet the requirements, otherwise the bounding box is considered to not meet the requirements.

4. The spatial three-dimensional model data loading method according to claim 2 or 3, characterized in that: The calculation process of the overlap score is: Get the number of triangulated networks in the original three-dimensional space data; Extract the vertex coordinates of all triangulated networks from the original three-dimensional space data, the three vertex coordinates of each triangulated network form a coordinate group, delete the repeated coordinate groups, and obtain a non-repeated coordinate group set; Calculate the ratio of the number of coordinate groups in the non-repeated coordinate group set to the number of triangulated networks, and if the ratio is less than or equal to a first ratio threshold, assign the overlap score to a first value; otherwise, assign the overlap score to 0; and / or, The calculation process of the breakpoint score is as follows: obtaining the total number of vertices of the original three-dimensional space data; obtaining the number of non-repeated vertices included in the non-repeated coordinate group set; Calculate the ratio of the number of non-repeated vertices to the total number of vertices, and if the ratio is less than or equal to a second ratio threshold, assign the breakpoint score to the second value; otherwise, assign the breakpoint score to 0; and / or, The over-refinement score calculation process is: Set the first variable, initialize the first variable and the over-refinement score to 0; Starting from the first subdivision level, an accumulation step is performed on each triangulated mesh of the first subdivision level, wherein the accumulation step is: obtaining normal vectors of all triangulated meshes in the space corresponding to the triangulated mesh at the second subdivision level, if the angles of any two or more normal vectors of all triangulated meshes are less than or equal to the angle threshold, accumulating 1 to the first variable, and if the value of the first variable is greater than the preset value threshold, assigning the over-refinement score to a third value; If the value of the first variable is less than or equal to the preset value threshold after all triangulated meshes of the first subdivision level have executed the accumulation step, then starting from the second subdivision level, the accumulation step is executed for each triangulated mesh of the second subdivision level, wherein the accumulation step is: obtaining the normal vectors of all triangulated meshes in the space corresponding to the triangulated mesh of the third subdivision level, if the angles of any two or more normal vectors of all triangulated meshes are less than or equal to the angle threshold, then 1 is accumulated to the first variable, and if the value of the first variable is greater than the preset value threshold, the over-refinement score is assigned a third value; If after all triangulated meshes of the second subdivision level have executed the accumulation step, the value of the first variable is less than or equal to the preset numerical threshold, then starting from the third subdivision level, the accumulation step is executed for each triangulated mesh of the third subdivision level, and so on, until all triangulated meshes of the second to last subdivision level of the original three-dimensional space data have executed the accumulation step, at which time the over-refinement score is still 0, or until the value of the first variable is greater than the preset numerical threshold, at which time the over-refinement score is assigned a third numerical value.

5. The method for loading spatial three-dimensional model data according to claim 2, characterized in that: The calculation process of the texture redundancy score is: The number of triangulated networks and the number of texture images are extracted from the original three-dimensional spatial data, the ratio of the number of texture images to the number of triangulated networks is calculated, and the texture redundancy score is obtained based on the ratio according to the texture redundancy anomaly mapping relationship.

6. The method for loading spatial three-dimensional model data according to claim 2, 3 or 5, characterized in that: The calculation process of the texture size anomaly score is: The number of texture images that do not match the corresponding triangulated network size in all detail levels of the original spatial three-dimensional data is obtained, the ratio of the number of texture images to the total number of texture images in all detail levels of the original spatial three-dimensional data is calculated, and the texture size anomaly score is obtained based on the ratio according to the texture size anomaly mapping relationship.

7. The method for loading spatial three-dimensional model data according to claim 6, characterized in that: The pre-processing comprises: For bounding box anomalies, adjust the object model scale when integrating oblique photography modeling data; For triangulated network anomalies, delete duplicate triangulated networks and isolated vertices, and simplify the triangulated network in over-subdivided areas; For texture redundancy exceptions, delete the redundant texture images; For damaged files, delete the damaged files; For texture size anomalies, the resolution of the texture size anomaly image is adjusted based on the triangulated mesh size corresponding to the texture size anomaly image.

8. The method for loading spatial three-dimensional model data according to claim 2, 3, 5 or 7, characterized in that: The anomaly score S of the original spatial three-dimensional model data is: S=ρ1S1+ρ2S2+ρ3S3+ρ4S4 Among them, ρ1 represents the bounding box anomaly weight, S1 represents the bounding box anomaly score; ρ2 represents the triangulated network anomaly weight, S2 represents the triangulated network anomaly score; ρ3 represents the texture redundancy weight, S3 represents the texture redundancy score; ρ4 represents the texture size anomaly weight, S4 represents the texture size anomaly score; The method for obtaining the bounding box anomaly weight ρ1, the triangulated network anomaly weight ρ2, the texture redundancy weight ρ3 and the texture size anomaly weight ρ4 is as follows: Acquire original spatial three-dimensional model data for testing, recorded as test data, wherein the test data simultaneously has bounding box anomalies, triangulated network anomalies, texture redundancy, and texture size anomalies at a preset subdivision level; The test data is directly converted, compressed and displayed in S3M mode without preprocessing to obtain an initial display screen of a preset subdivision level, and the area of ​​the mottled region is picked up in the initial display screen, which is recorded as the initial mottled region area A0; Perform a first preprocessing on the test data, the first preprocessing only processes the bounding box anomalies of a preset subdivision level, obtains the first preprocessed data, performs S3M mode conversion, compression, and display on the first preprocessed data to obtain a first display screen of a preset subdivision level, picks up the area of ​​the mottled region in the first display screen, and records it as the first mottled region area A1; Perform a second preprocessing on the test data, the second preprocessing only processes the triangulated network anomalies of the preset subdivision level, obtains the second preprocessed data, performs S3M mode conversion, compression, and display on the second preprocessed data to obtain a second display screen of the preset subdivision level, picks up the mottled area in the second display screen, and records it as the second mottled area A2; Performing a third preprocessing on the test data, wherein the third preprocessing only processes texture redundancy at a preset subdivision level, obtaining third preprocessed data, performing S3M mode conversion, compression, and display on the third preprocessed data to obtain a third display screen at a preset subdivision level, and picking up the area of ​​the mottled region in the third display screen, which is recorded as the third mottled region area A3; Performing a fourth preprocessing on the test data, the fourth preprocessing only processes the texture size anomaly at a preset subdivision level, obtaining fourth preprocessed data, performing S3M mode conversion, compression, and display on the fourth preprocessed data to obtain a fourth display screen at a preset subdivision level, picking up the mottled area in the fourth display screen, and recording it as the fourth mottled area A4; Obtain the bounding box anomaly score SS1, triangulated network anomaly score SS2, texture redundancy score SS3 and texture size anomaly score SS4 of the test data at a preset subdivision level; The initial weights of bounding box anomaly, triangulated network anomaly, texture redundancy and texture size anomaly are: The normalized bounding box anomaly weights, triangulated network anomaly weights, texture redundancy weights, and texture size anomaly weights are: 。 9. A spatial three-dimensional model data loading system, characterized in that: A method for loading spatial three-dimensional model data according to any one of claims 1 to 8, the system comprising: Integration module, integrating multiple oblique photography modeling data to obtain original spatial three-dimensional model data; An S3M mode data acquisition module is used to obtain an abnormality score of the original spatial three-dimensional model data. If the abnormality score is greater than a preset score threshold, the original spatial three-dimensional model data is preprocessed to obtain preprocessed spatial three-dimensional model data, and the preprocessed spatial three-dimensional model data is processed by an S3M mode conversion tool to obtain S3M mode data. Otherwise, the original spatial three-dimensional model data is processed by an S3M mode conversion tool to obtain S3M mode data, wherein the original spatial three-dimensional model data adopts a multi-level of detail architecture based on LOD; The compression module compresses the S3M mode data using a preset compression algorithm; Display module, loads compressed S3M model data on the GIS display platform.

10. An electronic device, characterized in that: The electronic device comprises: At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute a spatial three-dimensional model data loading method as described in any one of claims 1 to 8.

Citation Information

Cited By

  • Urban water pipe valve control-oriented three-dimensional modeling method and system

    CN120318450A

  • A three-dimensional modeling method and system for urban water pipe valve management and control

    CN120318450B