Building live-action map making method and system

[0033] In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0034] In recent years, with the widespread application of building information model BIM in the field of construction technology, the combination of BIM and the surveying and mapping geographic information industry has become a new research field. BIM technology has effectively promoted the design efficiency and quality of building design schemes, and proposed a full life cycle concept from design, construction to operation and maintenance, and improved the economic benefits of digital engineering design and delivery technology. The BIM data contains the geometric structure, professional attributes and status information of the semantic segmentation of the single building. It has refined model construction components, which greatly improves the degree of information integration of the construction project, and can provide basic refinement for the construction of building map elements 化part data.

[0035] However, the BIM geometric model lacks real scene information inside and outside the building. How to effectively obtain building textures with different semantic attributes and realize the real texture mapping from material to structure is a key issue in constructing an integrated real-world map of buildings indoors and outdoors. In recent years, the rapid development of UAV tilt photogrammetry rapid modeling has provided a fast and effective solution for outdoor real-world texture data acquisition of buildings. Using multi-view sensors to quickly obtain multi-angle images of the scene, the drone tilt photogrammetry solution can automatically generate a triangulation model of a large-scale scene with high accuracy and rich texture information.

[0036] The organization and management of building map elements is the basis and skeleton of building real map construction. Effective expression and organization of indoor element data is beneficial to improve the performance and practicability of building real maps. At present, three-dimensional map models of buildings can be divided into geometric-based spatial models, symbol-based spatial models, and semantic-based spatial models. However, with the rapid increase of large and complex buildings in urban construction and the continuous expansion of the application field of building map models, a single model cannot meet the diversified needs of the complex building indoor environment and its application scenarios. Hybrid space models It began to be gradually applied to the expression of indoor scenes in complex buildings. Although the existing real-world map model construction has rich geometric and semantic information, it lacks the concept of floors. The construction of building paths and the analysis of semantic associations between elements have weak support and lack a comprehensive description of geometric structures. Cannot be used alone. The main problems are as follows: 1. Lack of a general building map model that can satisfy the geometric information, semantic attributes, and topological relations covering all elements of the building; 2. The building map model only expresses a specific application and cannot adapt to the building. The diversification trend of map model application scenarios.

[0037] figure 1 This is a schematic flow chart of a method for making a real-world map of a building provided by an embodiment of the present invention, such as figure 1 As shown, the embodiment of the present invention provides a method for making a real map of a building, including:

[0038] Step 101: Construct a BIM model of the target real scene, and classify the model structure of the BIM model according to the geometric structure to obtain a first classified geometric structure and a second classified geometric structure.

[0039] Specifically, in the embodiment of the present invention, the first classification geometric structure includes at least walls, columns, doors, windows, and stairs; the second classification geometric structure includes at least display boards, door plates, safety exit signs, bookshelves, and Fire hydrant sign.

[0040] In the embodiment of the present invention, based on the target scene, the BIM model of the target scene is constructed through the steps of establishing grids and floor lines, importing CAD files, and layering establishment sequentially. In addition, if the BIM model of the target scene is the existing produced data, it can also be used directly. In the embodiment of the present invention, the BIM model of the target scene is integrated indoor and outdoor model data. First, based on the model data in each floor of the model data, layered extraction to obtain the walls, columns, stairs, The model data corresponding to the geometric structures with large area, large number and uniform structure, such as doors, windows, and stairs, so as to obtain the first classified geometric structure. In the embodiment of the present invention, the surface texture features of these model data have simple texture or Features such as less information; then, the auxiliary elements of buildings with small areas, small numbers and diversified structures, such as display panels, door plates, safety exit signs, bookshelves, and fire hydrant signs in each floor, are classified as the second category Geometric structure. In the embodiment of the present invention, the surface texture feature of the model data of the second classification geometric structure is complex and has a large amount of information, for example, text information or image content.

[0041] Step 102: According to the semantic type of the first classification geometric structure, storing the model data of the first classification geometric structure as first file format data, which specifically includes: according to the semantic type of the first classification geometric structure, storing The model data of the first classification geometric structure is stored as model data in the FBX file format; the model data in the FBX file format is converted into the model data in the JSON file format to obtain the first file format data.

[0042] In the embodiment of the present invention, after the first classification geometric structure is obtained, based on different semantic classification requirements, the first classification geometric structure is first stored in the FBX file format. The FBX file format is based on the scene graph/tree (SceneGraph/Tree). ) Structure to store all the information of the model (it can also be considered as a multi-tree). Under the root node of the scene tree corresponding to the FBX file format, it contains the geometric network, camera, light source, and bones. The corresponding nodes are read through traversal The attribute information of the model can better retain the basic information of the model during the model conversion process. The embodiment of the present invention uses the FBX file format as a transition file for model data conversion. Then, import the FBX file format into the Blender software and convert it into a JSON (JavaScript Object Notation) data file for storage, thereby obtaining the first file format data. The JSON data file is a lightweight data exchange format that can be used Data exchange is carried out in a variety of Application Programming Interface (API). The embodiment of the present invention stores walls, columns, doors, windows, and stairs with a relatively uniform structure and a high degree of normalization as a JSON data set for storage, which can effectively increase the loading speed of model data and improve the production efficiency of real scene maps.

[0043] Further, on the basis of the foregoing embodiment, storing the model data of the second classification geometric structure as second file format data according to the semantic type of the second classification geometric structure includes: according to the second file format data The semantic type of the classified geometric structure is to store the model data of the second classified geometric structure in an image file format; the model data in the image file format is converted to the model data in the OBJ file format to obtain the second file format data.

[0044] In the embodiment of the present invention, first, the second classification geometric structure is temporarily stored in the image file format, so that when the subsequent texture mapping matches, the model data in the OBJ file format can be output, that is, the second file format data. OBJ file is a standard 3D model file, which mainly supports polygon (Polygons) model, and also supports normal and texture coordinates, so as to retain the normal and texture coordinates of the model, and provide effective data organization for building indoor and outdoor real scene models. basis. The embodiments of the present invention include, but are not limited to, using display boards, door plates, safety exit signs, bookshelves, and fire hydrant signs as auxiliary basic data of building maps, and provide OBJ models for storage and loading in the later stage of real map production.

[0045] Step 103: Acquire texture data of the target real scene, and perform coordinate matching on the texture data with the first file format data and the second file format data, respectively, to obtain a real scene map corresponding to the target real scene. Specifically, the texture data includes: outdoor texture data of a building and indoor texture data of a building.

[0046] Further, on the basis of the foregoing embodiment, the outdoor texture data of the building is obtained through a drone, and the indoor texture data of the building is obtained through an image collection mobile terminal.

[0047] figure 2 This is a schematic diagram of the overall flow of a method for making a real-world map of a building provided by an embodiment of the present invention. figure 2 As shown, in the embodiment of the present invention, before performing texture data coordinate matching, it is first necessary to classify and collect textures inside and outside the building, and sequentially go through affine transformation, corner detection, texture extraction, semantic segmentation, and orthographic imagery. Through the processing process, texture data is obtained. In the embodiment of the present invention, the texture data includes outdoor texture data of a building and indoor texture data of a building. For tall buildings, it is impossible to directly obtain the texture information of each side elevation and top surface. It is necessary to use a light and small unmanned aerial vehicle (UAV) for multi-angle outdoor texture collection to obtain outdoor texture data of the building ; When collecting indoor texture data of a building, it is necessary to classify the internal structure of the building, and collect corresponding texture data for different geometric structures. The embodiment of the present invention provides an image collection mobile terminal, such as a mobile phone, a tablet or a camera And so on, to collect indoor textures by close-up photography to obtain indoor texture data of buildings. Because the extracted indoor and outdoor texture data of the building has geometric distortion caused by factors such as camera inclination, lighting, and atmospheric environment, it is necessary to correct the acquired texture data image. In the embodiment of the present invention, firstly, the vertex information of the texture map is acquired through corner detection; then, the deformed texture is corrected into the orthographic texture image image through perspective transformation, thereby obtaining the corrected texture image data.

[0048] Further, on the basis of the foregoing embodiment, after the texture data is obtained, the texture data is stored in the MTL (Material Library File) file format, which includes texture coordinates, texture mapping paths, shadow control effects, and lighting Loading conditions, etc., so that the texture file in the texture data matches the corresponding geometric structure model. Preferably, refer to figure 2 As shown, on the basis of the foregoing embodiment, after the construction of the BIM model of the target real scene, the method further includes:

[0049] Lightweight processing is performed on the BIM model, and the lightweight processed BIM model is obtained, which can be used to make a real scene map.

[0050] In the embodiment of the present invention, after the BIM high-precision model is constructed, since the BIM model contains more unnecessary mouse traces and other line structures during the construction process, the number of surface structures of the model will increase, resulting in a slower model loading speed. , And texture rendering is more complicated. In order to enhance the visualization effect of the BIM model and effectively increase the loading speed of the model in the actual application of GIS, the embodiment of the present invention performs lightweight processing on the BIM model to obtain reconstructed data after lightweight processing, so that it is more suitable for GIS Application scenarios.

[0051] Specifically, in the embodiment of the present invention, in the lightweighting process, the obtained BIM model data is first exported to DWG format in Revit software, and the exported color is adjusted to true color (RGB value), using ACIS entity Format for export and storage. Then import the exported DWG true color model data into the 3Dmax software, convert it into an editable mesh, delete redundant lines and surface structures, and delete non-geometric data structures, etc., to obtain the BIM lightweight processing Model data, while obtaining a white model in OBJ format.

[0052] Further, in the embodiment of the present invention, after obtaining the indoor and outdoor geometric structure of the building (that is, the first classification geometric structure and the second classification geometric structure) and texture data, you can refer to figure 2 As shown, WebGL is a technology for drawing, displaying and interacting with 3D computer graphics in a browser, and is one of the key technologies for visualization of indoor 3D models. Due to the complexity of WebGLAPI, the embodiment of the present invention is based on the WebGL framework Three.js library to realize the visualization of the indoor map model, and since the Three.js library does not support BIM format data, it needs to be converted into Web visualization. Data format. In the embodiment of the present invention, Three.js supports the loading of files in a variety of 3D model formats; JSON format data can increase the loading rate of 3D models due to its lightweight data organization structure; and OBJ format data supports refined models The texture map is loaded, which makes the construction of the building scene more authentic. Therefore, the two data files are combined to build the indoor and outdoor scene models of the building, which improves the loading efficiency of the model while ensuring the authenticity of the scene. Furthermore, based on the web-side 3D rendering method, the geometric structure model data in the OBJ file format is coordinated with the texture data in the MTL file format, and the model data in the JSON file format is hierarchically loaded, and the building is realized through Three.js The visualization effect of the integrated indoor and outdoor real-world map on the Web side, so as to obtain the real-world map of the target real-scene.

[0053] The method for making a real-world map of a building provided by an embodiment of the present invention improves the accuracy of the indoor and outdoor real-world map of the building by classifying and storing different semantic structures of the building, and performing texture coordinate mapping and matching on the texture data and the building model. , Making the constructed real-world map more effectively applied to the positioning and navigation of the three-dimensional scene.

[0054] In an embodiment of the present invention, the BIM indoor and outdoor data of a certain building is collected to make a real-world map of the building for description. Specifically, the building has six floors, of which there are five floors above ground and one underground. The building elements that are more likely to be repeated and have uniform texture information in the building include walls, columns, stairs, doors and Windows, etc., are displayed on the Web terminal in JSOM format. The embodiment of the present invention uses Blender to export JSON format model files. Blender and Three.js are closely connected. There is a dedicated Three.js exporter plug-in for exporting Three.js JSON format model files, so that the extracted elements can be extracted through Blender The spatial information data is converted into JSON format and displayed on the web.

[0055] Further, for elements with a small repetition probability or diversified texture information in the building scene, such as display boards, electric boxes, and fire hydrants, the embodiment of the present invention loads by combining OBJ files with MTL files, thereby The texture matching between the texture data and the corresponding geometric structure is completed, and the geometric structure in the JSON file format is hierarchically loaded to produce indoor and outdoor real-world maps of different floors of the building.

[0056] image 3 It is a schematic diagram of the structure of a building real-world map making system provided by an embodiment of the present invention, such as

[0057] image 3 As shown, the embodiment of the present invention provides a building real-world map making system, including a model processing module 301, a model format conversion module 302, and a texture matching module 303. The model processing module 301 is used to construct a BIM model of the target real world. And according to the geometric structure, classify the model structure of the BIM model to obtain the first classified geometric structure and the second classified geometric structure; the model format conversion module 302 is used to convert the semantic type of the first classified geometric structure Storing the model data of the first classification geometric structure as first file format data; storing the model data of the second classification geometric structure as second file format data according to the semantic type of the second classification geometric structure; texture The matching module 303 is configured to obtain the texture data of the target real scene, and perform coordinate matching on the texture data with the first file format data and the second file format data respectively to obtain the real scene corresponding to the target real scene map.

[0058] The building real-world map making system provided by the embodiment of the present invention improves the accuracy of indoor and outdoor real-world maps of buildings by classifying and storing different semantic structures of buildings, and performing texture coordinate mapping and matching on texture data and building models. , So that the constructed real-world map can be more effectively applied to the positioning and navigation of the three-dimensional scene.

[0059] On the basis of the foregoing embodiment, the system further includes: a preprocessing module, which is used to perform lightweight processing on the BIM model to obtain a lightweight processed BIM model for use in making a real scene map.

[0060] The system provided in the embodiment of the present invention is used to execute the foregoing method embodiments. For the specific process and details, please refer to the foregoing embodiment, which will not be repeated here.

[0061] Figure 4 It is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, refer to Figure 4 The electronic device may include: a processor 401, a communications interface 402, a memory 403, and a communication bus 404. The processor 401, the communication interface 402, and the memory 403 complete each other through the communication bus 404. Inter-communication. The processor 401 can call the logical instructions in the memory 403 to execute the following method: construct a BIM model of the target real scene, and classify the model structure of the BIM model according to the geometric structure to obtain the first classified geometric structure and the second classified geometric structure. Classification geometric structure; according to the semantic type of the first classification geometric structure, the model data of the first classification geometric structure is stored as first file format data; according to the semantic type of the second classification geometric structure, the The model data of the second classification geometric structure is stored as the second file format data; the texture data of the target real scene is acquired, and the texture data is coordinated with the first file format data and the second file format data respectively Matching to obtain a real scene map corresponding to the target real scene.

[0062] In addition, the above-mentioned logical instructions in the memory 403 can be implemented in the form of a software functional unit and when sold or used as an independent product, they can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present invention essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .

[0063] On the other hand, the embodiments of the present invention also provide a non-transitory computer-readable storage medium on which a computer program is stored, and the computer program is implemented when executed by a processor to perform the building real-world map production provided by the foregoing embodiments. The method includes, for example, constructing a BIM model of the target real scene, and classifying the model structure of the BIM model according to the geometric structure to obtain a first classified geometric structure and a second classified geometric structure; according to the first classified geometric structure Storing the model data of the first classification geometric structure as first file format data; according to the semantic type of the second classification geometric structure, storing the model data of the second classification geometric structure as second File format data; acquiring texture data of the target real scene, and matching the texture data with the first file format data and the second file format data respectively to obtain a real scene map corresponding to the target real scene .

[0064] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of the embodiments. Those of ordinary skill in the art can understand and implement it without creative work.

[0065] Through the description of the above implementation manners, those skilled in the art can clearly understand that each implementation manner can be implemented by software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions can be embodied in the form of software products, which can be stored in computer-readable storage media, such as ROM/RAM, magnetic A disc, an optical disc, etc., include a number of instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in each embodiment or some parts of the embodiment.

[0066] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the foregoing embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.