Model viewer using method and device, equipment and storage medium

Abstract

The invention discloses a model viewer using method and device, equipment and a storage medium, and belongs to the technical field of engineering design. The method comprises the following steps: importing model data; analyzing the model data to obtain three-dimensional model data, two-dimensional picture data and associated information; and matching the three-dimensional model data with the two-dimensional picture data according to the associated information to obtain a comprehensive data model. According to the method, the two-dimensional picture in the building information and the three-dimensional effect model of the building are automatically associated according to the spatial relationship, so that a user can check the two-dimensional picture of the corresponding position of the building while checking the three-dimensional effect model of the building, the working efficiency of finding design problems, formulating a rectification scheme and assigning tasks through the picture is improved, and the user experience is improved. And the management of the construction engineering information is optimized.

Description

Technical Field

[0001] The present invention relates to the field of engineering design technology, and in particular to a method for using a model viewer, an apparatus, equipment and a storage medium. Background Art

[0002] With the development of digital design, the proportion of three-dimensional effect models used in the industrial design process is increasing, and Building Information Modeling (BIM) is also increasingly used in the field of engineering design. Compared with traditional design, BIM design uses digital technology to establish a three-dimensional effect model that is consistent with the actual situation and can serve the entire life cycle of engineering construction.

[0003] Currently, existing building information models only display a 3D rendering of a building. They fail to provide a corresponding 2D map during the 3D model viewing process, making it difficult to efficiently locate locations of interest when viewing the 3D model. Furthermore, when 2D maps of a building are used, they are often design drawings or manually drawn diagrams. This can lead to problems during construction, such as low efficiency, poor construction accuracy, deviations from construction scales, and discrepancies with the actual 3D model. Therefore, an engineering technology method is urgently needed to improve construction efficiency and effectiveness.

[0004] The above content is only used to assist in understanding the technical solution of the present invention and does not constitute an admission that the above content is prior art. Summary of the Invention

[0005] The main purpose of the present invention is to provide a method, device, equipment and storage medium for using a model viewer, aiming to solve the technical problem of low construction efficiency caused by the inconvenience in viewing construction information in the prior art.

[0006] To achieve the above object, the present invention provides a method for using a model viewer, the method comprising the following steps:

[0007] Import model data;

[0008] Parsing the model data to obtain three-dimensional model data, two-dimensional image data, and related information;

[0009] The three-dimensional model data and the two-dimensional image data are matched according to the association information to obtain a comprehensive data model.

[0010] Optionally, before importing the model data, also include:

[0011] According to the coordinate system definition information of the three-dimensional model data in the model data, the coordinate system adaptability between the three-dimensional model data and the model viewer is adjusted.

[0012] Optionally, after matching the three-dimensional model data and the two-dimensional image data according to the association information to obtain a comprehensive data model, the method further includes:

[0013] Acquiring model viewer perspective mode information, and performing model viewer perspective mode conversion according to the model viewer perspective mode information to obtain a current model viewer perspective mode;

[0014] A model operation instruction is received, and based on the current model viewer viewing mode, the model operation instruction is executed.

[0015] Optionally, the steps of receiving a model operation instruction and executing the model operation instruction based on the current model viewer viewing mode include:

[0016] receiving and parsing the model operation instruction to obtain model operation information;

[0017] Determining a current function execution module based on the model operation information;

[0018] The model operation instruction is executed based on the current model viewer viewing mode and through the current function execution module.

[0019] Optionally, the specific steps of receiving and parsing the model operation instruction to obtain the model operation information include:

[0020] receiving the model operation instruction and performing identification and classification to obtain a model operation instruction classification result;

[0021] According to the classification result of the model operation instruction, the model operation instruction is parsed to obtain corresponding model operation information.

[0022] Optionally, the specific steps of determining the current function execution module according to the model operation information include:

[0023] When the model operation information is the first type of model operation information, the current function execution module is a three-dimensional viewer;

[0024] When the model operation information is the second type of model operation information, the current function execution module is a photo viewer;

[0025] When the model operation information is the third type of model operation information, the current function execution module is a map viewer.

[0026] Optionally, the specific step of determining the current function execution module according to the model operation information further includes:

[0027] When the model operation information is comprehensive model operation information, the current function execution module is a plurality of viewers involved in executing the comprehensive model operation information.

[0028] In addition, to achieve the above-mentioned purpose, the present invention further provides a device for using a model viewer, the device for using the model viewer comprising:

[0029] Data input module: import model data;

[0030] Data parsing module: parses the model data to obtain three-dimensional model data, two-dimensional image data and related information;

[0031] Data matching module: matches the three-dimensional model data and the two-dimensional image data according to the association information to obtain a comprehensive data model.

[0032] In addition, to achieve the above-mentioned purpose, the present invention also proposes a device for using a model viewer, which includes: a memory, a processor, and a model viewer usage program stored in the memory and executable on the processor, wherein the model viewer usage program is configured to implement the steps of the method for using the model viewer as described above.

[0033] In addition, to achieve the above-mentioned purpose, the present invention also proposes a computer-readable storage medium storing a computer program, wherein the storage medium stores a program for using a model viewer, and when the program for using the model viewer is executed by a processor, the steps of the method for using the model viewer as described above are implemented.

[0034] The present invention imports model data; analyzes the model data to obtain 3D model data, 2D image data, and associated information; and matches the 3D model data and 2D image data based on the associated information to obtain a comprehensive data model. The present invention automatically associates the 2D images in the building information with the building's 3D rendering model based on their spatial relationship. This allows users to simultaneously view the 2D images of the building at the corresponding location while viewing the 3D rendering model. This improves the efficiency of identifying design issues, formulating rectification plans, and assigning tasks through images, and optimizes the management of construction project information. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is a structural diagram of a device using a model viewer of a hardware operating environment involved in an embodiment of the present invention;

[0036] Figure 2 This is a flow chart of a first embodiment of a method for using a model viewer according to the present invention;

[0037] Figure 31. A flow chart of a second embodiment of a method for using a model viewer according to the present invention;

[0038] Figure 4 1. A schematic flow chart of a third embodiment of a method for using a model viewer according to the present invention;

[0039] Figure 5 1. A flowchart of a fourth embodiment of a method for using a model viewer according to the present invention;

[0040] Figure 6 This is a structural block diagram of a first embodiment of a device for using a model viewer according to the present invention.

[0041] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0042] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0043] Reference Figure 1 , Figure 1 This is a schematic diagram of the device structure of the model viewer used in the hardware operating environment involved in the embodiment of the present invention.

[0044] like Figure 1 As shown, the device using the model viewer may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard). Optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a wireless fidelity (Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (RAM) or a stable non-volatile memory (NVM), such as a disk storage. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0045] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the device for using the model viewer, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0046] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a model viewer usage program.

[0047] exist Figure 1 In the model viewer usage device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the model viewer usage device of the present invention can be set in the model viewer usage device, and the model viewer usage device calls the model viewer usage program stored in the memory 1005 through the processor 1001, and executes the model viewer usage method provided by the embodiment of the present invention.

[0048] The embodiment of the present invention provides a method for using a model viewer, referring to Figure 2 , Figure 2 This is a flow chart of a first embodiment of a method for using a model viewer according to the present invention.

[0049] In this embodiment, the method for using the model viewer includes the following steps:

[0050] Step S10: importing model data;

[0051] It should be noted that, in the specific implementation, the model data includes three-dimensional model data, two-dimensional image data and associated information data, wherein the three-dimensional model data specifically includes: point cloud data in formats such as LAS (an open data format for storing point clouds, mainly used to store radar point cloud data), E57 (a 3D image data file format standard), mesh model data such as OBJ (a general 3D model file format that can store various types of 3D data such as polygonal meshes, surfaces and point clouds), PLY (a general 3D model file format that can store various types of 3D data such as point clouds, meshes and surfaces), vector model data such as BIM (Building Information Modeling) and SU (models created using Sketchup software), and implicitly expressed three-dimensional model data based on NeRF (Neural Radiance Fields).

[0052] Step S20: parsing the model data to obtain three-dimensional model data, two-dimensional image data, and related information;

[0053] It can be understood that the three-dimensional model data, two-dimensional image data and related information obtained by parsing the model data are the basis for the subsequent establishment of a comprehensive data model. The specific formats of the two-dimensional image data include jpg, png, tiff, dwg, pdf and point cloud maps.

[0054] It should also be noted that, in a specific implementation, the associated information specifically refers to the position and posture information when the photo was taken.

[0055] Step S30: Match the three-dimensional model data and the two-dimensional image data according to the association information to obtain a comprehensive data model.

[0056] It should be noted that, in practice, 3D model data and 2D image data are matched using the position and pose information from the 2D photo. A successful match generates a 2D image view icon on the 3D model data. Users simply click on the icon to view the 2D image corresponding to the 3D model location.

[0057] This embodiment imports model data; analyzes the model data to obtain 3D model data, 2D image data, and associated information; and matches the 3D model data and 2D image data based on the associated information to obtain a comprehensive data model. This embodiment automatically spatially associates the 2D image in the building information with the 3D rendering model of the building. This allows users to simultaneously view the 2D image of the corresponding location in the building while viewing the 3D rendering model. This improves the efficiency of identifying design issues, developing rectification plans, and assigning tasks through images, and optimizes the management of construction project information.

[0058] Furthermore, before importing the model data, the method further includes: adjusting the coordinate system adaptability between the three-dimensional model data and the model viewer according to the coordinate system definition information of the three-dimensional model data in the model data.

[0059] It can be understood that the coordinate system adaptability adjustment between the 3D model data and the model viewer specifically refers to that before the model data is imported, since the model data contains multiple 3D model data, the coordinate system definition methods of these 3D model data may be different. Therefore, it is necessary to adjust the meaning of their respective X, Y and Z axes according to the coordinate system definition of these 3D model data to adapt to the model viewer, and then 3D models of different types and quantities will be aligned and imported into the model viewer through a unified coordinate system.

[0060] refer to Figure 3 , Figure 3 This is a flow chart of a second embodiment of a method for using a model viewer according to the present invention.

[0061] Based on the first embodiment above, in this embodiment, after step S30, the following steps are further performed:

[0062] Step S40: obtaining model viewer perspective mode information, and performing model viewer perspective mode conversion according to the model viewer perspective mode information to obtain the current model viewer perspective mode;

[0063] It should be noted that, in a specific implementation, the model viewer is provided with a plurality of different viewing modes, and the user can make a corresponding selection according to the needs when performing specific use.

[0064] It should also be noted that the viewer perspective mode information is specifically used to determine the perspective mode of the model viewer, where the perspective modes of the model viewer specifically include: initial perspective mode, first-person perspective mode and third-person perspective mode. When the perspective mode of the model viewer is in third-person perspective mode, the user can scroll the mouse wheel to achieve the perspective zoom function, click and drag the left mouse button to achieve perspective translation, and right click and drag to achieve perspective rotation; when the perspective mode of the model viewer is in first-person perspective mode, the user can use the W, A, S, D, R, and F keys on the keyboard to respectively achieve the roaming operations of forward, left, backward, right, up, and down of the perspective, and click and drag the left mouse button or use keyboard keys to achieve the rotation operation of the perspective.

[0065] Step S50: receiving a model operation instruction, and executing the model operation instruction based on the current model viewer viewing mode.

[0066] It is understandable that the current model viewer perspective mode is determined by user selection. When executing a model operation instruction, if the user does not switch the model viewer perspective mode, the execution of the model operation instruction will not be changed.

[0067] This embodiment realizes the conversion of the model viewing perspective according to the actual needs of the user by selecting the perspective mode of the model viewer, thereby improving the efficiency of the user in obtaining model information.

[0068] refer to Figure 4 , Figure 4 This is a flow chart of a third embodiment of a method for using a model viewer according to the present invention.

[0069] Based on the above second embodiment, in this embodiment, step S50 specifically includes:

[0070] Step S51: receiving and parsing the model operation instruction to obtain model operation information;

[0071] It should be noted that, in a specific implementation, model operation instructions include multiple types, and the specific functional modules of the model viewer involved in different types of model operation instructions are not exactly the same.

[0072] Step S52: Determine the current function execution module according to the model operation information;

[0073] It is understandable that the model operation information includes associated information of the function execution modules involved in executing the model operation instructions.

[0074] Step S53: Based on the current model viewer viewing mode, the model operation instruction is executed through the current function execution module.

[0075] It should be noted that the current function execution module will not change the current model viewer perspective mode when executing the model operation instruction.

[0076] This embodiment determines the corresponding function execution module by receiving and parsing the model operation refrigeration, and then responds to the model operation instruction based on the current model viewer perspective mode and the determined current function execution module, thereby realizing the model operation function of the model viewer.

[0077] refer to Figure 5 , Figure 5 This is a flow chart of a fourth embodiment of a method for using a model viewer according to the present invention.

[0078] Based on the above second embodiment, in this embodiment, step S51 specifically includes:

[0079] Step S511: receiving the model operation instruction and performing identification and classification to obtain the model operation instruction classification result;

[0080] It should be noted that model operation instructions have multiple categories depending on the different functional execution modules involved. For example, when the model operation instruction only involves the map viewer of the model viewer, the map viewer functional module will respond to the model operation instruction, while other functional modules in the model viewer will not respond to the model operation instruction.

[0081] Step S512: According to the classification result of the model operation instruction, the model operation instruction is parsed to obtain corresponding model operation information.

[0082] It should be noted that, in a specific implementation, model operation instructions include first-category model operation instructions, second-category model operation instructions, and third-category model operation instructions. The first-category model operation instructions include model viewing instructions, model measurement instructions, model editing instructions, and result export instructions, which are operation instructions involving the 3D viewer functional module. Among them, model viewing instructions specifically refer to users viewing the various perspectives and positions of the loaded 3D model through the model viewer; model measurement instructions specifically refer to users using the model viewer's measurement tools to measure model data such as size, area, volume, angle, and height at any position on the model; model editing instructions specifically refer to users performing operations such as cropping, slicing, annotating, and format conversion on the 3D model; and result export instructions specifically refer to users exporting data such as the edited model, measurement results, and sectional drawings.

[0083] It should also be noted that, in the specific implementation, the second type of model operation instructions mainly refers to the operation instructions involving the image viewer function module in the model viewer, specifically including: viewing the image information and image format data corresponding to each position of the three-dimensional model; scaling the image size when viewing the image; saving the selected image to a specified location, etc.

[0084] It can be understood that, in the specific implementation, the third type of model operation instructions mainly refer to the operation instructions related to the map viewer function module in the model viewer, specifically including: viewing the plane map corresponding to the three-dimensional model in the three-dimensional model viewer, where the plane map can be obtained by the user importing the engineering drawing, or it can be automatically generated by the system based on the three-dimensional model; viewing various relevant information of the model, such as the plane map information corresponding to the current three-dimensional model, the collection trajectory information when collecting model data, the current viewing perspective position and perspective angle information, the plane position when the two-dimensional picture is taken, and the plane position information of other marks, etc.

[0085] It should also be noted that when executing the third type of model operation instructions, the Model Viewer automatically generates a planar map of the 3D model. For single-layer data, the Model Viewer automatically detects the ground surface and projects the 3D data within a certain range above the ground surface onto the XY plane as points, generating a planar map. For multi-layer data, the system automatically detects the height and ground surface of each layer, generating planar maps for each layer.

[0086] This embodiment enables each function execution module in the model viewer to better respond to various model operation instructions by identifying and classifying the model operation instructions, thereby improving the operation instruction response efficiency of the model viewer.

[0087] Furthermore, based on the model operation information, the specific steps of determining the current function execution module include: when the model operation information is the first type of model operation information, the current function execution module is a three-dimensional viewer; when the model operation information is the second type of model operation information, the current function execution module is a photo viewer; when the model operation information is the third type of model operation information, the current function execution module is a map viewer.

[0088] Furthermore, the specific step of determining the current function execution module according to the model operation information also includes: when the model operation information is comprehensive model operation information, the current function execution module is multiple viewers involved when executing the comprehensive model operation information.

[0089] It should be noted that in the specific implementation, due to the existence of data interaction, when executing the corresponding model operation instructions, multiple functional modules in the model viewer will be involved. Therefore, the comprehensive model operation information specifically refers to the association information between the functional modules when the model operation instructions involve multiple functional modules in the model viewer.

[0090] When the operation instructions involve the 3D model viewer and the image viewer, for example: clicking the image mark on the 3D model viewer will automatically display the image on the image viewer, and the perspective of the 3D viewer will also jump to the same perspective as the image shooting perspective; when the user roams in the 3D model viewer using the first-person perspective mode, the image viewer will display the image closest to the current perspective.

[0091] When operating instructions involve the 3D viewer and map viewer, for example: the view position and posture in the 3D viewer will be displayed in real time at the corresponding position on the map viewer to achieve state synchronization; clicking any position on the map viewer will also jump to the corresponding position in the 3D viewer.

[0092] When the operation instructions involve the map viewer and the image viewer, for example: clicking the corresponding image mark on the map viewer, the image viewer will display the image, the view angle and posture display of the map viewer will automatically switch to the image shooting perspective, and the view angle and position of the 3D model viewer will also change accordingly.

[0093] In addition, an embodiment of the present invention further proposes a computer-readable storage medium storing a computer program, wherein the storage medium stores a program for using a model viewer, and when the program for using the model viewer is executed by a processor, the steps of the method for using the model viewer as described above are implemented.

[0094] Since the storage medium adopts all the technical solutions of all the above embodiments, it has at least all the beneficial effects brought about by the technical solutions of the above embodiments, which will not be described one by one here.

[0095] Reference Figure 6 , Figure 6 This is a structural block diagram of a first embodiment of a device for using a model viewer according to the present invention.

[0096] like Figure 6 As shown, the device for using the model viewer proposed in the embodiment of the present invention includes:

[0097] Data input module 10: import model data;

[0098] Data parsing module 20: parses the model data to obtain three-dimensional model data, two-dimensional image data and related information;

[0099] Data matching module 30: matches the three-dimensional model data and the two-dimensional image data according to the association information to obtain a comprehensive data model.

[0100] This embodiment imports model data; analyzes the model data to obtain 3D model data, 2D image data, and associated information; and matches the 3D model data and 2D image data based on the associated information to obtain a comprehensive data model. This embodiment automatically spatially associates the 2D image in the building information with the 3D rendering model of the building. This allows users to simultaneously view the 2D image of the corresponding location in the building while viewing the 3D rendering model. This improves the efficiency of identifying design issues, developing rectification plans, and assigning tasks through images, and optimizes the management of construction project information.

[0101] It should be understood that the above is only an example and does not constitute any limitation to the technical solution of the present invention. In specific applications, those skilled in the art can make settings as needed, and the present invention does not impose any limitation on this.

[0102] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of it according to actual needs to achieve the purpose of the embodiment scheme, and no limitation is made here.

[0103] In addition, for technical details not fully described in this embodiment, please refer to the method for using the model viewer provided in any embodiment of the present invention, and will not be repeated here.

[0104] In addition, it should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0105] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0106] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, or of course by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0107] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for using a model viewer, characterized in that: include: Import model data; Parsing the model data to obtain three-dimensional model data, two-dimensional image data and related information; The three-dimensional model data and the two-dimensional image data are matched according to the association information to obtain a comprehensive data model.

2. The method for using the model viewer according to claim 1, characterized in that: Before importing model data, also include: According to the coordinate system definition information of the three-dimensional model data in the model data, the coordinate system adaptability between the three-dimensional model data and the model viewer is adjusted.

3. The method for using the model viewer according to claim 2, characterized in that: After matching the three-dimensional model data and the two-dimensional image data according to the association information to obtain a comprehensive data model, the method further includes: Acquire model viewer perspective mode information, and perform model viewer perspective mode conversion according to the model viewer perspective mode information to obtain the current model viewer perspective mode; A model operation instruction is received, and based on the current model viewer viewing mode, the model operation instruction is executed.

4. The method for using the model viewer according to claim 3, characterized in that: The specific steps of receiving a model operation instruction and executing the model operation instruction based on the current model viewer viewing mode include: Receiving and parsing the model operation instruction to obtain model operation information; Determine the current function execution module according to the model operation information; Based on the current model viewer viewing mode, the model operation instruction is executed through the current function execution module.

5. The method for using the model viewer according to claim 4, characterized in that: The specific steps of receiving and parsing the model operation instruction and obtaining the model operation information include: Receiving the model operation instruction and performing identification and classification to obtain a model operation instruction classification result; According to the classification result of the model operation instruction, the model operation instruction is parsed to obtain corresponding model operation information.

6. The method for using the model viewer according to claim 5, characterized in that: According to the model operation information, the specific steps of determining the current function execution module include: When the model operation information is the first type of model operation information, the current function execution module is a three-dimensional viewer; When the model operation information is the second type of model operation information, the current function execution module is a photo viewer; When the model operation information is the third type of model operation information, the current function execution module is a map viewer.

7. The method for using the model viewer according to claim 6, characterized in that: According to the model operation information, the specific steps of determining the current function execution module also include: When the model operation information is comprehensive model operation information, the current function execution module is a plurality of viewers involved in executing the comprehensive model operation information.

8. A device for using a model viewer, characterized in that: The device for using the model viewer comprises: Data input module: import model data; Data analysis module: analyzes the model data to obtain three-dimensional model data, two-dimensional image data and related information; Data matching module: matches the three-dimensional model data and the two-dimensional image data according to the association information to obtain a comprehensive data model.

9. A device for using a model viewer, characterized in that: The model viewer usage device comprises: a memory, a processor, and a model viewer construction program stored in the memory and executable on the processor, wherein the model viewer construction program is configured to implement the model viewer usage method according to any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps in the method for using the model viewer according to any one of claims 1 to 7 can be implemented.

Images