A 3D display method, device and storage medium for project progress

Abstract

The present invention relates to a three-dimensional display method, device and storage medium for project progress. In the present invention, a complete project model is pre-constructed, voxel grids for dividing the complete project model are constructed, and a corresponding point cloud model is obtained by downsampling using the voxel grids; a radar point cloud model of the latest progress structure of the project and the overall structure of the project entity where it is located is collected; a progress point cloud model of the latest progress structure and the overall structure of the project entity where the latest progress structure is located in the coordinate system of the point cloud model is obtained through the radar point cloud model and the target transformation matrix; the progress point cloud model is input into a pre-trained three-dimensional point cloud capsule network to obtain a corresponding progress three-dimensional model; all the progress three-dimensional models are combined according to their own positions to obtain a first project progress three-dimensional model that can display the project progress, realizing the construction and positioning of the progress three-dimensional model based on the radar point cloud model, and forming a first project progress three-dimensional model that is convenient for displaying the project progress.

Description

Technical Field

[0001] The present invention relates to the field of three-dimensional display of project progress, and particularly to a method, device and storage medium for three-dimensional display of project progress. Background Art

[0002] Regarding the display of project progress, an intuitive project progress display method can facilitate users to quickly understand the project progress and save time.

[0003] Currently, the existing project progress is usually displayed in the form of a report. Although this project progress display method provides convenience for users to understand the project progress to a certain extent, since the project progress is displayed through at least one piece of information in the report, there is often a problem that the project progress display is not intuitive enough. Especially when there is a large amount of information in the project progress, users need to understand the project progress from a large amount of information, which wastes time. In view of this, providing a method, device and storage medium for three-dimensional display of project progress to avoid the situation that the project progress display is not intuitive and not convenient for users to quickly understand the project progress caused by the existing technology of displaying project progress in the form of a report is an urgent problem to be solved. Summary of the Invention

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present invention provides a method, device and storage medium for three-dimensional display of project progress.

[0005] In a first aspect, the present invention provides a method for three-dimensional display of project progress, including: pre-constructing a complete project model, constructing voxel grids for segmenting the complete project model, and obtaining a corresponding point cloud model by downsampling using the voxel grids;

[0006] Collecting a radar point cloud model of the latest progress structure of the project and the overall structure of the project entity where it is located, converting the radar point cloud model to the coordinate system of the point cloud model through a transformation matrix iteratively optimized by the Newton optimization algorithm, and obtaining a target transformation matrix on the condition that the probability distribution of the points in the converted radar point cloud model within the voxel grid is closest to the probability distribution of the corresponding part of the radar point cloud model in the point cloud model in the voxel grid; obtaining a progress point cloud model of the latest progress structure and the overall structure of the project entity where it is located in the coordinate system of the point cloud model through the radar point cloud model and the target transformation matrix;

[0007] Inputting the progress point cloud model into a pre-trained three-dimensional point cloud capsule network to obtain a corresponding progress three-dimensional model;

[0008] Combining all the progress three-dimensional models according to their own positions to obtain a first project progress three-dimensional model that can display the project progress.

[0009] Furthermore, capture the first appearance images of the latest progress structure of a project at several preset angles on the engineering site and the overall structure of the corresponding project entity. When the first engineering progress 3D model is displayed at a certain display angle, match the first appearance image with the closest angle to the display angle as the target first appearance image. Extract the style features of the latest progress structure of the project and the overall structure of the corresponding project entity in the target first appearance image. Obtain the appearance presented by the corresponding progress 3D model in the first engineering progress 3D model at the display angle as the second appearance image. Input the style features and the second appearance image into the pre-trained starGAN network model to obtain the display effect diagram of the progress 3D model rendered with the style features of the latest progress structure of the project and the overall structure of the corresponding project entity in the first appearance image.

[0010] Furthermore, extract the area of the latest progress structure of the project and the overall structure of the corresponding project entity in the first appearance image as the first target area. Extract the fine style features of the first target area. Extract the block of the corresponding progress 3D model in the second appearance image as the second target area. Input the fine style features and the extracted second target area into the pre-trained starGAN network model correspondingly to obtain more precisely the display effect diagram of the model rendered with the fine style features.

[0011] Furthermore, according to the recognizable partial structure of the project entity, identify a more refined first target sub-area within the first target area and a more refined second target sub-area within the second target area; the first target sub-area is the area within the first target area of the recognizable partial structure of the latest progress structure of the project and the overall structure of the corresponding project entity, and the second target sub-area is the area within the second target area of the recognizable partial structure.

[0012] Extract the more refined style features of the first target sub-area and render the corresponding second target sub-area.

[0013] Furthermore, pre-train a semantic segmentation model for recognizing the project entity constructed by the project and the partial structure of the project entity. Use the semantic segmentation model to recognize and segment the first appearance image to obtain the first target area or the first target sub-area of the latest progress structure of the project and the overall structure of the corresponding project entity in the first appearance image. Use the semantic segmentation model to recognize and segment the second appearance image to obtain the second target area or the second target sub-area of the corresponding model in the second appearance image.

[0014] Further, all the progress 3D models are combined to obtain a first engineering progress 3D model; the first engineering progress 3D model is scaled according to a preset interpolation algorithm to obtain a first engineering progress 3D model with a size ratio of 1:1 to the complete project model; the first engineering progress 3D model is mapped to a first matrix space; according to whether the points in the first matrix space are mapped to the points of the first engineering progress 3D model, the first matrix space is binarized, and the binarized first matrix space is filtered to obtain a mask domain; the complete project model is mapped to a second matrix space with the same size as the first matrix space; the two second matrix spaces and the mask domain are subjected to bitwise AND to obtain a second engineering progress 3D model.

[0015] Further, the complete project model mapped to the second matrix space is rendered in appearance according to the project plan.

[0016] In a second aspect, the present invention provides an engineering progress 3D display device, including: a processing module, a storage module, a bus module interface module, and a display module. The processing module, the storage module, the interface module, and the display module are connected through the bus module. The storage module stores at least computer programs and operation data of the computer programs. The processing module executes the computer programs to process the operation data to implement the engineering progress 3D display method.

[0017] Even further, the engineering progress 3D display device includes: a collection module. The collection module includes a radar for collecting a radar point cloud model and a GPS unit for positioning the attitude and position of the collection module, and transmits operation data to the storage module through a connection interface module.

[0018] In a third aspect, the present invention provides a storage medium for implementing the engineering progress 3D display method. The storage medium for implementing the engineering progress 3D display method stores at least one instruction, and reads and executes the instruction to implement the engineering progress 3D display method.

[0019] The above technical solutions provided by the embodiments of the present invention have the following advantages compared with the prior art:

[0020] In the present invention, the radar point cloud model is converted through a target transformation matrix to obtain a progress point cloud model in the coordinate system where the point cloud model is located. The progress point cloud model is input into a pre-trained 3D point cloud capsule network to obtain a corresponding progress 3D model. All the progress 3D models are combined according to their own positions to obtain a first engineering progress 3D model that can display the engineering progress.

[0021] In the present invention, the starGAN network model is used to extract the style features (fine style features, more fine style features) of the first appearance map to render the corresponding progress 3D models in the first engineering progress 3D model, so as to display the engineering progress of the project entity appearance.

[0022] Moreover, map the complete project model with the appearance rendered according to the project plan to the second matrix space, map the first project progress model with a scale of 1:1 to the size of the complete project model to the first matrix space. According to whether the points in the first matrix space are mapped to the points of the first project progress three-dimensional model, binarize and filter the first matrix space to obtain a mask domain. Perform a bitwise AND operation on the two second matrix spaces and the mask domain to obtain the second project progress three-dimensional model. By combining the second project progress three-dimensional model containing the rendering result and the project entity appearance project progress, the gap between the appearance project progress and the expectation can be obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings herein are incorporated into the specification and form a part of this specification, showing embodiments consistent with the present invention, and are used together with the specification to explain the principles of the present invention.

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0025] Figure 1 It is a flowchart of the project entity structure progress display of a three-dimensional project progress display method provided by an embodiment of the present invention;

[0026] Figure 2 It is a flowchart of the project entity surface processing progress display and the current surface gap display of a three-dimensional project progress display method provided by an embodiment of the present invention;

[0027] Figure 3 It is a schematic diagram of a three-dimensional project progress display device provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0028] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts fall within the scope of protection of the present invention.

[0029] It should be noted that in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements not only includes those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising one..." does not exclude the presence of additional identical elements in the process, method, article or device comprising said element.

[0030] Embodiment 1

[0031] Refer to Figure 1 As shown, the embodiment of the present invention provides a three-dimensional display method for project progress, including: a method for displaying the progress of the project entity structure and a method for displaying the processing progress of the project entity surface and the difference between the current surface and the surface.

[0032] The method for displaying the progress of the project entity structure includes:

[0033] Pre-build a complete project model, construct voxel grids for dividing the complete project model, and use the voxel grids to downsample to obtain a corresponding point cloud model. Specifically, import all the project CAD drawings into 3D modeling software, and the 3D modeling software models according to the project CAD drawings, and connects the built model according to the preset connection relationship to obtain a complete project model.

[0034] Collect the radar point cloud model of the latest progress structure of the project and the overall structure of the project entity where it is located through the acquisition module. The acquisition module is configured with a radar and a GPS unit. Collect the radar point cloud map of the latest progress structure of the project and the overall structure of the project entity where it is located through the radar, and convert the radar point cloud map in the radar coordinate system to the radar point cloud model in the coordinate system determined by the GPS unit.

[0035] Multiply the radar point cloud model by the target transformation matrix to obtain the progress point cloud model of the latest progress structure and the overall structure of the project entity where the latest progress structure is located in the coordinate system of the point cloud model. In the specific implementation process, the radar point cloud model is converted to the coordinate system where the point cloud model is located through a transformation matrix iteratively optimized by the Newton optimization algorithm, and the target transformation matrix is obtained on the condition that the probability distribution of the points in the voxel grid of the converted radar point cloud model is closest to the probability distribution of the corresponding part of the points in the voxel grid of the radar point cloud model in the point cloud model.

[0036] Input the progress point cloud model into the pre-trained 3D point cloud capsule network to obtain the corresponding progress 3D model. In the specific implementation process, the 3D point cloud capsule network includes a decoder and an encoder. Among them, the decoder includes a point cloud input layer of n×3. The point cloud input layer is connected to a multi-layer perceptron, and the multi-layer perceptron extracts features of n×128 from the data input by the point cloud input layer. The multi-layer perceptron is connected to multiple independent convolutional layers with different weights. The independent convolutional layers are connected to a max-pooling layer. Each feature of n×1024 is max-pooled into 1024 dimensions and merged into the primary point capsules. The primary point capsules are aggregated into latent capsules through dynamic routing. The decoder of the 3D point cloud capsule network learns to reconstruct the point set of the latent features in the latent capsules, constructs a random 2D grid assigned to the latent capsules, and applies a multi-layer perceptron to generate multiple point patches targeting different regions of the progress 3D model. The surface formed by all the point patches constructs the progress 3D model, making the chamfer distance between the constructed progress 3D model and the progress point cloud model optimal.

[0037] Combine all the progress 3D models according to their own positions to obtain the first 3D model of project progress that can display the project progress. In the specific implementation process, combining the progress 3D models can display the construction degree of the project entity.

[0038] In the specific implementation process, refer to Figure 2 As shown, the display of the surface processing progress of the project entity and the display of the gap with the current surface include:

[0039] For the progress 3D model displayed at a certain display angle, match the first appearance map with the closest angle according to the display angle as the target first appearance map, and render the progress 3D model with the style features included in the first appearance map.

[0040] Collect the first appearance maps of the latest progress structures of the project at several preset angles on the construction site and the overall structure of the corresponding project entity. When the first 3D model of project progress is displayed at a certain display angle, match the first appearance map with the closest angle according to the display angle as the target first appearance map. Extract the style features of the latest progress structure of the project and the overall structure of the corresponding project entity in the target first appearance map, obtain the appearance presented by the corresponding progress 3D model in the first 3D model of project progress according to the display angle as the second appearance map, and input the style features and the second appearance map into the pre-trained starGAN network model to obtain the display effect diagram of the progress 3D model rendered with the style features of the latest progress structure of the project and the overall structure of the corresponding project entity in the first appearance map. The surface construction progress of the project entity is displayed through the method of style feature rendering.

[0041] To achieve more refined rendering of style features, extract the area of the latest progress structure of the project and the overall structure of the project entity where it is located in the first appearance diagram as the first target area, extract the refined style features of the first target area, extract the block of the corresponding progress three-dimensional model in the second appearance diagram as the second target area, and input the refined style features and the extracted second target area into the pre-trained starGAN network model correspondingly to more finely obtain the model display effect diagram rendered with the refined style features. According to the partial structure of the recognizable project entity, identify a more refined first target sub-area within the first target area and a more refined second target sub-area within the second target area; the first target sub-area is the area within the first target area of the recognizable partial structure of the latest progress structure of the project and the overall structure of the project entity where it is located, and the second target sub-area is the area within the second target area of the recognizable partial structure; extract the more refined style features of the first target sub-area and render the corresponding second target sub-area. Pre-train a semantic segmentation model for recognizing the project entity and the partial structure of the project entity constructed by the project. Use the semantic segmentation model to recognize and segment the first appearance diagram to obtain the first target area or the first target sub-area of the latest progress structure of the project and the overall structure of the project entity where it is located in the first appearance diagram, and use the semantic segmentation model to recognize and segment the second appearance diagram to obtain the second target area or the second target sub-area of the corresponding model within the second appearance diagram.

[0042] Combine all the progress three-dimensional models to obtain the first project progress three-dimensional model; scale it according to the preset interpolation algorithm to obtain the first project progress three-dimensional model with a size ratio of 1:1 to the complete project model; map the first project progress three-dimensional model to the first matrix space; binaryize the first matrix space according to whether the points in the first matrix space are mapped to the points of the first project progress three-dimensional model, and perform filtering processing on the binaryized first matrix space to obtain the mask domain; map the complete project model to the second matrix space with the same size as the first matrix space; perform a bitwise AND operation on the two second matrix spaces and the mask domain to obtain the second project progress three-dimensional model. Among them, the complete project model mapped to the second matrix space is rendered according to the project plan. In the specific implementation process, the project plan includes the rendering plan of each construction period progress three-dimensional model, and the complete project model is rendered according to the construction period of the project. By comparing the first project progress three-dimensional model and the first project progress three-dimensional model, the gap between the current surface processing of the first project progress three-dimensional model and the current rendering plan can be obtained.

[0043] Embodiment 2

[0044] An embodiment of the present invention provides a three-dimensional display device for project progress, including: a processing module, a storage module, a bus module interface module, and a display module. The processing module, the storage module, the interface module, and the display module are connected through the bus module. The storage module stores at least a computer program and operation data of the computer program. The processing module executes the computer program to process the operation data to implement any one of the three-dimensional display methods for project progress. Among them, the interface module is connected to an acquisition module. The acquisition module includes a radar for acquiring a radar point cloud model and a GPS unit for positioning the attitude and position of the acquisition module. The acquisition module acquires the operation data of the computer program for implementing the three-dimensional display method for project progress.

[0045] Embodiment 3

[0046] An embodiment of the present invention provides a storage medium for implementing a three-dimensional display method for project progress. The storage medium for implementing the three-dimensional display method for project progress stores at least one instruction, and reading and executing the instruction implements the three-dimensional display method for project progress.

[0047] In the embodiments provided by the present invention, it should be understood that the disclosed structure and method can be implemented in other ways. For example, the structural embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection can be through some interfaces, and the indirect coupling or communication connection of structures or units can be in electrical, mechanical or other forms.

[0048] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0049] In addition, the functional units in each embodiment of the present invention can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

[0050] The above are only specific embodiments of the present invention, enabling those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown herein, but rather to the broadest scope consistent with the principles and novel features claimed herein.

Claims

1. A three-dimensional display method for project progress, characterized in that, Including: Pre - construct a complete project model, construct a voxel grid for segmenting the complete project model, and downsample using the voxel grid to obtain the corresponding point cloud model; Collect the radar point cloud model of the latest progress structure of the project and the overall structure of the project entity where it is located. Transform the radar point cloud model into the coordinate system of the point cloud model through a transformation matrix iteratively optimized by the Newton optimization algorithm. Obtain the target transformation matrix on the condition that the probability distribution of points in the voxel grid of the transformed radar point cloud model is closest to the probability distribution of the corresponding part of the radar point cloud model in the point cloud model. Obtain the progress point cloud model of the latest progress structure and the overall structure of the project entity where it is located in the coordinate system of the point cloud model through the radar point cloud model and the target transformation matrix; Input the progress point cloud model into a pre - trained three - dimensional point cloud capsule network to obtain the corresponding progress three - dimensional model; Combine all the progress three - dimensional models according to their own positions to obtain the first three - dimensional model of the project progress that can display the project progress; The display of the surface processing progress of the project entity and the display of the gap with the current surface include: Collect the first appearance pictures of the latest progress structure of the project at several preset angles in the project site and the overall structure of the project entity where it is located. When the first three - dimensional model of the project progress is displayed at a certain display angle, select the first appearance picture with the closest matching angle as the target first appearance picture according to the display angle. Extract the style features of the latest progress structure of the project and the overall structure of the project entity where it is located in the target first appearance picture. Obtain the appearance presented by the corresponding progress three - dimensional model in the first three - dimensional model of the project progress at the display angle as the second appearance picture. Input the style features and the second appearance picture into the pre - trained starGAN network model to obtain the display effect picture of the progress three - dimensional model rendered with the style features of the latest progress structure of the project and the overall structure of the project entity where it is located in the first appearance picture. Extract the area of the latest progress structure of the project and the overall structure of the project entity where it is located in the first appearance picture as the first target area, extract the fine style features of the first target area, extract the block in the second appearance picture of the corresponding progress three - dimensional model as the second target area, and input the fine style features and the extracted second target area into the pre - trained starGAN network model to obtain the model display effect picture rendered with the fine style features. Scale according to the preset interpolation algorithm to obtain the first three - dimensional model of the project progress with a size ratio of 1:1 to the complete project model. Map the first three - dimensional model of the project progress to the first matrix space. Binary - value the first matrix space according to whether the points in the first matrix space are mapped to the points of the first three - dimensional model of the project progress, and perform filtering processing on the binary - valued first matrix space to obtain the mask domain. Map the complete project model to the second matrix space with the same size as the first matrix space. Perform a bit - wise AND operation on the two second matrix spaces and the mask domain to obtain the second three - dimensional model of the project progress. Render the appearance of the complete project model mapped to the second matrix space according to the project plan. Compare the first three - dimensional model of the project progress and the second three - dimensional model of the project progress to know the gap between the current surface processing of the first three - dimensional model of the project progress and the current rendering plan.

2. The three-dimensional display method of the project progress according to claim 1, wherein According to the partial structure of the recognizable project entity, a more refined first target sub-region is recognized within the first target region, and a more refined second target sub-region is recognized within the second target region; the first target sub-region is the region within the first target region of the overall structure of the latest project progress structure and its corresponding project entity that can be recognized, and the second target sub-region is the region within the second target region of the recognizable partial structure. Extract the more refined style features of the first target sub-region and render the corresponding second target sub-region.

3. The three-dimensional display method of the project progress according to claim 2, wherein Pre-train a semantic segmentation model for recognizing the project entities and partial structures of project entities constructed by the project. Through the semantic segmentation model, the first appearance map is recognized and segmented to obtain the first target region or the first target sub-region of the overall structure of the latest project progress structure and its corresponding project entity in the first appearance map. Through the semantic segmentation model, the second appearance map is recognized and segmented to obtain the second target region or the second target sub-region of the corresponding model within the second appearance map.

4. A three-dimensional display device for project progress, characterized in that, It includes: A processing module, a storage module, a bus module, an interface module, and a display module. The processing module, the storage module, the interface module, and the display module are connected through the bus module. The storage module stores at least computer programs and operation data of the computer programs. The processing module executes the computer programs to process the operation data to implement the three-dimensional display method of project progress as described in any one of claims 1-3.

5. The three-dimensional display device for project progress according to claim 4, wherein It includes: An acquisition module. The acquisition module includes a radar for acquiring a radar point cloud model and a GPS unit for positioning the attitude and position of the acquisition module. The operation data is transmitted to the storage module through the connection interface module.

6. A storage medium for implementing a three-dimensional display method of project progress, characterized in that, The storage medium for implementing the three-dimensional display method of project progress stores at least one instruction. The processing module reads and executes the instruction to implement the three-dimensional display method of project progress as described in any one of claims 1-3.

Images