Intelligent construction comprehensive management system and method

Abstract

The embodiment of the invention provides an intelligent construction comprehensive management system and method, and relates to the technical field of construction equipment comprehensive management, and the system comprises a data layer, a construction layer, a platform layer and a visualization layer. The data layer, the construction layer and the platform layer are in communication connection with one another through an edge computing gateway; wherein the data layer provides data support for model training in the construction layer; the construction layer provides a multi-modal fusion model for the platform layer; the platform layer performs intelligent scheduling of each module according to the multi-modal fusion model provided by the construction layer; and the visualization layer is connected with the platform layer according to an interface provided by the platform layer, and is used for controlling the platform layer and displaying information. According to the invention, the real-time data collected by the sensor and the camera is utilized to train the multi-modal fusion model, and the model is utilized to perform unified scheduling of the platform, so that the digitization, automation and intelligence of construction management are further enhanced.

Description

Technical Field

[0001] The present application relates to the technical field of integrated construction equipment management, and more specifically, to an intelligent integrated construction management system and method. Background Art

[0002] It cannot adapt to the current development, so it must be guided by digital technology, integrate the current emerging information industry technology, and apply advanced construction project management theory. Digital construction is the inevitable direction of the transformation and upgrading of the construction industry.

[0003] Common problems with existing smart construction integrated management products include:

[0004] (1) Faced with a large number of devices from different manufacturers and models, the data types collected by the devices are inevitably multi-source heterogeneous, but the massive amount of data cannot be effectively processed and utilized.

[0005] (2) Traditional models may only process a single type of data; they have difficulty understanding the context of the data; they may perform well on a specific data set, but have poor generalization capabilities in new scenarios. The actual construction site situation is complex and diverse. Summary of the invention

[0006] The embodiments of the present application provide a smart construction integrated management system and method to solve the technical problems existing in the prior art.

[0007] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.

[0008] According to a first aspect of an embodiment of the present application, there is provided a smart construction integrated management system, comprising: a data layer, a construction layer, a platform layer and a visualization layer;

[0009] The data layer, the construction layer and the platform layer are connected to each other through an edge computing gateway;

[0010] Wherein, the data layer provides data support for model training in the construction layer;

[0011] The construction layer provides a multimodal fusion model for the platform layer;

[0012] The platform layer performs intelligent scheduling of each module according to the multimodal fusion model provided by the construction layer;

[0013] The visualization layer is connected to the platform layer according to an interface provided by the platform layer, and is used to control the platform layer and display information.

[0014] In some embodiments of the present application, based on the aforementioned solution, the data layer includes: sensors and cameras;

[0015] Wherein, the sensor and the camera are used to obtain construction equipment data;

[0016] The sensor and the camera are registered with the platform layer through an edge computing gateway.

[0017] In some embodiments of the present application, based on the aforementioned solution, the construction layer includes: a storage layer;

[0018] The storage layer is used to store the data uploaded by the data layer and the correction data of the automatic processing results of the platform layer operated by the user in the visualization layer.

[0019] In some embodiments of the present application, based on the aforementioned solution, the platform layer includes: a platform management center and a platform device registration center;

[0020] The platform management center is used for safety monitoring, identification and early warning, dust-spraying monitoring and processing, and equipment failure prediction;

[0021] The platform equipment registration center is used to register equipment that collects construction equipment data and manage registered equipment.

[0022] According to a second aspect of the embodiment of the present application, a smart construction integrated management method is provided, including:

[0023] Obtain and upload construction equipment data collected by sensors installed in construction equipment and cameras installed at construction sites;

[0024] Performing ELT processing on the construction equipment data, performing model training and multimodal fusion based on the ELT-processed construction equipment data, and obtaining a multimodal fusion model;

[0025] Monitoring and processing are performed based on the multimodal fusion model, and the processing results are sent to corresponding personnel according to the weight levels.

[0026] In some embodiments of the present application, based on the above solution, it also includes:

[0027] Register the sensors installed in the construction equipment and the cameras installed at the construction site with the platform equipment registration center;

[0028] Registered sensors and cameras periodically send device survival messages to the platform device registration center;

[0029] If the platform device registration center does not receive the device survival message within the set time, it is determined that the sensor or camera is faulty.

[0030] In some embodiments of the present application, based on the aforementioned solution, the monitoring process based on the multimodal fusion model includes:

[0031] Acquire real-time construction equipment data, process the real-time construction equipment data based on the multimodal fusion model, and obtain the operation data and operation status of the construction equipment.

[0032] In some embodiments of the present application, based on the above scheme, the monitoring process includes:

[0033] On-site operation safety monitoring and processing, personnel identity security identification and authentication monitoring and processing, on-site vehicle equipment safety management monitoring and processing, dust-spraying monitoring and processing, and equipment failure monitoring and processing.

[0034] The technical solution of this application utilizes sensor equipment and cameras deployed at the construction site to collect and normalize data in real time, train multimodal fusion models, and use the models to perform unified scheduling on the platform, thereby further enhancing the digitization, automation, and intelligence of construction management.

[0035] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0037] Figure 1 A block diagram of a smart construction integrated management system according to an embodiment of the present application is shown;

[0038] Figure 2 A flow chart of a smart construction integrated management system according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0039] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.

[0040] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0041] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0042] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0043] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution in the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiment of the present invention. Obviously, the described embodiment is only a part of the embodiment of the present invention, not all the embodiments. Based on the embodiment of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0044] Some embodiments of the present application will be described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments may be combined with each other.

[0045] See also Figure 1 , shows a block diagram of a smart construction integrated management system according to an embodiment of the present application.

[0046] like Figure 1 As shown, a smart construction integrated management system is presented, including: data layer, construction layer, platform layer and visualization layer;

[0047] The data layer, the construction layer and the platform layer are connected to each other through an edge computing gateway;

[0048] Wherein, the data layer provides data support for model training in the construction layer;

[0049] The construction layer provides a multimodal fusion model for the platform layer;

[0050] The platform layer performs intelligent scheduling of each module according to the multimodal fusion model provided by the construction layer;

[0051] The visualization layer is connected to the platform layer according to an interface provided by the platform layer, and is used to control the platform layer and display information.

[0052] like Figure 1 As shown, the visualization layer includes: client, WEB, mobile and large screen. The client, WEB, mobile and large screen can all receive relevant data, which is convenient for management personnel to view and monitor, and for relevant operators at the construction site to receive early warning messages in time and go to investigate and maintain, thereby realizing the overall intelligent scheduling function.

[0053] In some feasible embodiments, based on the aforementioned solution, the data layer includes: sensors and cameras;

[0054] Wherein, the sensor and the camera are used to obtain construction equipment data;

[0055] The sensor and the camera are registered with the platform layer through an edge computing gateway.

[0056] It should be noted that sensors are arranged at the construction site, such as in equipment and facilities such as sprinkler equipment and excavators, and cameras are arranged in various construction function monitoring areas at the construction site to collect real-time operation data of equipment and facilities and real-time monitoring image data.

[0057] The construction equipment data collected by sensors and cameras are transmitted to the construction layer through the edge computing gateway for unified storage.

[0058] In some feasible embodiments, based on the aforementioned solution, the construction layer includes: a storage layer;

[0059] The storage layer is used to store the data uploaded by the data layer and the correction data of the automatic processing results of the platform layer operated by the user in the visualization layer.

[0060] It should be noted that the correction data is used to fine-tune the multimodal fusion model.

[0061] like Figure 1 As shown in the figure, the construction layer also includes modules such as ELT service, abstract embedding features, feature fusion and task-based decision-making, through which a multimodal fusion model can be constructed.

[0062] The multimodal fusion model constructed by the construction layer will be uploaded to the platform layer after construction is completed. At the same time, the model will be compressed and trimmed and sent to the edge computing gateway. The edge computing gateway is used to quickly and autonomously respond to small local events, reduce bandwidth usage, and reduce the computing pressure of the platform. At the same time, it avoids the inability to handle local events in a timely manner due to network delays, communication failures with the platform, or other situations where the platform service cannot be accessed.

[0063] In some feasible embodiments, based on the aforementioned solution, the platform layer includes: a platform management center and a platform device registration center;

[0064] The platform management center is used for safety monitoring, identification and early warning, dust-spraying monitoring and processing, and equipment failure prediction;

[0065] The platform equipment registration center is used to register equipment that collects construction equipment data and manage registered equipment.

[0066] like Figure 1 As shown, the platform management center includes: a safety monitoring identification and early warning module, a dust-spraying monitoring and processing module, and an equipment failure prediction module.

[0067] Among them, the safety monitoring, identification and early warning module includes: on-site operation safety monitoring and processing sub-module, personnel identity safety identification and authentication monitoring and processing sub-module and on-site vehicle equipment safety management and processing sub-module.

[0068] When a problem is discovered, the platform will automatically execute the corresponding instructions and send an alarm message to relevant personnel based on the severity of the problem for them to handle, and issue a safety assessment to relevant personnel within the scheduled time.

[0069] The dust-spraying monitoring and processing module collects and transmits data from various air environment monitoring sensors (PM2.5, air temperature and humidity, wind speed, wind direction, etc.) in real time, and performs calculations and processing on the edge computing gateway. If the data volume exceeds the threshold, it is transmitted and calculated to the platform layer to control the spraying system for dust reduction treatment.

[0070] The equipment fault prediction module collects the equipment's operating data in real time and transmits it to the edge computing gateway for calculation and processing. If the data volume exceeds the threshold, it is transmitted to the platform layer for calculation to predict the equipment's fault condition and facilitate troubleshooting and maintenance by relevant personnel.

[0071] Based on the same inventive concept, the present application also provides a smart construction integrated management method, see Figure 2 , showing a flow chart of a smart construction integrated management method according to an embodiment of the present application.

[0072] like Figure 2As shown, a smart construction integrated management method is demonstrated, which is applied to a smart construction integrated management system provided in the above embodiment, and specifically includes steps S100 to S300.

[0073] refer to Figure 2 , step S100, the data layer obtains the construction equipment data collected by the sensors installed in the construction equipment and the cameras installed at the construction site and uploads it to the construction layer.

[0074] In some feasible embodiments, based on the above solution, the method further includes:

[0075] Register the sensors installed in the construction equipment and the cameras installed at the construction site with the platform equipment registration center;

[0076] Registered sensors and cameras periodically send device survival messages to the platform device registration center;

[0077] If the platform device registration center does not receive the device survival message within the set time, it is determined that the sensor or camera is faulty.

[0078] It should be noted that after receiving the device survival message, the platform device registration center will return a corresponding confirmation reply message.

[0079] It should be noted that after determining that a sensor or camera is faulty, the platform equipment registration center will notify relevant personnel to go for inspection and repair.

[0080] Continue to refer Figure 2 , step S200, the construction layer performs ELT processing on the construction equipment data, performs model training and multimodal fusion based on the construction equipment data after ELT processing, and obtains a multimodal fusion model.

[0081] It should be noted that ELT, which stands for "Extract", "Transform" and "Load", is a classic data integration method.

[0082] In this embodiment, the ELT process includes:

[0083] The construction equipment data uploaded in step S100 is extracted and loaded into the construction layer, and then the data is converted and processed.

[0084] Continue to refer Figure 2 , step S300, performing monitoring processing based on the multimodal fusion model, and sending the processing results to corresponding personnel according to the weight level.

[0085] In some feasible embodiments, based on the above solution, the monitoring process based on the multimodal fusion model includes:

[0086] Acquire real-time construction equipment data, process the real-time construction equipment data based on the multimodal fusion model, and obtain the operation data and operation status of the construction equipment.

[0087] In this embodiment, the monitoring process includes:

[0088] On-site operation safety monitoring and processing, personnel identity security identification and authentication monitoring and processing, on-site vehicle equipment safety management monitoring and processing, dust-spraying monitoring and processing, and equipment failure monitoring and processing.

[0089] In summary, the safety monitoring, identification and early warning module in the technical solution of this application can monitor and early warning of on-site personnel identification and authentication, on-site operation safety, and on-site vehicle equipment safety. The dust-spraying monitoring and processing module can monitor the dust situation at the construction site and control the spraying system to reduce dust. The equipment failure prediction module can predict the possible future operating status of the equipment. All of them can transmit information to the management platform. If a problem occurs, the module will automatically execute the specified instruction action and send an abnormal notification to relevant personnel at the same time. Users can receive the abnormal notification sent by the platform on the terminal device or view it on the management platform and process it, thereby improving the management level, management efficiency and project safety.

[0090] Through this technical solution, relevant personnel can perform secondary processing on the system's processing results in the management system. This processing will be fed back to the model, and the model will be corrected and updated accordingly, thereby improving the accuracy of the system processing.

[0091] The multimodal model in this technical solution can use data from one modality to enhance the understanding of another modality. The fusion of multiple modalities can provide comprehensive analysis, thereby reducing the misjudgment rate of system processing results and ensuring the robustness of the project.

[0092] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary techniques in the art that are not disclosed in the present application. It should be understood that the present application is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A smart construction integrated management system, characterized in that: include: Data layer, construction layer, platform layer and visualization layer; The data layer, the construction layer and the platform layer are connected to each other through an edge computing gateway; Wherein, the data layer provides data support for model training in the construction layer; The construction layer provides a multimodal fusion model for the platform layer; The platform layer performs intelligent scheduling of each module according to the multimodal fusion model provided by the construction layer; The visualization layer is connected to the platform layer according to an interface provided by the platform layer, and is used to control the platform layer and display information.

2. The system according to claim 1, characterized in that The data layer includes: sensors and cameras; Wherein, the sensor and the camera are used to obtain construction equipment data; The sensor and the camera are registered with the platform layer through an edge computing gateway.

3. The system according to claim 1, characterized in that The construction layer includes: a storage layer; The storage layer is used to store the data uploaded by the data layer and the correction data of the automatic processing results of the platform layer operated by the user in the visualization layer.

4. The system according to claim 1, characterized in that The platform layer includes: a platform management center and a platform device registration center; The platform management center is used for safety monitoring, identification and early warning, dust-spraying monitoring and processing, and equipment failure prediction; The platform equipment registration center is used to register equipment that collects construction equipment data and manage registered equipment.

5. A smart construction integrated management method, applied to the system as claimed in any one of claims 1 to 4, characterized in that: include: Obtain and upload construction equipment data collected by sensors installed in construction equipment and cameras installed at construction sites; Performing ELT processing on the construction equipment data, performing model training and multimodal fusion based on the ELT-processed construction equipment data, and obtaining a multimodal fusion model; Monitoring and processing are performed based on the multimodal fusion model, and the processing results are sent to corresponding personnel according to the weight levels.

6. The method according to claim 5, characterized in that Also includes: Register the sensors installed in the construction equipment and the cameras installed at the construction site with the platform equipment registration center; Registered sensors and cameras periodically send device survival messages to the platform device registration center; If the platform device registration center does not receive the device survival message within the set time, it is determined that the sensor or camera is faulty.

7. The method according to claim 5, characterized in that The monitoring process based on the multimodal fusion model includes: Acquire real-time construction equipment data, process the real-time construction equipment data based on the multimodal fusion model, and obtain the operation data and operation status of the construction equipment.

8. The method according to claim 7, characterized in that The monitoring process includes: On-site operation safety monitoring and processing, personnel identity security identification and authentication monitoring and processing, on-site vehicle equipment safety management monitoring and processing, dust-spraying monitoring and processing, and equipment failure monitoring and processing.

Images