Intelligent construction monitoring platform based on digital twinning and monitoring method thereof

Abstract

The embodiment of the invention discloses an intelligent construction monitoring platform based on digital twinning and a monitoring method thereof. According to one specific embodiment, the intelligent construction monitoring platform based on digital twinning comprises a data acquisition module, a project management module, a material management module, an inspection module, a mechanical management module, a safety management module, a quality management module and a digital twinning module, the data acquisition module is respectively in communication connection with the safety management module, the quality management module and the digital twin module; the project management module is in communication connection with the quality management module and the digital twinning module. The material management module is in communication connection with the quality management module and the digital twinning module. The inspection module is respectively in communication connection with the safety management module, the quality management module and the digital twin module; the mechanical management module is in communication connection with the quality management module and the digital twin module. And the safety management module is in communication connection with the digital twin module. According to the implementation mode, the construction safety can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of digital twin technology, and specifically to a smart construction monitoring platform and a monitoring method thereof based on digital twins. Background Art

[0002] The digital twin smart platform is mainly the popularization and application of the new generation of information technology (such as the Internet of Things, cloud computing, big data, artificial intelligence, etc.) and the concept of Industry 4.0. The rapid development of these technologies has made it easier to obtain, share, manage and analyze data on construction sites, making intelligent management of construction sites more feasible. At the same time, the industry's urgent need to improve construction efficiency, reduce engineering construction costs, and enhance the safety and environmental protection of the construction process, as well as the society's high attention to the quality and safety of construction projects, have also promoted the development and application of digital twin smart platform technology. Digital twin technology is widely used in product design, product manufacturing, medical analysis and other fields, but due to the complex environment of the construction site, digital twin technology has not been widely used in the field of construction engineering. In addition, during the construction process of construction projects, how to monitor the safety hazards of the construction site through digital twin technology is an important direction for improving construction safety. Summary of the invention

[0003] The content of this application is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this application is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0004] Some embodiments of the present application propose a smart construction monitoring platform and a monitoring method based on digital twins to solve one or more of the technical problems mentioned in the above background technology section.

[0005] In the first aspect, some embodiments of the present application provide a smart construction monitoring platform based on digital twins, and the above-mentioned smart construction monitoring platform based on digital twins includes: a data acquisition module, a project management module, a material management module, an inspection module, a machinery management module, a safety management module, a quality management module, and a digital twin module, wherein the above-mentioned data acquisition module is communicatively connected with the above-mentioned safety management module, the above-mentioned quality management module, and the above-mentioned digital twin module respectively; the above-mentioned project management module is communicatively connected with the above-mentioned quality management module and the above-mentioned digital twin module respectively; the above-mentioned material management module is communicatively connected with the above-mentioned quality management module and the above-mentioned digital twin module respectively; the above-mentioned inspection module is communicatively connected with the above-mentioned safety management module, the above-mentioned quality management module, and the above-mentioned digital twin module respectively; the above-mentioned machinery management module is communicatively connected with the above-mentioned The quality management module and the digital twin module are respectively communicatively connected; the safety management module is communicatively connected to the digital twin module; the quality management module is communicatively connected to the digital twin module; the material management module includes: material type module, supply-side information module, material planning module, first material flow information module, material application module, material administrator setting module, material acquisition module, second material flow information module, material receiving module, and warehouse management module; the safety management module includes: safety hazard library module, safety hazard management module, and safety inspection module; the quality management module includes: quality hazard library module, quality hazard management module, and quality inspection module; the machinery management module includes: machinery equipment module, equipment user module, equipment entry and exit module, and equipment adjustment module.

[0006] Optionally, the above-mentioned smart construction monitoring platform also includes: a login module, a permission management module, wherein the above-mentioned login module is used to: register user login information, and log in to the smart construction monitoring platform; the above-mentioned project management module includes: a project information module, a construction supply-side module, and a construction user information module; the above-mentioned inspection module includes: a patrol point recording module, a patrol point management module, a patrol point template module, and a patrol route management module.

[0007] Optionally, the material management module is used to obtain construction material information, wherein the construction material information includes material type information, supply-side information, material planning information, first material flow information, material application information, material manager information, material acquisition information, second material flow information, material receiving information, and material storage information; the material type module is used to add, modify, and check the material type information, wherein the material type information includes material identification and material name; the supply-side information module is used to add, delete, modify, and check the supply-side information, wherein the supply-side information includes supply-side identification and supply-side name; the material planning module is used to add, modify, and check the material planning information , wherein the material planning information includes: material planning identification, material planning name, material planning date, material identification, material name, supply end identification, supply end name, material planning quantity, material planning administrator name, material planning result; the above-mentioned first material flow information module is used to: perform additional check processing on the first material flow information, wherein the first material flow information includes: first material flow identification, material identification, material name, project identification, project name, first material flow status, first material flow time, first planned flow quantity, first actual flow quantity, first material flow information result; the above-mentioned material application module is used to: perform additional check processing on the material application information, wherein the material application The information includes: material application identification, material application name, material identification, material name, material application status, material circulation time, material circulation method, and material circulation number; the material administrator setting module is used to: perform additional check processing on the material administrator information, wherein the material administrator information includes: material administrator identification, material administrator name, circulation administrator name, and creation time; the material acquisition module is used to: view material acquisition information, wherein the material acquisition information includes: material acquisition identification, material acquisition name, material identification, material name, supply end identification, supply end name, material acquisition quantity, project identification, project name, material acquisition value attribute information, material acquisition time, material The name of the material acquisition administrator; the above-mentioned second material flow information module is used for: performing additional check processing on the second material flow information, wherein the second material flow information includes: the second material flow identification, material identification, material name, project identification, project name, second material flow status, second material flow time, and second flow quantity; the above-mentioned material receiving module is used for: performing additional check processing on the material receiving information, wherein the material receiving information includes: material receiving identification, material identification, material name, project identification, project name, and supplier name; the above-mentioned warehouse management module is used for: monitoring material storage information, wherein the material storage information includes: material identification, material name, material balance, and material warning status.

[0008] Optionally, the above-mentioned safety hazard library module is used to: perform additional checks on safety hazard category information, wherein the safety hazard category information includes: safety hazard category identification, safety hazard content, safety hazard level, and safety hazard category status; the above-mentioned safety hazard management module is used to: view safety hazard information, wherein the safety hazard information includes: safety hazard identification, safety inspection category, safety hazard level, safety inspection location, safety hazard content, safety hazard status, rectification date, and rectification administrator name; the above-mentioned safety inspection module is used to: generate safety hazard information; the above-mentioned quality hazard library module is used to: perform additional checks on quality hazard category information, wherein the quality hazard category information includes: quality hazard category identification, quality hazard content, quality hazard level, and quality hazard category status; the above-mentioned quality hazard management module is used to: view quality hazard information, wherein the quality hazard information includes: quality hazard identification, quality inspection category, quality hazard level, quality inspection location, quality hazard content, quality hazard status, rectification date, and rectification administrator name; the above-mentioned quality inspection module is used to: For: generating quality hazard information; the above-mentioned mechanical equipment module is used for: adding, deleting, modifying and checking the mechanical equipment information, wherein the mechanical equipment information includes: equipment number, equipment type, equipment name, equipment value type, equipment online status, equipment operating status, equipment model, equipment activation time, and equipment operator name; the above-mentioned equipment user module is used for: adding, modifying and checking the equipment operator information, wherein the equipment operator information includes: equipment operator name, equipment operator identification, equipment type, and equipment number; the above-mentioned equipment entry and exit module is used for: adding, modifying and checking the equipment scheduling information, wherein the equipment scheduling information includes: equipment scheduling number, equipment number, equipment type, project name, scheduling operator name, equipment scheduling date, equipment scheduling duration, equipment scheduling type, and equipment scheduling status; the above-mentioned equipment adjustment module is used for: adding, modifying and checking the equipment adjustment information, wherein the equipment adjustment information includes: equipment adjustment number, equipment number, equipment category, entry project name, equipment entry date, exit project name, equipment exit date, and equipment usage duration.

[0009] Optionally, the project information module is used to: perform additional check processing on the construction project information, wherein the construction project information includes: project identification, project name, project address, project administrator name, project type, and project status; the participating supply-side module is used to: perform addition, deletion, modification, and query processing on the participating supply-side information, wherein the participating supply-side information includes: participating supply-side identification, participating supply-side name, and participating administrator name; the construction user information module is used to: perform additional check processing on the construction user information, wherein the construction user information includes: construction user identification, construction user name, participating supply-side identification, and participating supply-side name; the patrol point record module is used to: view the patrol point record information, wherein the patrol point record information includes: patrol point name, patrol point status, creation time, and patrol administrator name; the patrol point management module is used to: perform additional check processing on the patrol point information The patrol point information is added, modified and checked, wherein the patrol point information includes: patrol point name, patrol point location, patrol administrator name, patrol QR code, patrol type, patrol number, patrol start date, and patrol point template name; the above-mentioned patrol point template module is used to: add, delete, modify and check the patrol point template information, wherein the patrol point template information includes: patrol point template name, confirmation items, number of pictures and texts, patrol point template status, creation time, creation administrator name, modification time, and modification administrator name; the above-mentioned patrol route management module is used to: add, delete, modify and check the patrol route information, wherein the patrol route information includes: patrol route name, patrol point name, patrol route status, patrol creation time, creation administrator name, modification time, and modification administrator name; the above-mentioned authority management module is used to: perform authority configuration processing on administrator information.

[0010] Optionally, the digital twin module is configured to: obtain construction site video from the data acquisition module; obtain construction project information from the project management module; obtain construction material information from the material management module; obtain patrol route information from the inspection module; obtain machinery and equipment information and equipment scheduling information from the machinery management module; obtain safety hazard information from the safety management module; obtain quality hazard information from the quality management module; construct a three-dimensional construction model based on the construction site video; construct a physical construction model based on the construction project information, the construction material information, the machinery and equipment information and the equipment scheduling information; construct a user behavior model based on the patrol route information; construct a construction twin model based on the three-dimensional construction model, the physical construction model, the user behavior model, the safety hazard information and the quality hazard information.

[0011] Optionally, the safety inspection module is configured to: obtain construction site video from the data acquisition module; obtain patrol route information from the inspection module; input the construction site video and the patrol route information into a pre-trained safety hazard identification model to obtain safety hazard information.

[0012] Optionally, the safety inspection module is further configured to: obtain a training sample set, wherein the training samples in the training sample set include: sample construction site videos, sample patrol route information and sample safety hazard information; determine an initial safety hazard identification model, wherein the initial safety hazard identification model includes: an initial image feature extraction model, an initial target detection model, an initial patrol feature extraction model, and an initial encoding model; select target training samples from the training sample set; perform key frame extraction processing on the sample construction site videos included in the selected target training samples to generate an initial construction image information sequence; perform image enhancement processing on each initial construction image information sequence in the initial construction image information sequence to generate initial construction enhanced image information, and obtain an initial construction enhanced image information sequence. ; Input each initial construction enhancement picture information in the initial construction enhancement picture information sequence into the initial picture feature extraction model to generate initial picture feature information and obtain an initial picture feature information sequence; input the initial picture feature information sequence into the initial target detection model to obtain initial detection information; input the sample patrol route information included in the selected target training sample into the initial patrol feature extraction model to obtain initial patrol feature information; input the initial detection information and the initial patrol feature information into the initial coding model to obtain initial safety hazard information; based on a preset loss function, determine the difference value between the initial safety hazard information and the sample safety hazard information included in the selected target training sample; in response to determining that the difference value is greater than or equal to the preset difference value, adjust the network parameters of the initial safety hazard identification model.

[0013] Optionally, the safety inspection module is further configured to: in response to determining that the difference value is less than the preset difference value, determine the initial safety hazard identification model as the trained safety hazard identification model.

[0014] In the second aspect, some embodiments of the present application provide a monitoring method based on digital twins, which is applied to the above-mentioned smart construction monitoring platform based on digital twins, including: a data acquisition module obtains construction site video, and sends the construction site video to the safety management module, the quality management module and the digital twin module; the project management module obtains construction project information, and sends the construction project information to the quality management module and the digital twin module; the material management module obtains construction material information, and sends the construction material information to the quality management module and the digital twin module; the inspection module obtains patrol route information, and sends the patrol route information to the safety management module, the quality management module and the digital twin module; the machinery management module obtains machinery equipment information and equipment scheduling information, and sends the machinery equipment information and equipment scheduling information to the quality management module and the digital twin module; The full management module responds to receiving the construction site video and the patrol route information, determines the safety hazard information based on the above-mentioned construction site video and the above-mentioned patrol route information, and sends the above-mentioned safety hazard information to the above-mentioned digital twin module; the above-mentioned quality management module responds to receiving the construction site video, the construction project information, the construction material information, the patrol route information, the mechanical equipment information and the equipment scheduling information, determines the quality hazard information based on the above-mentioned construction site video, the above-mentioned construction project information, the above-mentioned construction material information, the above-mentioned patrol route information, the above-mentioned mechanical equipment information and the above-mentioned equipment scheduling information, and sends the above-mentioned quality hazard information to the digital twin module; the above-mentioned digital twin module responds to receiving the construction site video, the construction project information, the construction material information, the patrol route information, the mechanical equipment information, the equipment scheduling information, the safety hazard information and the quality hazard information, constructs a construction twin model, and sends the above-mentioned construction twin model to the target user terminal.

[0015] The above-mentioned embodiments of the present application have the following beneficial effects: the digital twin-based smart construction monitoring platform of some embodiments of the present application includes: a data acquisition module, a project management module, a material management module, an inspection module, a machinery management module, a safety management module, a quality management module, and a digital twin module. Thus, the construction site video can be shot through the data acquisition module so that the subsequent digital twin module can build a construction twin model. Secondly, the construction project information, construction material information, patrol route information, mechanical equipment information and equipment scheduling information, safety hazard information, and quality hazard information can be monitored respectively through the project management module, the material management module, the inspection module, the machinery management module, the safety management module, the quality management module, and the digital twin module so that the subsequent digital twin module can build a construction twin model. Then, the digital twin module can build a construction twin model based on the construction site video, the construction project information, the construction material information, the patrol route information, the mechanical equipment information and equipment scheduling information, the safety hazard information, and the quality hazard information. Thus, the digital twin can be applied to the safety monitoring of the construction site to promote the implementation of the digital twin in the field of construction safety. And because the constructed construction twin model takes into account more comprehensive information, it can monitor the construction project from all angles and effectively detect hidden dangers in the construction process, thereby improving construction safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other features, advantages and aspects of the embodiments of the present application will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0017] Figure 1 It is a structural schematic diagram of some embodiments of the digital twin-based smart construction monitoring platform according to the present application; Figure 2 It is a structural schematic diagram of some embodiments of the project management module, material management module, inspection module, machinery management module, safety management module, and quality management module of the digital twin-based smart construction monitoring platform of the present application; Figure 3 It is a structural schematic diagram of other embodiments of the digital twin-based smart construction monitoring platform according to the present application; Figure 4 It is a scenario diagram of the construction twin model of the digital twin-based smart construction monitoring platform of the present application; Figure 5 It is a flowchart of some embodiments of the digital twin-based monitoring method according to the present application. DETAILED DESCRIPTION

[0018] Embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present application. It should be understood that the drawings and embodiments of the present application are only for exemplary purposes and are not intended to limit the scope of protection of the present application.

[0019] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other.

[0020] It should be noted that the concepts such as "first" and "second" mentioned in this application are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0021] It should be noted that the modifications of "one" and "plurality" mentioned in the present application are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0022] The names of the messages or information exchanged between multiple devices in the embodiments of the present application are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0023] The present application will be described in detail below with reference to the accompanying drawings and in combination with embodiments.

[0024] refer to Figure 1-2 As shown, Figure 1 A structural schematic diagram of some embodiments of a digital twin-based smart construction monitoring platform according to the present application is shown. Figure 2 It is a schematic diagram of the structure of some embodiments of the project management module, material management module, inspection module, machinery management module, safety management module, and quality management module of the digital twin-based smart construction monitoring platform of this application. Figure 1-2 As shown, the above-mentioned smart construction monitoring platform based on digital twin includes: data acquisition module 1, project management module 2, material management module 3, inspection module 4, machinery management module 5, safety management module 6, quality management module 7, and digital twin module 8.

[0025] In some embodiments, the data acquisition module 1 is respectively connected in communication with the safety management module 6, the quality management module 7, and the digital twin module 8. The project management module 2 is respectively connected in communication with the quality management module 7 and the digital twin module 8. The material management module 3 is respectively connected in communication with the quality management module 7 and the digital twin module 8. The inspection module 4 is respectively connected in communication with the safety management module 6, the quality management module 7, and the digital twin module 8. The mechanical management module 5 is respectively connected in communication with the quality management module 7 and the digital twin module 8. The safety management module 6 is connected in communication with the digital twin module 8. The quality management module 7 is connected in communication with the digital twin module 8. Among them, the data acquisition module can be used to shoot videos of the construction project in operation. For example, the data acquisition module can be a drone.

[0026] Among them, the above-mentioned project management module 2 includes: project information module 21, construction supply module 22, construction user information module 23. The above-mentioned material management module 3 includes: material type module 31, supply information module 32, material planning module 33, first material flow information module 34, material application module 35, material manager setting module 36, material acquisition module 37, second material flow information module 38, material receiving module 39, warehouse management module 310. The above-mentioned inspection module 4 includes: patrol point recording module 41, patrol point management module 42, patrol point template module 43, patrol route management module 44. The above-mentioned mechanical management module 5 includes: mechanical equipment module 51, equipment user module 52, equipment entry and exit module 53, equipment adjustment module 54. The above-mentioned safety management module 6 includes: safety hazard library module 61, safety hazard management module 62, safety inspection module 63. The above-mentioned quality management module 7 includes: quality hazard library module 71, quality hazard management module 72, quality inspection module 73.

[0027] refer to Figure 3 As shown, Figure 3 The following is a schematic diagram showing the structure of some other embodiments of the digital twin-based smart construction monitoring platform according to the present application. Figure 3 As shown, the above-mentioned smart construction monitoring platform based on digital twins also includes: a login module 9 and a permission management module 10.

[0028] In some embodiments, the login module 9 is used to register user login information and log in to the smart construction monitoring platform. The user login information may include but is not limited to: user name, user nickname, mobile phone number, password. In practice, the user can first register the user login information, and then log in to the smart construction monitoring platform by entering the user login information.

[0029] Optionally, the material management module 3 is used to obtain construction material information. The construction material information may include material type information, supply-side information, material planning information, first material flow information, material application information, material manager information, material acquisition information, second material flow information, material receiving information, and material storage information. In practice, the material management module may obtain construction material information from a terminal device by wired connection or wireless connection. Here, the material type information may represent the type of construction material. The supply-side information may represent the information of the supply-side for producing construction materials. The material planning information may represent the expected information for obtaining construction materials (material planning procurement information). The first material flow information may represent the flow of construction materials (outbound order). The material application information may represent the transportation of construction materials. The material manager information may represent the information of the manager (for example, the account reconciler, the data reviser, the material receiver, the material sender, the early warning processor, and the person in charge of procurement). The material acquisition information may represent the specific expected information for obtaining construction materials (purchase order). The second material flow information may represent the actual situation of the construction materials received (inbound order). Material receiving information can represent the situation of construction project receiving construction materials (material receiving order). Material storage information can represent the storage situation of construction materials (warehouse management).

[0030] It should be noted that the above wireless connection methods may include but are not limited to 3G / 4G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other wireless connection methods currently known or to be developed in the future.

[0031] The material type module 31 is used to add, modify and check the material type information. The material type information includes: material identification and material name. Here, the material identification can uniquely identify a construction material. The material name can represent the name of the construction material (for example, sand, earthwork, bluestone, mold, aluminum mold, sand, stone, metal mold, river sand, safety helmet, steel bar). In practice, first, the material type module can view the material type information from the material type database. The material type database can be a database used to store material type information in the material type module. Secondly, the material type module can obtain the target material type information from the terminal device through a wired connection or a wireless connection. The target material type information can represent the material type information that is not stored in the material type database. Then, the material type module can store the acquired target material type information in the material type database. Finally, the material type module can update the material type information stored in the material type database to the material type update information. In practice, the material type module can update the material type information stored in the material type database to the material type update information through the following steps: First, in response to receiving the material type update information input by the administrator, the material type module queries the material type information corresponding to the material type update information from the material type database. The material type update information can represent the material type information that the administrator wants to update. The material type information corresponding to the material type update information can be: the material type information in the material type database that has the same material identifier as the material type update information. Second, the material type information in the material type database that corresponds to the material type update information is updated to the material type update information.

[0032] The supply-side information module 32 is used to add, delete, modify and query the supply-side information. The supply-side information includes: a supply-side identifier and a supply-side name. The supply-side identifier can uniquely identify a supply-side that produces construction materials. In practice, first, the supply-side information module can view the supply-side information from the supply-side database. The supply-side database can be a database used to store supply-side information in the supply-side information module. Secondly, the supply-side information module can delete the supply-side information from the supply-side database. Then, the supply-side information module can obtain the target supply-side information from the terminal device via a wired connection or a wireless connection. The target supply-side information can represent the supply-side information that is not stored in the supply-side database. Then, the supply-side information module can store the target supply-side information in the supply-side database. Finally, the supply-side information module can update the supply-side information stored in the supply-side database to the supply-side update information. Among them, the specific implementation method in which the above-mentioned supply-side information module can update the supply-side information stored in the supply-side database to the supply-side update information and the technical effect brought about by it can refer to "the above-mentioned material type module can update the material type information stored in the material type database to the material type update information" in the above-mentioned embodiment, which will not be repeated here.

[0033] The material planning module 33 is used to perform additional check processing on the material planning information. The material planning information includes: material planning identification, material planning name, material planning date, material identification, material name, supply end identification, supply end name, material planning quantity, material planning administrator name, and material planning result. The material planning identification can uniquely determine a material planning information. The material planning date can represent the expected date for obtaining construction materials (the planned date for purchasing construction materials). The material planning quantity can represent the expected quantity of construction materials (the planned quantity of construction materials). The material planning administrator name can represent the name of the administrator who fills in the material planning information. The material planning result can be information representing "approval passed". The material planning result can also be information representing "approval rejected". In practice, first, the material planning module can view the material planning information from the material planning database. The material planning database can be a database used to store material planning information in the material planning module. Secondly, the material planning module can obtain the target material planning information from the terminal device through a wired connection or a wireless connection. The target material planning information can represent the material planning information that is not stored in the material planning database. Next, the material planning module may store the target material planning information in the material planning database.

[0034] The first material flow information module 34 is used to perform additional check processing on the first material flow information. The first material flow information includes: a first material flow identifier, a material identifier, a material name, a project identifier, a project name, a first material flow status, a first material flow time, a first planned flow quantity, a first actual flow quantity, and a first material flow information result. The first material flow identifier can uniquely determine a first material flow information. The first material flow status can be characterized by but not limited to: "approval passed", "approval rejected". The first material flow time can be characterized by the time when the construction material is shipped out of the warehouse. The first planned flow quantity can be the number of construction materials planned to be shipped out of the warehouse. The first actual flow quantity can be the number of construction materials actually shipped out of the warehouse. The first material flow information result can be characterized by "shipped". In practice, the first material flow information module can view the first material flow information from the first material flow database. The first material flow database can be a database used to store the first material flow information in the first material flow information module. Secondly, the first material flow information module can obtain the first target material flow information from the terminal device through a wired connection or a wireless connection. The first target material flow information may be first material flow information that is not stored in the first material flow database. Then, the first material flow information module may store the first target material flow information in the first material flow database.

[0035] The material application module 35 is used to perform additional check processing on the material application information. The material application information includes: material application identification, material application name, material identification, material name, material application status, material circulation time, material circulation method, and material circulation number. The material application identification can uniquely identify a material application information. The material application status can be information indicating "approval passed". The material application status can also be information indicating "approval rejected". The material circulation time can be the time when the construction material starts to be transported (delivery time). The material circulation method can be the method of transporting the construction material (for example, unattended automatic delivery). The material circulation number can be the number (license plate number) of the equipment for transporting the construction material. In practice, first, the material application module can view the material application information from the material application database. The material application database can be a database used to store the material application information in the material application module. Secondly, the material application module can obtain the target material application information from the terminal device through a wired connection or a wireless connection. The target material application information can be the material application information that is not stored in the material application database. Then, the material application module can store the target material application information in the material application database.

[0036] The material manager setting module 36 is used to perform additional check processing on the material manager information. Among them, the material manager information includes: material manager identification, material manager name, circulation manager name, and creation time. The material manager identification can uniquely identify an administrator (for example, account reconciler, data reviser, material receiver, material sender, warning handler, procurement manager). The circulation manager name can be the name of the administrator who created the material manager information. The circulation manager name can correspond to a circulation manager. The creation time can be the time when the circulation manager corresponding to the circulation manager name creates the material manager information. In practice, first, the material manager setting module can view the material manager information from the material manager database. Among them, the material manager database can be a database used to store material manager information in the material manager setting module. Secondly, the material manager setting module can obtain the target material manager information from the terminal device through a wired connection or a wireless connection. Among them, the target material manager information can be the material manager information that is not stored in the material manager database. Then, the material manager setting module can store the target material manager information in the material manager database.

[0037] The material acquisition module 37 is used to view material acquisition information. The material acquisition information includes material acquisition identification, material acquisition name, material identification, material name, supply end identification, supply end name, material acquisition quantity, project identification, project name, material acquisition value attribute information, material acquisition time, and material acquisition administrator name. The material acquisition identification can uniquely determine a material acquisition information. The material acquisition quantity can be the expected quantity (purchase quantity) of the construction materials. The material acquisition value attribute information can represent the value attribute value (purchase amount) of the construction materials. The material acquisition time can represent the time (purchase time) of acquiring the construction materials. The material acquisition administrator name can be the name of the administrator who acquires the construction materials (procurement manager). In practice, the material acquisition module can view the material acquisition information from the material acquisition database. The material acquisition database can be a database used to store material acquisition information in the material acquisition module.

[0038] The second material flow information module 38 is used to perform additional check processing on the second material flow information. The second material flow information includes: a second material flow identifier, a material identifier, a material name, a project identifier, a project name, a second material flow status, a second material flow time, and a second flow quantity. The second material flow identifier can uniquely determine a second material flow information. The second material flow status can be information representing "approval passed". The second material flow status can also be information representing "approval rejected". The second material flow time can represent the time (warehouse time) of the construction material received. The second flow quantity can represent the quantity (warehouse quantity) of the construction material received. In practice, first, the second material flow information module can view the second material flow information from the second material flow database. The second material flow database can be a database for storing the second material flow information in the second material flow information module. Secondly, the second material flow information module can obtain the second target material flow information from the terminal device by wired connection or wireless connection. The second target material flow information can be the second material flow information not stored in the second material flow database. Next, the second material flow information module may store the second target material flow information in a second material flow database.

[0039] The material receiving module 39 is used to perform additional check processing on the material receiving information. The material receiving information includes: material receiving identification, material identification, material name, project identification, project name, and supplier name. The material receiving identification can uniquely identify a material receiving information. In practice, firstly, the material receiving module can view the material receiving information from the material receiving database. The material receiving database can be a database used to store material receiving information in the material receiving module. Secondly, the material receiving module can obtain the target material receiving information from the terminal device through a wired connection or a wireless connection. The target material receiving information can be the material receiving information that is not stored in the material receiving database. Then, the material receiving module can store the target material receiving information in the material receiving database.

[0040] The above-mentioned warehouse management module 310 is used to: monitor material storage information. Among them, the material storage information includes: material identification, material name, material balance, and material warning status. Among them, the material balance can represent the number of construction materials stored in the construction warehouse. The material warning status can be information representing "the balance is small and a warning is required." The material warning status can also be information representing "sufficient balance." For example, when the material balance is less than the preset balance threshold, the material warning status is "the balance is small and a warning is required." When the material balance is greater than or equal to the preset balance threshold, the material warning status is "sufficient balance." For example, the preset balance threshold can be: 50.

[0041] Optionally, the above-mentioned safety hazard library module 61 is used to: perform additional check processing on the safety hazard category information. Among them, the safety hazard category information includes: safety hazard category identification, safety hazard content, safety hazard level, and safety hazard category status. Among them, the safety hazard category identification can uniquely determine a safety hazard category information. The safety hazard content can be characterized by but not limited to: "on-site construction safety", "electricity safety", "civilized construction management", "foundation pit safety management", "production safety management", and "safety hazard-foundation pit". The safety hazard level can be but not limited to: the first hazard level (general), the second hazard level (serious). The safety hazard category status can be information representing "disabled". The safety hazard category status can also be information representing "not disabled". In practice, first, the above-mentioned safety hazard library module can view the safety hazard category information from the safety hazard library. Among them, the safety hazard library can be a database in the safety hazard library module for storing safety hazard category information. Secondly, the above-mentioned safety hazard library module can obtain the target safety hazard category information from the terminal device through a wired connection or a wireless connection. Among them, the target safety hazard library category information can be safety hazard category information not stored in the safety hazard library. Next, the safety hazard library module may store the target safety hazard category information in the safety hazard library.

[0042] The above-mentioned safety hazard management module 62 is used to: view safety hazard information. Among them, the safety hazard information includes: safety hazard identification, safety inspection category, safety hazard level, safety inspection location, safety hazard content, safety hazard status, rectification date, and rectification administrator name. Among them, the safety hazard identification can uniquely determine a safety hazard information. The safety inspection category can be but not limited to: the first inspection category (random inspection), the second inspection category (superior inspection). The safety inspection location can be "deep foundation pit". The safety hazard status can be "pending rectification". The safety hazard status can also be "completed". The rectification date can be the date on which the rectification administrator rectifies the safety hazard. The rectification administrator can be an administrator who can rectify the safety hazard.

[0043] The safety inspection module 63 is used to generate potential safety hazards information. Here, the potential safety hazards information may represent potential safety hazards existing in the construction process. For example, potential safety hazards may include but are not limited to potential safety hazards existing in the foundation pit, potential safety hazards existing during on-site construction, and potential safety hazards existing during electricity use.

[0044] The quality hazard library module 71 is used to: perform additional inspection on the quality hazard category information. Among them, the quality hazard category information includes: quality hazard category identification, quality hazard content, quality hazard level, and quality hazard category status. Among them, the quality hazard category identification can uniquely determine a quality hazard category information. The quality hazard content can be characterized by but not limited to: "rebar construction", "support spraying", "waterproof construction", "foundation pit-flatness". The quality hazard level can be but not limited to: the first hazard level (general), the second hazard level (serious). The quality hazard category status can be information representing "disabled". The quality hazard category status can also be information representing "not disabled". In practice, first, the quality hazard library module can view the quality hazard category information from the quality hazard library. Among them, the quality hazard library can be a database for storing quality hazard category information in the quality hazard library module. Secondly, the quality hazard library module can obtain the target quality hazard category information from the terminal device by wired connection or wireless connection. Among them, the target quality hazard library category information can be quality hazard category information not stored in the quality hazard library. Then, the quality hazard library module can store the target quality hazard category information in the quality hazard library.

[0045] The quality hazard management module 72 is used to view quality hazard information. The quality hazard information includes quality hazard identification, quality inspection category, quality hazard level, quality inspection location, quality hazard content, quality hazard status, rectification date, and rectification administrator name. The quality hazard identification can uniquely identify a quality hazard information. The quality inspection category can be, but is not limited to, the first inspection category (random inspection), the second inspection category (superior inspection). The quality inspection location can be a "deep foundation pit". The quality hazard status can be "pending rectification". The quality hazard status can also be "pending re-inspection". The quality hazard status can also be "completed". The rectification date can be the date on which the rectification administrator rectifies the quality hazard. The rectification administrator can be an administrator who can rectify the quality hazard.

[0046] The quality inspection module 73 is used to generate quality hazard information. Here, the quality hazard information can represent the quality hazards existing in the construction process. For example, the quality hazards can be, but are not limited to, quality hazards existing in the foundation pit, quality hazards existing in the waterproofing construction, quality hazards existing in the steel bar construction, and quality hazards existing in the support spraying. For example, the specific implementation method of generating quality hazard information and the technical effects brought about by it can refer to the "generating safety hazard information" in the above embodiment, which will not be repeated here.

[0047] The mechanical equipment module 51 is used to add, delete, modify and query mechanical equipment information. The mechanical equipment information includes: equipment number, equipment type, equipment name, equipment value type, equipment online status, equipment operation status, equipment model, equipment activation time, and equipment operator name. The equipment number can uniquely identify a mechanical equipment (for example, a tower crane, a construction elevator). The equipment type can be, but not limited to: a first equipment type (tower crane), a second equipment type (construction elevator). The equipment value type can be, but not limited to: a first value type (owned equipment), a second value type (rented equipment). The equipment online status can be, but not limited to: an offline status, an online status. The equipment operation status can be, but not limited to: an idle status, an operation status. The equipment model can be the model of the mechanical equipment. The equipment activation time can be the time when the mechanical equipment starts to run. The equipment operator name can be the name of an administrator who can start and run the mechanical equipment. In practice, first, the mechanical equipment module can view the mechanical equipment information from the mechanical equipment database. The mechanical equipment database can be a database in the mechanical equipment module for storing mechanical equipment information. Secondly, the mechanical equipment module can delete the mechanical equipment information from the mechanical equipment database. Next, the mechanical equipment module can obtain the target mechanical equipment information from the terminal device through a wired connection or a wireless connection. Among them, the target mechanical equipment information can represent the mechanical equipment information that is not stored in the mechanical equipment database. Then, the mechanical equipment module can store the target mechanical equipment information in the mechanical equipment database. Finally, the mechanical equipment module can update the mechanical equipment information stored in the mechanical equipment database to mechanical equipment update information. In practice, the specific implementation method and technical effect brought about by the mechanical equipment module can update the mechanical equipment information stored in the mechanical equipment database to the mechanical equipment update information, which can refer to the "the material type module can update the material type information stored in the material type database to the material type update information" in the above embodiment, which will not be repeated here.

[0048] The above-mentioned device user module 52 is used to add, modify and query the device operator information. Among them, the device operator information includes: device operator name, device operator identification, device type, and device number. Among them, the device operator identification can uniquely identify a device operator. The device operator can be an administrator who can start and run the mechanical equipment. In practice, first, the above-mentioned device user module can view the device user information from the device user database. Among them, the device user database can be a database used to store device user information in the device user module. Then, the above-mentioned device user module can obtain the target device user information from the terminal device through a wired connection or a wireless connection. Among them, the target device user information can represent the device user information that is not stored in the device user database. Then, the above-mentioned device user module can store the target device user information in the device user database. Finally, the above-mentioned device user module can update the device user information stored in the device user database to the device user update information. In practice, the above-mentioned device user module can update the device user information stored in the device user database to the device user update information. The specific implementation method and the technical effect brought by it can refer to the "the above-mentioned material type module can update the material type information stored in the material type database to the material type update information" in the above-mentioned embodiment, which will not be repeated here.

[0049] The equipment entry and exit module 53 is used to add, modify and check the equipment scheduling information. The equipment scheduling information includes: equipment scheduling number, equipment number, equipment type, project name, scheduling operator name, equipment scheduling date, equipment scheduling duration, equipment scheduling type, and equipment scheduling status. The equipment scheduling number can uniquely determine an equipment scheduling information. The scheduling operator name can be the name of the administrator who applies for scheduling mechanical equipment. The equipment scheduling date can be the date when the mechanical equipment starts to be scheduled. The equipment scheduling duration can be the scheduling duration (use duration) of the mechanical equipment. The equipment scheduling type can be but not limited to: the first scheduling type (equipment entry form) and the second scheduling type (equipment exit form). The equipment scheduling status can be characterized by but not limited to: "approval passed" and "approval rejected". In practice, first, the equipment entry and exit module can view the equipment scheduling information from the equipment scheduling database. The equipment scheduling database can be a database used to store equipment scheduling information in the equipment entry and exit module. Then, the equipment entry and exit module can obtain the target equipment scheduling information from the terminal device through a wired connection or a wireless connection. The target equipment scheduling information can represent the equipment scheduling information that is not stored in the equipment scheduling database. Then, the equipment entry and exit module can store the target equipment scheduling information in the equipment scheduling database. Finally, the equipment entry and exit module can update the equipment scheduling information stored in the equipment scheduling database to the equipment scheduling update information. In practice, the specific implementation method and technical effect of the equipment entry and exit module that can update the equipment scheduling information stored in the equipment scheduling database to the equipment scheduling update information can refer to the "the material type module can update the material type information stored in the material type database to the material type update information" in the above embodiment, which will not be repeated here.

[0050] The equipment adjustment module 54 is used to add, modify and check the equipment adjustment information. The equipment adjustment information includes: equipment adjustment number, equipment number, equipment category, project name, equipment entry date, project name, equipment exit date, and equipment use time. The equipment adjustment number can uniquely determine an equipment adjustment information. The project name can represent the name of the project that requires mechanical equipment. The equipment entry date can represent the date when the mechanical equipment is dispatched to the project. The exit project name can be the name of the project that does not need to occupy the mechanical equipment. The equipment exit date can be the date when the mechanical equipment is transferred from the exit project. The equipment use time can be the length of time that the mechanical equipment is needed to be used for the project. In practice, first, the equipment adjustment module can view the equipment adjustment information from the equipment adjustment database. The equipment adjustment database can be a database used to store equipment adjustment information in the equipment adjustment module. Then, the equipment adjustment module can obtain the target equipment adjustment information from the terminal device by wired connection or wireless connection. The target equipment adjustment information can represent the equipment adjustment information that is not stored in the equipment adjustment database. Then, the equipment adjustment module can store the target equipment adjustment information in the equipment adjustment database. Finally, the equipment adjustment module can update the equipment adjustment information stored in the equipment adjustment database to the equipment adjustment update information. In practice, the specific implementation method and technical effect of the equipment adjustment module that can update the equipment adjustment information stored in the equipment adjustment database to the equipment adjustment update information can refer to the "the material type module can update the material type information stored in the material type database to the material type update information" in the above embodiment, which will not be repeated here.

[0051] Optionally, the project information module 21 is used to perform additional check processing on the construction project information. The construction project information includes: project identification, project name, project address, project administrator name, project type, and project status. The project identification can uniquely identify a construction project. The project administrator name can be the name of the administrator responsible for the construction project. The project status can be, but is not limited to, the first project status (stop work), the second project status (normal operation). For example, the project name can be "Smart Construction Site Demonstration Project". The project type can be "Relocation Project". In practice, first, the project information module can view the construction project information from the project information database. The project information database can be a database used to store construction project information in the project information module. Then, the project information module can obtain the target construction project information from the terminal device via a wired connection or a wireless connection. The target construction project information can represent the construction project information that is not stored in the project information database. Then, the project information module can store the target construction project information in the project information database.

[0052] The above-mentioned construction participating supply side module 22 is used to add, delete, modify and query the construction participating supply side information. Among them, the construction participating supply side information includes: construction participating supply side identification, construction participating supply side name, and construction participating administrator name. Among them, the construction participating supply side identification can uniquely identify a construction participating supply side. The construction participating administrator name can be the name of the administrator in the construction participating supply side who is responsible for managing the construction project. The construction participating supply side can be a supplier (construction participating unit) that participates in and undertakes the construction project. In practice, first, the construction participating supply side module can view the construction participating supply side information from the construction participating supply side database. Among them, the construction participating supply side database can be a database used to store construction participating supply side information in the construction participating supply side module. Secondly, the construction participating supply side module can delete the construction participating supply side information from the construction participating supply side database. Then, the construction participating supply side module can obtain the target construction participating supply side information from the terminal device through a wired connection or a wireless connection. Among them, the target construction participating supply side information can represent the construction participating supply side information that is not stored in the construction participating supply side database. Then, the above-mentioned construction participating supply-side module can store the target construction participating supply-side information in the construction participating supply-side database. Finally, the above-mentioned construction participating supply-side module can update the construction participating supply-side information stored in the construction participating supply-side database to the construction participating supply-side update information. In practice, the specific implementation method and technical effect brought about by the above-mentioned construction participating supply-side module that can update the construction participating supply-side information stored in the construction participating supply-side database to the construction participating supply-side update information can refer to the "the above-mentioned material type module can update the material type information stored in the material type database to the material type update information" in the above-mentioned embodiment, which will not be repeated here.

[0053] The above-mentioned construction user information module 23 is used to: perform additional check processing on the construction user information. Among them, the construction user information includes: construction user identification, construction user name, construction supply side identification, and construction supply side name. Among them, the construction user identification can uniquely identify a construction user. The construction user can be a user (worker) who participates in the construction project in the construction supply side. In practice, first, the above-mentioned construction user information module can view the construction user information from the construction user database. Among them, the construction user database can be a database used to store construction user information in the construction user information module. Then, the above-mentioned construction user information module can obtain the target construction user information from the terminal device through a wired connection or a wireless connection. Among them, the target construction user information can represent the construction user information that is not stored in the construction user database. Then, the above-mentioned construction user information module can store the target construction user information in the construction user database.

[0054] The patrol point record module 41 is used to view patrol point record information. The patrol point record information includes patrol point name, patrol point status, creation time, and patrol administrator name. The patrol point status can be characterized by but not limited to "normal" and "abnormal". The creation time can be the time when the patrol point record information is created. The patrol administrator name can be the name of the administrator used to create the patrol point record information. For example, the patrol point name can be but not limited to: "First patrol point", "Nanxiu Technology Gate", "Nanxiu Technology Fence", "Safety Electricity Inspection".

[0055] The patrol point management module 42 is used to add, modify and check patrol point information. The patrol point information includes: patrol point name, patrol point location, patrol administrator name, patrol QR code, patrol type, patrol number, patrol start date, and patrol point template name. The patrol type can be, but not limited to: first patrol type (only once), second patrol type (every day), third patrol type (every two days), and fourth patrol type (every week). The patrol number can represent the number of times the patrol administrator has patrolled the patrol point. The patrol start time can represent the time of the first patrol of the patrol administrator. The patrol point template name can be, but not limited to: first template, second template.

[0056] The above-mentioned patrol point template module 43 is used to add, delete, modify and query the patrol point template information. Among them, the patrol point template information includes: patrol point template name, confirmation items, number of pictures and texts, patrol point template status, creation time, creation administrator name, modification time, and modification administrator name. Among them, the confirmation items may include patrol points that need to be patrolled. The number of pictures and texts can represent the number of pictures that need to be taken of the patrol points. The patrol point template status can be represented by but not limited to: "disabled" and "not disabled". The creation time can be the time when the patrol point template information is created. The creation administrator name can be the name of the administrator who created the patrol point template information. The modification time can be the time when the patrol point template information is modified. The modification administrator name can be the name of the modified patrol point template information.

[0057] The patrol route management module 44 is used to add, delete, modify and check patrol route information. The patrol route information includes patrol route name, patrol point name, patrol route status, patrol creation time, creation administrator name, modification time, and modification administrator name. The patrol route status can be characterized by but not limited to: "normal" and "abnormal". The creation time can be the time when the patrol route information is created. The creation administrator name can be the name of the administrator who created the patrol route information. The modification time can be the time when the patrol route information is modified. The modification administrator name can be the name of the modified patrol route information.

[0058] The authority management module 10 is used to perform authority configuration processing on administrator information. The administrator information includes administrator name and project name. For example, the administrator can be associated with the construction project to grant the administrator authority to monitor the construction project.

[0059] Optionally, the digital twin module 8 is configured as follows: The first step is to obtain a construction site video from the data acquisition module 1. The construction site video may be a video shot by the data acquisition module.

[0060] The second step is to obtain construction project information from the project management module 2.

[0061] The third step is to obtain construction material information from the material management module 3.

[0062] The fourth step is to obtain patrol route information from the patrol module 4.

[0063] The fifth step is to obtain mechanical equipment information and equipment scheduling information from the mechanical management module 5.

[0064] The sixth step is to obtain safety hazard information from the safety management module 6.

[0065] The seventh step is to obtain quality risk information from the quality management module 7.

[0066] Step 8: Based on the above construction site video, a 3D construction model is constructed. In practice, the above digital twin model can be constructed based on the above construction site video by using a preset 3D model construction algorithm. For example, the preset 3D model construction algorithm can be a BIM (Building Information Modeling) model loaded and optimized using the Unity (test tool) tool.

[0067] The ninth step is to construct a physical construction model based on the above-mentioned construction project information, the above-mentioned construction material information, the above-mentioned mechanical equipment information and the above-mentioned equipment scheduling information. In practice, first, the above-mentioned digital twin model can fuse the above-mentioned construction project information, the above-mentioned construction material information, the above-mentioned mechanical equipment information and the above-mentioned equipment scheduling information based on the corresponding relationship between the construction project information, the construction material information, the above-mentioned mechanical equipment information and the equipment scheduling information to generate construction fusion information. Then, the above-mentioned digital twin model can construct a physical construction model based on the construction fusion information by using a preset physical model construction algorithm. Among them, the corresponding relationship between the construction project information, the construction material information, the mechanical equipment information and the equipment scheduling information can be: the project name included in the construction project information can correspond to the project name included in the material receiving information included in the construction material information; the project name included in the construction project information can correspond to the project name included in the equipment scheduling information; the equipment number included in the mechanical equipment information can correspond to the equipment number included in the equipment scheduling information. For example, the preset physical model construction algorithm can be a physical model construction algorithm. For example, a physical model building algorithm can be: based on physical characteristics and behavior laws (for example, the actual operation logic of construction equipment), establish physical equations or mathematical equations of the behavior of physical entities (for example, the mechanical model of a tower crane, the operation logic of an elevator).

[0068] Step 10: Based on the patrol route information, a user behavior model is constructed. In practice, the digital twin model can be constructed by presetting a user behavior construction algorithm based on the patrol route information to construct a user behavior model. For example, the preset user behavior construction algorithm can be: Improved Dense Trajectories algorithm.

[0069] The eleventh step is to construct a construction twin model based on the three-dimensional construction model, the physical construction model, the user behavior model, the safety hazard information, and the quality hazard information. In practice, the digital twin model can integrate the three-dimensional construction model, the physical construction model, the user behavior model, the safety hazard information, and the quality hazard information through preset simulation software to generate a construction twin model. For example, the preset simulation software can be but is not limited to: MATLAB Simulink (visual simulation tool), COMSOL Multiphysics (advanced numerical simulation software), AnyLogic (simulation software). For example, the construction twin model can refer to Figure 4 A schematic diagram of the construction twin model of the digital twin-based smart construction monitoring platform of the present application is shown.

[0070] Optionally, the security check module 63 is configured to: The first step is to obtain a construction site video from the data acquisition module 1. The construction site video may be a video shot by the data acquisition module.

[0071] The second step is to obtain patrol route information from the patrol module 4.

[0072] The third step is to input the construction site video and the patrol route information into a pre-trained safety hazard identification model to obtain safety hazard information. The safety hazard identification model can be a pre-trained neural network model that takes the construction site video and patrol route information as input and takes safety hazard information as output.

[0073] Optionally, the security check module 63 is further configured to: The first step is to obtain a training sample set, wherein the training samples in the training sample set include: sample construction site videos, sample patrol route information, and sample safety hazard information.

[0074] The second step is to determine the initial safety hazard identification model, which includes: an initial image feature extraction model, an initial target detection model, an initial patrol feature extraction model, and an initial coding model.

[0075] The initial image feature extraction model may be a neural network model that takes the initial construction enhancement image information as input and takes the initial image feature information as output. For example, the initial image feature extraction model may be a CNN (Convolutional Neural Network) model.

[0076] The initial target detection model may be a neural network model that takes the initial image feature information sequence as input and takes the initial inspection information as output, for example, the initial target detection model may be a YOLO (You Only Look Once, target detection algorithm) model. The initial inspection information may represent patrol points in the construction site video.

[0077] The initial patrol feature extraction model may be a neural network model that takes sample patrol route information as input and takes initial patrol feature information as output. For example, the initial feature extraction model may be a ResNet (residual network) model.

[0078] The initial encoding model may be a neural network model that takes initial detection information and initial patrol feature information as input and takes initial safety hazard information as output. For example, the initial encoding model may be an autoencoder model (AutoEncoder).

[0079] The third step is to select a target training sample from the training sample set. In practice, the security inspection module may randomly select a training sample from the training sample set as the target training sample.

[0080] In the fourth step, a key frame extraction process is performed on the sample construction site video included in the selected target training sample to generate an initial construction picture information sequence. In practice, the above-mentioned safety inspection module can perform a key frame extraction process on the sample construction site video included in the selected target training sample by using a preset key frame extraction algorithm to generate an initial construction picture information sequence. For example, the preset key frame extraction algorithm can be a key frame extraction algorithm based on a frame difference method.

[0081] In the fifth step, each of the initial construction picture information sequences in the initial construction picture information sequence is subjected to picture enhancement processing to generate initial construction enhanced picture information and obtain an initial construction enhanced picture information sequence. In practice, the above-mentioned safety inspection module can perform picture enhancement processing on each of the initial construction picture information sequences in the initial construction picture information sequence by using a preset picture enhancement algorithm to generate initial construction enhanced picture information and obtain an initial construction enhanced picture information sequence. For example, the preset picture enhancement algorithm can be, but is not limited to: a histogram equalization algorithm, a wavelet transform algorithm, and a Gamma (power law) transform algorithm.

[0082] In the sixth step, each initial construction enhancement picture information in the initial construction enhancement picture information sequence is input into the initial picture feature extraction model to generate initial picture feature information, thereby obtaining an initial picture feature information sequence.

[0083] In the seventh step, the initial image feature information sequence is input into the initial target detection model to obtain initial detection information.

[0084] In the eighth step, the sample patrol route information included in the selected target training sample is input into the initial patrol feature extraction model to obtain the initial patrol feature information.

[0085] In the ninth step, the initial detection information and the initial patrol feature information are input into the initial coding model to obtain the initial safety hazard information.

[0086] In the tenth step, based on a preset loss function, the difference value between the initial safety hazard information and the sample safety hazard information included in the selected target training sample is determined. For example, the preset loss function may be, but is not limited to: mean square error loss function (MSE), hinge loss function, cross entropy loss function (CrossEntropy), 0-1 loss function, absolute value loss function, log loss function, square loss function, exponential loss function, etc.

[0087] In step 11, in response to determining that the difference value is greater than or equal to the preset difference value, the network parameters of the initial safety hazard identification model are adjusted. For example, the difference value and the preset difference value can be calculated. On this basis, the parameters of the initial safety hazard identification model are adjusted using methods such as back propagation and gradient descent. For example, the preset difference value can be 0.1.

[0088] Optionally, the safety check module 63 is further configured to: in response to determining that the difference value is less than the preset difference value, determine the initial safety hazard identification model as the trained safety hazard identification model.

[0089] Thus, firstly, the feature information of the key frames in the construction site video can be extracted by the initial image feature extraction model. Secondly, the feature information of the patrol points in the construction site video can be detected by the initial target detection model. Then, the feature information in the patrol route information can be extracted by the initial patrol feature extraction model. Then, the safety hazard information existing in the construction process can be identified by combining the initial detection information and the initial patrol feature information representing the patrol points through the initial coding model. Therefore, a relatively accurate safety hazard identification model can be trained by training the initial safety hazard identification model including the initial image feature extraction model, the initial target detection model, the initial patrol feature extraction model, and the initial coding model. Thus, the safety hazard information identified by the safety hazard identification model, in addition to the patrol route information, also takes into account the construction site video, so that the accuracy of the identified safety hazard information is higher. Furthermore, the construction safety can be improved.

[0090] The above-mentioned embodiments of the present application have the following beneficial effects: the digital twin-based smart construction monitoring platform of some embodiments of the present application includes: a data acquisition module, a project management module, a material management module, an inspection module, a machinery management module, a safety management module, a quality management module, and a digital twin module. Thus, the construction site video can be shot through the data acquisition module so that the subsequent digital twin module can build a construction twin model. Secondly, the construction project information, construction material information, patrol route information, mechanical equipment information and equipment scheduling information, safety hazard information, and quality hazard information can be monitored respectively through the project management module, the material management module, the inspection module, the machinery management module, the safety management module, the quality management module, and the digital twin module so that the subsequent digital twin module can build a construction twin model. Then, the digital twin module can build a construction twin model based on the construction site video, the construction project information, the construction material information, the patrol route information, the mechanical equipment information and equipment scheduling information, the safety hazard information, and the quality hazard information. Thus, the digital twin can be applied to the safety monitoring of the construction site to promote the implementation of the digital twin in the field of construction safety. And because the constructed construction twin model takes into account more comprehensive information, it can monitor the construction project from all angles and effectively detect hidden dangers in the construction process, thereby improving construction safety.

[0091] The present application also provides a monitoring method based on digital twins, which is applied to the smart construction monitoring platform based on digital twins in the above embodiments, such as Figure 5 As shown, a flowchart of some embodiments of the monitoring method based on digital twins according to the present application is shown. The method may include the following steps: Step 501: The data acquisition module obtains the construction site video, and sends the construction site video to the safety management module, the quality management module and the digital twin module.

[0092] In some embodiments, the data acquisition module acquires construction site videos, and sends the construction site videos to the safety management module, the quality management module, and the digital twin module.

[0093] Step 502: The project management module obtains construction project information and sends the construction project information to the quality management module and the digital twin module.

[0094] In some embodiments, the project management module obtains construction project information, and sends the construction project information to the quality management module and the digital twin module.

[0095] Step 503: The material management module obtains construction material information and sends the construction material information to the quality management module and the digital twin module.

[0096] In some embodiments, the material management module obtains construction material information, and sends the construction material information to the quality management module and the digital twin module.

[0097] Step 504: The inspection module obtains the patrol route information, and sends the patrol route information to the security management module, the quality management module and the digital twin module.

[0098] In some embodiments, the inspection module obtains patrol route information, and sends the patrol route information to the security management module, the quality management module and the digital twin module.

[0099] Step 505: The mechanical management module obtains mechanical equipment information and equipment scheduling information, and sends the mechanical equipment information and equipment scheduling information to the quality management module and the digital twin module.

[0100] In some embodiments, the mechanical management module obtains mechanical equipment information and equipment scheduling information, and sends the above-mentioned mechanical equipment information and the above-mentioned equipment scheduling information to the above-mentioned quality management module and the above-mentioned digital twin module.

[0101] Step 506: In response to receiving the construction site video and patrol route information, the safety management module determines safety hazard information based on the construction site video and patrol route information, and sends the safety hazard information to the digital twin module.

[0102] In some embodiments, the above-mentioned safety management module responds to receiving the construction site video and the patrol route information, determines the safety hazard information based on the above-mentioned construction site video and the above-mentioned patrol route information, and sends the above-mentioned safety hazard information to the above-mentioned digital twin module.

[0103] Step 507, the quality management module responds to receiving the construction site video, construction project information, construction material information, patrol route information, machinery and equipment information and equipment scheduling information, and determines the quality hazard information based on the construction site video, construction project information, construction material information, patrol route information, machinery and equipment information and equipment scheduling information, and sends the quality hazard information to the digital twin module.

[0104] In some embodiments, the quality management module responds to receiving the construction site video, construction project information, construction material information, patrol route information, machinery and equipment information and equipment scheduling information, and determines the quality hazard information based on the construction site video, construction project information, construction material information, patrol route information, machinery and equipment information and equipment scheduling information, and sends the quality hazard information to the digital twin module.

[0105] Step 508: The digital twin module builds a construction twin model in response to receiving the construction site video, construction project information, construction material information, patrol route information, machinery and equipment information, equipment scheduling information, safety hazard information, and quality hazard information, and sends the construction twin model to the target user terminal.

[0106] In some embodiments, the digital twin module builds a construction twin model in response to receiving construction site videos, construction project information, construction material information, patrol route information, machinery and equipment information, equipment scheduling information, safety hazard information and quality hazard information, and sends the construction twin model to the target user terminal.

[0107] The above description is only some preferred embodiments of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present application is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the embodiments of the present application to form a technical solution.

Claims

1. A smart construction monitoring platform based on digital twins, characterized in that: The smart construction monitoring platform includes: data acquisition module, project management module, material management module, inspection module, machinery management module, safety management module, quality management module, and digital twin module, among which: The data acquisition module is communicatively connected with the safety management module, the quality management module, and the digital twin module respectively; The project management module is communicatively connected with the quality management module and the digital twin module respectively; The material management module is communicatively connected with the quality management module and the digital twin module respectively; The inspection module is communicatively connected with the safety management module, the quality management module, and the digital twin module respectively; The mechanical management module is communicatively connected with the quality management module and the digital twin module respectively; The security management module is communicatively connected with the digital twin module; The quality management module is communicatively connected with the digital twin module; The material management module includes: a material type module, a supply-side information module, a material planning module, a first material flow information module, a material application module, a material manager setting module, a material acquisition module, a second material flow information module, a material receiving module, and a warehouse management module; The safety management module includes: a safety hazard library module, a safety hazard management module, and a safety inspection module; The quality management module includes: a quality hidden danger database module, a quality hidden danger management module, and a quality inspection module; The mechanical management module includes: a mechanical equipment module, an equipment user module, an equipment entry and exit module, and an equipment adjustment module.

2. The digital twin-based intelligent construction monitoring platform according to claim 1 is characterized in that: The smart construction monitoring platform also includes: a login module and a rights management module, wherein: The login module is used to: register user login information and log in to the smart construction monitoring platform; The project management module includes: project information module, construction supply module, and construction user information module; The inspection module includes: a patrol point recording module, a patrol point management module, a patrol point template module, and a patrol route management module.

3. The digital twin-based intelligent construction monitoring platform according to claim 1 is characterized in that: The material management module is used to obtain construction material information, wherein the construction material information includes: material type information, supply end information, material planning information, first material flow information, material application information, material manager information, material acquisition information, second material flow information, material receiving information, and material storage information; The material type module is used to: perform addition, modification and query processing on material type information, wherein the material type information includes: material identification and material name; The supply-side information module is used to add, delete, modify and check the supply-side information, wherein the supply-side information includes: the supply-side identification and the supply-side name; The material planning module is used to: perform additional check processing on material planning information, wherein the material planning information includes: material planning identification, material planning name, material planning date, material identification, material name, supplier identification, supplier name, material planning quantity, material planning administrator name, and material planning results; The first material flow information module is used to: perform additional check processing on the first material flow information, wherein the first material flow information includes: the first material flow identification, the material identification, the material name, the project identification, the project name, the first material flow status, the first material flow time, the first planned flow quantity, the first actual flow quantity, and the first material flow information result; The material application module is used to: perform additional check processing on material application information, wherein the material application information includes: material application identification, material application name, material identification, material name, material application status, material circulation time, material circulation method, and material circulation number; The material manager setting module is used to: perform additional check processing on the material manager information, wherein the material manager information includes: material manager identification, material manager name, circulation manager name, and creation time; The material acquisition module is used to: view material acquisition information, wherein the material acquisition information includes: material acquisition identification, material acquisition name, material identification, material name, supplier identification, supplier name, material acquisition quantity, project identification, project name, material acquisition value attribute information, material acquisition time, and material acquisition administrator name; The second material flow information module is used to: perform additional check processing on the second material flow information, wherein the second material flow information includes: second material flow identification, material identification, material name, project identification, project name, second material flow status, second material flow time, and second flow quantity; The material receiving module is used to: perform additional check processing on the material receiving information, wherein the material receiving information includes: material receiving identification, material identification, material name, project identification, project name, and supplier name; The warehouse management module is used to monitor material storage information, wherein the material storage information includes material identification, material name, material remaining quantity, and material warning status.

4. The digital twin-based intelligent construction monitoring platform according to claim 1 is characterized in that: The safety hazard database module is used to: perform additional check processing on safety hazard category information, wherein the safety hazard category information includes: safety hazard category identification, safety hazard content, safety hazard level, and safety hazard category status; The safety hazard management module is used to: view safety hazard information, wherein the safety hazard information includes: safety hazard identification, safety inspection category, safety hazard level, safety inspection location, safety hazard content, safety hazard status, rectification date, and rectification administrator name; The safety inspection module is used to: generate safety hazard information; The quality hazard database module is used to: perform additional check processing on quality hazard category information, wherein the quality hazard category information includes: quality hazard category identification, quality hazard content, quality hazard level, and quality hazard category status; The quality hazard management module is used to: view quality hazard information, wherein the quality hazard information includes: quality hazard identification, quality inspection category, quality hazard level, quality inspection location, quality hazard content, quality hazard status, rectification date, and rectification administrator name; The quality inspection module is used to: generate quality risk information; The mechanical equipment module is used to add, delete, modify and check mechanical equipment information, wherein the mechanical equipment information includes: equipment number, equipment type, equipment name, equipment value type, equipment online status, equipment operation status, equipment model, equipment activation time, and equipment operator name; The device user module is used to: perform addition, modification and query processing on the device operator information, wherein the device operator information includes: device operator name, device operator identification, device type and device number; The equipment entry and exit module is used to: add, modify and check the equipment scheduling information, wherein the equipment scheduling information includes: equipment scheduling number, equipment number, equipment type, project name, scheduling operator name, equipment scheduling date, equipment scheduling duration, equipment scheduling type, and equipment scheduling status; The equipment adjustment module is used to add, modify and check equipment adjustment information, wherein the equipment adjustment information includes: equipment adjustment number, equipment number, equipment category, entry project name, equipment entry date, exit project name, equipment exit date, and equipment usage time.

5. The digital twin-based intelligent construction monitoring platform according to claim 2 is characterized in that: The project information module is used to: perform additional check processing on the construction project information, wherein the construction project information includes: project identification, project name, project address, project administrator name, project type, and project status; The construction supplier module is used to add, delete, modify and check the construction supplier information, where the construction supplier information includes: construction supplier identification, construction supplier name, and construction administrator name; The construction user information module is used to: perform additional check processing on the construction user information, wherein the construction user information includes: construction user identification, construction user name, construction supplier identification, and construction supplier name; The patrol point record module is used to: view patrol point record information, wherein the patrol point record information includes: patrol point name, patrol point status, creation time, and patrol administrator name; The patrol point management module is used to add, modify and check patrol point information, wherein the patrol point information includes: patrol point name, patrol point location, patrol administrator name, patrol QR code, patrol type, patrol number, patrol start date, and patrol point template name; The patrol point template module is used to add, delete, modify and check patrol point template information, wherein the patrol point template information includes: patrol point template name, confirmation items, number of pictures and texts, patrol point template status, creation time, creation administrator name, modification time, modification administrator name; The patrol route management module is used to add, delete, modify and check patrol route information, wherein the patrol route information includes: patrol route name, patrol point name, patrol route status, patrol creation time, creation administrator name, modification time, and modification administrator name; The authority management module is used to perform authority configuration processing on administrator information.

6. The digital twin-based intelligent construction monitoring platform according to claim 2 is characterized in that: The digital twin module is configured to: Obtain construction site video from the data acquisition module; Obtain construction project information from the project management module; Obtain construction material information from the material management module; Obtain patrol route information from the patrol module; Obtain mechanical equipment information and equipment scheduling information from the mechanical management module; Obtain security risk information from the security management module; Obtain quality risk information from the quality management module; Based on the construction site video, construct a three-dimensional construction model; Building a physical construction model based on the construction project information, the construction material information, the mechanical equipment information and the equipment scheduling information; Based on the patrol route information, a user behavior model is constructed; A construction twin model is constructed based on the three-dimensional construction model, the physical construction model, the user behavior model, the safety hazard information and the quality hazard information.

7. The digital twin-based intelligent construction monitoring platform according to claim 2 is characterized in that: The security check module is configured to: Obtain construction site video from the data acquisition module; Obtain patrol route information from the patrol module; The construction site video and the patrol route information are input into a pre-trained safety hazard identification model to obtain safety hazard information.

8. A monitoring method based on digital twins, applied to the smart construction monitoring platform as claimed in any one of claims 1 to 7, comprising: The data acquisition module acquires the construction site video, and sends the construction site video to the safety management module, the quality management module and the digital twin module; The project management module obtains the construction project information, and sends the construction project information to the quality management module and the digital twin module; The material management module obtains construction material information, and sends the construction material information to the quality management module and the digital twin module; The inspection module obtains patrol route information, and sends the patrol route information to the safety management module, the quality management module and the digital twin module; The mechanical management module obtains mechanical equipment information and equipment scheduling information, and sends the mechanical equipment information and the equipment scheduling information to the quality management module and the digital twin module; The safety management module, in response to receiving the construction site video and the patrol route information, determines safety hazard information based on the construction site video and the patrol route information, and sends the safety hazard information to the digital twin module; The quality management module, in response to receiving the construction site video, the construction project information, the construction material information, the patrol route information, the machinery and equipment information and the equipment scheduling information, determines the quality hazard information based on the construction site video, the construction project information, the construction material information, the patrol route information, the machinery and equipment information and the equipment scheduling information, and sends the quality hazard information to the digital twin module; The digital twin module builds a construction twin model in response to receiving construction site videos, construction project information, construction material information, patrol route information, machinery and equipment information, equipment scheduling information, safety hazard information and quality hazard information, and sends the construction twin model to the target user terminal.

Images