A device operation and maintenance management method and system, an electronic device, and a storage medium

Abstract

This invention utilizes BIM software to process pre-acquired equipment structure data into BIM equipment data, which is then displayed in CAD software to create a 3D model. Through twin technology, real-time variable data during equipment operation is synchronously simulated within the 3D model, thereby constructing a dynamic simulation platform. The operational scenario data is then unidirectionally output to the cloud for storage. This accurately synchronizes the 3D operational details of the equipment, converting the operational scenario data into an AR scene labeled with real-time equipment status parameters in the cloud. During equipment diagnostics, after authorization, client terminals or cloud users can access the real-time equipment status parameters within the AR scene based on control commands, enabling information interaction. The client terminal and cloud are connected via an authorized protocol. This facilitates the training of maintenance personnel, addresses the high risk of maintenance errors leading to low equipment maintenance efficiency, and thereby improves equipment maintenance security.

Description

Technical Field

[0001] This invention relates to the field of industrial equipment simulation operation and maintenance, and in particular to an equipment operation and maintenance management method, system, electronic device and storage medium. Background Technology

[0002] Currently, there are many types of industrial equipment and the operating environment is complex. Equipment fault location relies on manual inspection and experience judgment, especially when it comes to thermal control equipment for heating and industrial furnaces. For example, it is extremely difficult to manually inspect thermal control equipment such as boilers, heat exchangers, and combustion control cabinets, while the accuracy of remote operation and maintenance is not high.

[0003] Remote maintenance typically relies on video calls or on-site photos, but maintenance personnel cannot simultaneously view real-time operating data and 3D disassembly diagrams, leading to a high risk of errors and omissions. Most existing online fault simulation platforms are based on 2D flowcharts or standalone simulation software, making it difficult to intuitively present 3D structures, local details, and spatial constraints, resulting in low inspection efficiency and significant downtime damage. Maintenance personnel also struggle to receive adequate training. Summary of the Invention

[0004] In view of this, in order to solve the problem of the inability to accurately synchronize the three-dimensional operation and maintenance details during equipment operation, resulting in a high risk of operation and maintenance errors and omissions, and the problem of inadequate training of operation and maintenance personnel leading to low equipment operation and maintenance efficiency, we need to address these issues.

[0005] In a first aspect, embodiments of the present invention provide a method for equipment operation and maintenance management, including: The pre-acquired equipment structure data is processed into BIM equipment data using BIM software, and the BIM equipment data is then displayed in CAD software to create a three-dimensional model. By using twin technology, real-time variable data of the device during operation are synchronously simulated in the three-dimensional model, thereby constructing a dynamic simulation platform, and the operation scene data is unidirectionally output to the cloud for storage; The operational scenario data is converted into an AR scene labeled with real-time device status parameters in the cloud. During device diagnostics, after authorization, the client terminal or cloud user can invoke the real-time status parameters of the device within the AR scene according to control commands to achieve information interaction; the client terminal and the cloud are connected via an authorized protocol.

[0006] In one possible embodiment, during device diagnostics, after authorization, the client terminal or cloud user, according to control commands, invokes the device's real-time status parameters within the AR scene to achieve information interaction, including: When the diagnostic equipment is faulty, receive control commands for fault handling; After the user's authorization is verified in the cloud, the device is remotely controlled to trigger a fault handling mechanism based on the real-time status parameters of the device in the AR scene, according to the fault type; the fault types include: hardware fault, control logic fault, and process abnormality. The fault type is determined based on the fault's triggering conditions and symptoms.

[0007] In one possible embodiment, the fault handling mechanism includes: operating condition characteristics corresponding to the fault type, fault probability, fault mechanism analysis, and maintenance steps.

[0008] In one possible embodiment, the step of diagnosing the device, after the user on the client terminal or cloud has passed authorization authentication, calling the real-time status parameters of the device in the AR scene according to the control command to realize information interaction, further includes: When the diagnostic device malfunctions, it receives a data call instruction. After the client terminal user has passed authorization authentication, it calls the real-time status parameters of the device within the AR scene to achieve information interaction; and After the user's authorization is verified in the cloud, an exception handling instruction is received, which provides virtual disassembly and path labeling functions for the real-time status parameters of the device in the AR scene, and synchronizes the labeling results to the client terminal.

[0009] In one possible embodiment, the step of simulating the real-time variable data of the device during operation in the three-dimensional model using twin technology to construct a dynamic simulation platform and synchronously outputting the operating scene data to the cloud, further includes: Set positioning markers for the device, and load the dynamic simulation platform by scanning the positioning markers; By subscribing to the running scene data of the dynamic simulation platform, the AR device displays the running scene data as an AR scene overlaid with the device's real-time status parameters.

[0010] In one possible embodiment, the method further includes: Electronic work orders are generated based on the equipment's diagnostic information and synchronized to the cloud; The diagnostic information includes: diagnostic results, repair procedures, maintenance logs, and replacement parts.

[0011] In one possible embodiment, the method further includes: The dynamic simulation platform is used to convert the running scene data in the cloud into an AR scene marked with the real-time status parameters of the device and transmit it to the client terminal with AR vision during training. Provide AR scene reproduction functionality for the client terminal with AR field of view; and After the user sets the device status parameters corresponding to the running scenario data, the simulation simulates the function of the AR scenario set by the user for training purposes.

[0012] Secondly, the present invention provides an equipment operation and maintenance management system, comprising: The 3D module is used to process pre-acquired equipment structure data into BIM equipment data using BIM software, and to display the BIM equipment data in CAD software to create a 3D model. The dynamic simulation module is used to synchronously simulate the real-time variable data of the device during operation in the three-dimensional model through twin technology, thereby constructing a dynamic simulation platform and unidirectionally outputting the operation scene data to the cloud for storage. The AR module is used to convert the running scene data into an AR scene marked with real-time device status parameters in the cloud. The information interaction module is used to enable real-time status parameters of the device in the AR scene to be invoked by the client terminal or cloud user after authorization authentication during device diagnosis, thereby realizing information interaction; wherein the client terminal and the cloud are connected to communicate via an authorized protocol.

[0013] Thirdly, the present invention provides an electronic device, comprising: a processor and a memory, wherein the processor is configured to execute a device operation and maintenance management program stored in the memory to implement the device operation and maintenance management method as described in any one of the claims.

[0014] Fourthly, the present invention provides a storage medium storing one or more programs, which can be executed by one or more processors to implement the device operation and maintenance management method as described in any one of the claims.

[0015] This invention utilizes BIM software to process pre-acquired equipment structure data into BIM equipment data, which is then displayed in CAD software to create a 3D model. Through twin technology, real-time variable data during equipment operation is synchronously simulated within the 3D model, thereby constructing a dynamic simulation platform. The operational scenario data is then unidirectionally output to the cloud for storage. This accurately synchronizes the 3D operational details of the equipment, converting the operational scenario data into an AR scene labeled with real-time equipment status parameters in the cloud. During equipment diagnostics, after authorization, client terminals or cloud users can access the real-time equipment status parameters within the AR scene based on control commands, enabling information interaction. The client terminal and cloud are connected via an authorized protocol. This facilitates the training of maintenance personnel, addresses the high risk of maintenance errors leading to low equipment maintenance efficiency, and thereby improves equipment maintenance security. Attached Figure Description

[0016] The accompanying drawings, which form part of this specification, are used to provide a further understanding of the invention. The illustrative embodiments of the invention and their descriptions are used to explain the invention and do not constitute an undue limitation of the invention. In the drawings: Figure 1 A flowchart illustrating an embodiment of an equipment operation and maintenance management method provided by this invention; Figure 2 A flowchart illustrating an embodiment of another equipment operation and maintenance management method provided by the invention; Figure 3 A block diagram illustrating an embodiment of an equipment operation and maintenance management system provided by this invention; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0017] The present invention will now be described in detail with reference to the accompanying drawings and embodiments. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0018] The following detailed description is exemplary and intended to provide further detailed explanation of the invention. Unless otherwise specified, all technical terms used in this invention have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in this invention is for describing particular embodiments only and is not intended to limit the scope of exemplary embodiments according to the invention.

[0019] See Figure 1 This is a flowchart illustrating an embodiment of an equipment operation and maintenance management method provided by the present invention. Figure 1 As shown, the process may include the following steps: Step 101: Process the pre-acquired equipment structure data into BIM equipment data using BIM software, and then display the BIM equipment data in CAD software to create a three-dimensional model.

[0020] The device of this invention can be electronic equipment, mechanical equipment, thermal control equipment, etc. The following description focuses on thermal control equipment. This thermal control equipment can be a boiler, heat exchanger, combustion control cabinet, etc., and is not limited thereto. When obtaining the equipment structural data, it can be obtained through simplified meshing and material mapping. Specifically, the texture can be a structural image of the thermal control equipment. The equipment structural data can include: the length, height, and curvature of the thermal control equipment, and may also include the dimensions of internal components, etc., and is not limited thereto.

[0021] In one embodiment, BIM (Building Information Modeling) software can display and manage the structural data of thermal control equipment in the form of a 3D model. Therefore, first converting the equipment structural data into BIM equipment data, which can be in a 3D model format, better preserves the geometric attribute information of the BIM equipment data. Importing this BIM equipment data into CAD drawing software allows for better coordination and integration of the thermal control equipment structure, improving the efficiency of 3D model generation. Alternatively, it can be layer-level BIM equipment data, which can be compared and coordinated with existing thermal control equipment CAD drawings by setting coordinate systems and scales to obtain a 3D model; no limitation is imposed here.

[0022] Step 102: Using twin technology, the real-time variable data of the device during operation is synchronously simulated in the three-dimensional model to build a dynamic simulation platform, and the running scene data is unidirectionally output to the cloud for storage.

[0023] In one embodiment, real-time variable data during standby operation can be determined by combining fluid or thermodynamic equations with a table of variable points collected from the I / O channels of the thermal control equipment. This requires the collection of real-time variable data during equipment operation. Real-time collection can be achieved using a real-time SCADA (Supervisory Control and Data Acquisition) data acquisition and monitoring control system to collect data on the I / O channels of the thermal control equipment, avoiding data delays that could affect subsequent equipment status assessments.

[0024] The thermal control equipment can be a PLC (Programmable Logic Controller) or a DCS (Distributed Control System). The variable meters here represent the usage of various variables during equipment operation. Each variable has a unique corresponding variable name, device name, device address, register, register address, etc., which are not restricted here.

[0025] Here, variable points for thermal control equipment can be installed and calibrated using AR (Analog and Digital) landmarks to achieve one-to-one alignment. Specific types can include: digital input points (DI), digital output points (DO), analog input points (AI), analog output points (AO), and communication points. The variable point type can be determined based on the 3D model carrying the BIM equipment data of the thermal control equipment, showing various instruments such as pumps, valves, and motors. For example, a circuit switch after the motor generates electricity can be a digital input point (DI) when open and a digital output point (DO) when closed. Valves controlling the water volume pumped by the pump can be analog input points (AI), without restriction.

[0026] Furthermore, without affecting the normal operation of the thermal control equipment, for maintenance or monitoring analysis of the thermal control equipment, digital twin technology can be used to load the real-time variable data of the thermal control equipment during operation and simulate it synchronously in a three-dimensional model. By using this VR virtual reality technology, a dynamic simulation platform can be established, which allows for real-time observation of the operation of the thermal control equipment, that is, whether various parameters are normal and whether the components are operating safely.

[0027] The simulated operational scenario data from the dynamic simulation platform is then unidirectionally output to the cloud for storage. This facilitates the subsequent opening of the device API dynamic simulation platform interface, allowing AR or VR users on the device terminal and in the cloud to access the data or scenario at any time. The cloud can be a authorized device terminal, such as a mobile terminal (phone), or another computerized maintenance and management terminal (CMMS) connected to the device. It should be noted that during sensitive operating conditions of the thermal control equipment, data is only cached at the on-site edge gateway and uploaded to the cloud after anonymization to ensure the safe operation of the thermal control equipment. The edge gateway can be an ARM 8-core, dual-port device responsible for converting the OPC UA transmission protocol to the MQTT transmission protocol, facilitating interface with the SCADA data acquisition and monitoring control system to ensure secure data transmission. The transmission protocol here can be further configured with authentication for uploading to the cloud to provide additional security guarantees; no restrictions are imposed here.

[0028] The unidirectional transmission of operational scenario data to the motion field is also for security reasons, requiring unidirectional access control. Specifically, an industrial DMZ (Demilitarized Zone) network configuration architecture can be adopted, where the thermal control equipment (PLC) field network pushes read-only data to the cloud only through a data isolation gateway, ensuring secure unidirectional data transmission.

[0029] In practical applications, to ensure that real-time variable data of thermal control equipment can be loaded synchronously during operation, the front end can use Unity or Unreal Engine, and adopt Web Real-Time Communications (WebRTC) combined with gRemote Procedure Call (gRPC) to achieve low-latency data synchronization. The back end can adopt Kubernetes microservice architecture, and the containers of the dynamic simulation platform can use Modelica modeling or FMI simulation model to scale elastically as needed.

[0030] Step 103: Realize the AR scene of virtual device operation on the cloud based on the running scene data.

[0031] The VR virtual reality dynamic simulation platform established in step 102 above outputs operational scene data, which, via the AR view cloud, can display the virtual AR scene of the device's operation. Here, the cloud device with the AR view can be industrial explosion-proof AR glasses supporting SLAM synchronous positioning, with CPU parameters of ≥ 8 cores, 4 GB RAM, and an integrated 5G module. For details on how the device terminal and the cloud specifically display the virtual AR scene of the device's operation, please refer to steps 1031 and 1032 below: Step 1031: Convert the running scene data into an AR scene marked with the device's real-time status parameters in the cloud.

[0032] The real-time status parameters of the equipment may include, but are not limited to: the equipment's temperature, pressure, valve position, and the equipment's operating sound.

[0033] In one embodiment, to facilitate users to remotely view or operate thermal control equipment, the operating scene data can be converted into an AR scene marked with the real-time status parameters of the equipment in the cloud. Specifically, for example, if the user is a background expert, they can enter the same virtual machine room under the dynamic simulation platform through a VR headset to see the equipment status and the on-site AR user perspective in real time. Here, the VR can be a cloud-based system with a graphics card model of NVIDIA RTX2060 or higher.

[0034] Step 1032: Set a positioning marker for the device, and load the dynamic simulation platform by scanning the positioning marker; then, by subscribing to the running scene data of the dynamic simulation platform, the AR device will display the running scene data as an AR scene with the device's real-time status parameters superimposed.

[0035] In one embodiment, to facilitate direct viewing or operation by users on the thermal control equipment, a location marker, such as a QR code, can be set on the equipment. Scanning this marker will directly load a cloud-based dynamic simulation platform, from which the operating scenario data of the thermal control equipment can be obtained. To facilitate the acquisition of real-time operating scenario data of the thermal control equipment, the operating scenario data collected by SCADA can be subscribed to via the OPC UA and MQTT transmission protocols, thereby obtaining an AR scene overlaid with the equipment's real-time status parameters at any time.

[0036] Step 104: When diagnosing the device, after the client terminal or cloud user has passed the authorization authentication, they can call the real-time status parameters of the device in the AR scene according to the control command to realize information interaction.

[0037] The client terminal communicates with the cloud via an authorized protocol.

[0038] In one embodiment, the client terminal can be a mobile terminal, PC terminal, etc., connected to the cloud after the client has been authenticated through an authorization protocol. The authorization protocol can be OAuth 2.0 for identity authentication, or it can be combined with an RBAC permission model to restrict high-risk operations. Specifically, the permissions for high-risk operations can be determined based on the client's identity after the authorization protocol is passed. For example, if the client is an expert, they may have permissions for high-risk operations; of course, experts can also perform operations in the cloud as cloud users. If the client is a staff member, they can be configured to only use the AR scene they see for virtual disassembly and annotation in a VR virtual reality scene. If the client is another user, they can be configured to be the same as the staff member, or other users can be configured to only observe the AR scene from a first-person perspective; no restrictions are placed here.

[0039] Furthermore, users can issue corresponding control commands based on their permissions to invoke real-time status parameters of devices within the AR scene, enabling information interaction. For details on the specific situations and types of control commands that can be issued, please refer to [link / reference needed]. Figure 2 A flowchart illustrating another embodiment of the equipment operation and maintenance management method provided by the invention is shown below. Figure 2 As shown, the steps may include the following: Step 201: When the diagnostic device is faulty, receive the control command for fault handling; after the user in the cloud has passed the authorization authentication, the device can be remotely controlled to trigger the fault handling mechanism according to the fault type based on the real-time status parameters of the device in the AR scene.

[0040] Step 202: When the diagnostic device is found to be abnormal, the client terminal user and the cloud user operate the device according to the received instructions.

[0041] The following is a unified explanation of steps 201 and 202: The fault type is determined based on the triggering conditions and symptoms of the fault. Fault types may include, but are not limited to: hardware faults, control logic faults, and process anomalies.

[0042] Fault handling mechanisms may include, but are not limited to: the operating conditions corresponding to the fault type, the fault probability, the fault mechanism analysis, and the maintenance steps.

[0043] In one embodiment, AI diagnostic algorithms can be used to diagnose the real-time status parameters of devices within an AR scene. Specifically, the AI ​​diagnosis can first be based on an XGBoost classifier, inputting multiple real-time operating condition features and outputting fault probabilities. Then, the corresponding mechanism analysis and maintenance steps under the operating condition features are input. Thus, during AI diagnosis, the specific mechanism analysis and maintenance steps are obtained as the fault handling mechanism output by matching the on-site operating status of the thermal control equipment with the operating condition features in the classifier. A candidate list of fault root causes can also be generated; that is, for situations with similar operating condition features, multiple fault types and corresponding mechanism analyses and maintenance steps can be listed.

[0044] Taking hardware failure as an example, if a hardware component of the thermal control equipment malfunctions, a hardware failure type is triggered. The severity of the failure is determined based on the severity of the symptoms. Here, a failure severity threshold can be set based on the characteristics of each operating condition. If the threshold is exceeded, a failure is confirmed; otherwise, only an abnormality in the thermal control equipment is confirmed. Of course, if a failure not found in the cloud-based failure database occurs, script-based extensions can also be supported, allowing users to customize new failure type entries as needed.

[0045] When a thermal control equipment malfunction is detected, the cloud will issue a notification. Upon receiving the alarm notification, the user will issue a fault handling instruction. The cloud receives the fault handling control instruction, and after user authentication confirms their authority to handle the specific equipment, it determines a fault handling mechanism based on the corresponding operating conditions, including mechanism analysis and maintenance steps. The user can then instruct maintenance personnel to handle the issue according to this mechanism. After the fault is resolved, the inventory of damaged thermal control equipment parts in the cloud will decrease accordingly. Furthermore, the time and cost will be recorded in the cloud and included in the maintenance log. The maintenance log entries submitted during fault handling are written back into the fault database, meaning that potential fault conditions during maintenance are written into the database, which helps to improve the AR scene model displayed on the dynamic simulation platform.

[0046] The authentication of cloud users can be done in the same way as the authentication of client terminal users, as explained in step 104 above and will not be repeated here. For cloud users, a secondary confirmation can also be added, which can be done by local personnel scanning fingerprints, swiping cards, or signing to confirm that they have the right to access the device. Once the authentication is successful, it serves to prevent tampering.

[0047] It should be noted that, regardless of whether the maintenance process involves handling thermal control equipment malfunctions or abnormalities, all records can be archived in the cloud-based fault database, providing a data foundation for subsequent iterative learning.

[0048] When a malfunction is detected in the thermal control equipment, both cloud users and client terminal users will receive a cloud alarm notification. At this time, both the client terminal user and the cloud user can issue control commands, instructing the cloud to operate the equipment according to the received instructions. Here, it can be configured that the client terminal can only issue commands to observe and invoke the real-time status parameters of the equipment within the AR scene when the thermal control equipment malfunctions, and cannot issue commands to handle the malfunction. Alternatively, it can be configured that only cloud users can issue malfunction handling commands, controlling the equipment via a remote connection to the cloud. The following details how both ends of the user control the thermal control equipment; please refer to the steps below: Step 2021: When the diagnostic device is abnormal, receive the data call instruction. After the client terminal user has passed the authorization authentication, call the real-time status parameters of the device in the AR scene to realize information interaction.

[0049] Step 2022: When the diagnostic device is abnormal, receive the abnormality handling instruction. After the user is authorized in the cloud, the AR scene provides virtual disassembly and path marking functions for the real-time status parameters of the device, and synchronizes the marking results to the client terminal.

[0050] In one embodiment, the real-time status of the thermal control equipment is monitored for any abnormalities, and the normal operation of each component is checked. For components requiring maintenance due to abnormalities, the cloud user and the client terminal user are notified. Upon receiving an abnormality handling command from the cloud user, for example, indicating that a component is showing a red-hot temperature (above a preset abnormal temperature value), the cloud user can perform timely maintenance after authorization, record a maintenance log, and then upload the log to the cloud for storage. The client terminal user can only access the real-time status parameters of the device within the AR scene after authorization.

[0051] The authentication process has been explained in steps 104, 201, and 202, and will not be repeated here.

[0052] Therefore, after authorization, cloud users can virtually disassemble and mark paths for real-time device status parameters in AR scenes, and even adjust status parameters for simulation, such as simulating fault scenarios. The cloud will synchronize the marking results to the client terminal for client terminal users to observe and use.

[0053] Step 105: Generate an electronic work order based on the equipment's diagnostic information and synchronize it to the cloud.

[0054] The diagnostic information may include, but is not limited to: diagnostic results, repair procedures, maintenance logs, and replacement parts. In addition to diagnostic information, daily audit logs may also be included; that is, even when there are no faults or anomalies, daily inspections can be recorded. These audit logs can be stored in a cloud-based security operations database. Electronic work orders generated by the system are then uploaded to the cloud.

[0055] Step 106: The dynamic simulation platform is used in conjunction with AR vision devices for training and operation.

[0056] Step 1061: When the dynamic simulation platform is used for training, it can convert the running scene data in the cloud into an AR scene marked with the real-time status parameters of the device and transmit it to the client terminal with AR vision.

[0057] Step 1062: Provide AR scene reproduction function for client terminals with AR vision.

[0058] Step 1063: After the user sets the device status parameters corresponding to the running scene data, simulate the function of the AR scene set by the user for training purposes.

[0059] The following is a unified explanation of steps 106 to 1063: In one embodiment, maintenance personnel can be trained on a dynamic simulation platform to handle various operating conditions of the thermal control equipment with ease. During training, the operational scenario data in the cloud is converted into AR scenes marked with real-time equipment status parameters and transmitted to a client terminal with AR vision. On the client terminal, personnel can select the AR scene under the fault script, thus applying the AR fault scene reproduction function. When a fault occurs, they can observe abnormal parameters, hear abnormal sounds, or view red-hot, high-temperature components in the AR when the thermal control equipment malfunctions, providing a highly immersive experience. This allows personnel to record the troubleshooting steps, time consumption, fault probability, and fault handling, and then determine the accuracy of the records, which can be used to evaluate the personnel.

[0060] In another embodiment, during training, staff can subscribe to operational scenario data collected by SCADA to obtain an AR scene overlaid with real-time device status parameters from the AR-view client terminal. Furthermore, users can set real-time device status parameters corresponding to the operational scenario data, simulating the functionality of the user-defined AR scene for training purposes.

[0061] Specifically, taking the "Training - Boiler Pump Failure" script as an example, when the simulated pump outlet flow rate drops to a certain level, such as 30%, the dynamic simulation platform can trigger a secondary side differential pressure alarm on the thermal control equipment, notifying the cloud. At this point, staff can handle this anomaly during training, such as manually switching to the standby pump, and the system records the operation sequence in the maintenance log.

[0062] Taking the script for an alarm notification triggered by an unstable burner flame from the thermal control equipment as an example, the cloud system automatically switches to "maintenance mode," indicating an anomaly. Staff can then focus on the burner, and experts can disassemble a burner model within VR virtual reality, marking it as "Check the gas nozzle," while the on-site AR view simultaneously uses virtual arrows for positioning. After the nozzle cleaning is completed in the cloud, the expert clicks "Resume Operation" on the VR device, and after a second identity verification, the cloud system clears the alarm notification.

[0063] This invention utilizes BIM software to process pre-acquired equipment structure data into BIM equipment data, which is then displayed in CAD software to create a 3D model. Through twin technology, real-time variable data during equipment operation is synchronously simulated within the 3D model, thereby constructing a dynamic simulation platform. The operational scenario data is then unidirectionally output to the cloud for storage. This accurately synchronizes the 3D operational details of the equipment, converting the operational scenario data into an AR scene labeled with real-time equipment status parameters in the cloud. During equipment diagnostics, after authorization, client terminals or cloud users can access the real-time equipment status parameters within the AR scene based on control commands, enabling information interaction. The client terminal and cloud are connected via an authorized protocol. This facilitates the training of maintenance personnel, addresses the high risk of maintenance errors leading to low equipment maintenance efficiency, and thereby improves equipment maintenance security.

[0064] See Figure 3 A block diagram illustrating an embodiment of an equipment operation and maintenance management system provided by this invention, as shown below. Figure 3 As shown, it includes: The 3D module is used to process pre-acquired equipment structure data into BIM equipment data using BIM software, and to display the BIM equipment data in CAD software to create a 3D model. The dynamic simulation module is used to synchronously simulate the real-time variable data of the device during operation in the three-dimensional model through twin technology, thereby constructing a dynamic simulation platform and unidirectionally outputting the operation scene data to the cloud for storage. The AR module is used to convert the running scene data into an AR scene marked with real-time device status parameters in the cloud. The information interaction module is used to enable real-time status parameters of the device in the AR scene to be invoked by the client terminal or cloud user after authorization authentication during device diagnosis, thereby realizing information interaction; wherein the client terminal and the cloud are connected to communicate via an authorized protocol.

[0065] In one possible embodiment, the information interaction module includes (not shown in the figure): The fault unit is used to receive control commands for fault handling when the diagnostic device is faulty; after the user in the cloud has passed the authorization authentication, the user can remotely control the device to trigger the fault handling mechanism according to the fault type based on the real-time status parameters of the device in the AR scene; the fault types include: hardware fault, control logic fault, and process abnormality. The fault type is determined based on the fault's triggering conditions and symptoms.

[0066] In one possible embodiment, the fault handling mechanism includes: operating condition characteristics corresponding to the fault type, fault probability, fault mechanism analysis, and maintenance steps.

[0067] In one possible embodiment, the information interaction module further includes (not shown in the figure): The anomaly unit is used to receive a data call instruction when the diagnostic device is abnormal, and to call the real-time status parameters of the device in the AR scene after the client terminal user has passed the authorization authentication, so as to realize information interaction; and to receive an anomaly handling instruction after the cloud user has passed the authorization authentication, and to provide virtual disassembly and path marking functions for the real-time status parameters of the device in the AR scene, and to synchronize the marking results to the client terminal.

[0068] In one possible embodiment, the system further includes: The subscription scene module is used to set a positioning marker for the device and load the dynamic simulation platform by scanning the positioning marker. By subscribing to the running scene data of the dynamic simulation platform, the AR device displays the running scene data as an AR scene with the device's real-time status parameters superimposed.

[0069] In one possible embodiment, the system further includes: The work order module is used to generate electronic work orders based on the equipment's diagnostic information and synchronize them to the cloud; the diagnostic information includes: diagnostic results, repair steps, maintenance logs, and replacement parts.

[0070] In one possible embodiment, the system further includes: The training module is used to convert the running scene data in the cloud into an AR scene marked with real-time device status parameters and transmit it to the client terminal with AR field of view during the training of the dynamic simulation platform; to provide the client terminal with AR field of view with AR scene reproduction function; and to simulate the AR scene set by the user after the user sets the device status parameters corresponding to the running scene data for training purposes.

[0071] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Figure 4The illustrated electronic device includes at least one processor, memory, at least one network interface, and other user interfaces. The various components within the electronic device are coupled together via a bus system. It is understood that the bus system is used to enable communication and connection between these components. In addition to a data bus, the bus system also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 4 The general will label all buses as bus systems.

[0072] The user interface may include a display, keyboard, or clicking device (e.g., mouse, trackball, touchpad, or touchscreen).

[0073] It is understood that the memory in the embodiments of the present invention can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The memories described herein are intended to include, but are not limited to, these and any other suitable types of memory.

[0074] In some implementations, the memory stores elements such as executable units or data structures, or subsets thereof, or extended sets thereof: operating systems and applications.

[0075] The operating system includes various system programs, such as the framework layer, core library layer, and driver layer, used to implement various basic business functions and handle hardware-based tasks. The application programs include various applications, such as media players and browsers, used to implement various application functions. The program implementing the method of this invention can be included in the application programs.

[0076] In this embodiment of the invention, by calling a program or instruction stored in the memory, specifically a program or instruction stored in an application program, the processor executes the method steps provided in each method embodiment, including, for example: The pre-acquired equipment structure data is processed into BIM equipment data using BIM software, and the BIM equipment data is then displayed in CAD software to create a three-dimensional model. By using twin technology, real-time variable data of the device during operation are synchronously simulated in the three-dimensional model, thereby constructing a dynamic simulation platform, and the operation scene data is unidirectionally output to the cloud for storage; The operational scenario data is converted into an AR scene labeled with real-time device status parameters in the cloud. During device diagnostics, after authorization, the client terminal or cloud user can invoke the real-time status parameters of the device within the AR scene according to control commands to achieve information interaction; the client terminal and the cloud are connected via an authorized protocol.

[0077] The methods provided in the above embodiments of the present invention can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software form. The processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present invention can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software units in the decoding processor. The software units can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in the memory, and the processor reads the information in the memory and, in conjunction with its hardware, completes the steps of the above method.

[0078] It is understood that the embodiments described herein can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described herein, or combinations thereof.

[0079] For software implementation, the techniques described herein can be implemented by units that perform the functions described herein. The software code can be stored in memory and executed by a processor. The memory can be implemented in the processor or external to the processor.

[0080] The electronic device provided in this embodiment may be as follows: Figure 4 The electronic device shown can perform the following: Figure 1-2 All steps of the equipment operation and maintenance management method in China, thereby achieving Figure 1-2 For details on the technical effects of the equipment operation and maintenance management methods, please refer to [link / reference needed]. Figure 1-2 The relevant descriptions are presented concisely and will not be elaborated upon here.

[0081] This invention also provides a storage medium (computer-readable storage medium). This storage medium stores one or more programs. The storage medium may include volatile memory, such as random access memory; it may also include non-volatile memory, such as read-only memory, flash memory, hard disk, or solid-state drive; and it may also include combinations of the above types of memory.

[0082] When one or more programs in the storage medium can be executed by one or more processors to implement the device operation and maintenance management method described above that is executed on the electronic device side.

[0083] The processor is used to execute the device operation and maintenance management program stored in the memory to implement the following steps of the device operation and maintenance management method executed on the electronic device side: The pre-acquired equipment structure data is processed into BIM equipment data using BIM software, and the BIM equipment data is then displayed in CAD software to create a three-dimensional model. By using twin technology, real-time variable data of the device during operation are synchronously simulated in the three-dimensional model, thereby constructing a dynamic simulation platform, and the operation scene data is unidirectionally output to the cloud for storage; The operational scenario data is converted into an AR scene labeled with real-time device status parameters in the cloud. During device diagnostics, after authorization, the client terminal or cloud user can invoke the real-time status parameters of the device within the AR scene according to control commands to achieve information interaction; the client terminal and the cloud are connected via an authorized protocol.

[0084] As is known from common technical knowledge, this invention can be implemented through other embodiments that do not depart from its spirit or essential characteristics. Therefore, the disclosed embodiments described above are merely illustrative in all respects and are not the only ones. All modifications within the scope of this invention or its equivalents are included in this invention.

[0085] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0086] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0087] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0088] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0089] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that modifications or equivalent substitutions can still be made to the specific implementation of the present invention. Any modifications or equivalent substitutions that do not depart from the spirit and scope of the present invention should be covered within the protection scope of the claims of the present invention.

Claims

1. A method for equipment operation and maintenance management, characterized in that, include: The pre-acquired equipment structure data is processed into BIM equipment data using BIM software, and the BIM equipment data is then displayed in CAD software to create a three-dimensional model. By using twin technology, real-time variable data of the device during operation are synchronously simulated in the three-dimensional model, thereby constructing a dynamic simulation platform, and the operation scene data is unidirectionally output to the cloud for storage; The operational scenario data is converted into an AR scene labeled with real-time device status parameters in the cloud. During device diagnostics, after authorization, the client terminal or cloud user can invoke the real-time status parameters of the device within the AR scene according to control commands to achieve information interaction; the client terminal and the cloud are connected via an authorized protocol.

2. The method according to claim 1, characterized in that, During device diagnostics, after authorization, the client terminal or cloud user can invoke the device's real-time status parameters within the AR scene according to control commands to achieve information interaction, including: When the diagnostic equipment is faulty, receive control commands for fault handling; After the user's authorization is verified in the cloud, the device is remotely controlled to trigger a fault handling mechanism based on the real-time status parameters of the device in the AR scene, according to the fault type; the fault types include: hardware fault, control logic fault, and process abnormality. The fault type is determined based on the fault's triggering conditions and symptoms.

3. The method according to claim 2, characterized in that, The fault handling mechanism includes: the operating condition characteristics corresponding to the fault type, the fault probability, the fault mechanism analysis, and the maintenance steps.

4. The method according to claim 1, characterized in that, The method of diagnosing the device, whereby, after authorization, the user on the client terminal or cloud accesses the device and, according to control commands, invokes the device's real-time status parameters within the AR scene to achieve information interaction, further includes: When the diagnostic device malfunctions, it receives a data call instruction. After the client terminal user has passed authorization authentication, it calls the real-time status parameters of the device within the AR scene to achieve information interaction; and After the user's authorization is verified in the cloud, an exception handling instruction is received, which provides virtual disassembly and path labeling functions for the real-time status parameters of the device in the AR scene, and synchronizes the labeling results to the client terminal.

5. The method according to claim 1, characterized in that, The process involves using twin technology to simulate the real-time variable data of the device during operation in the 3D model, thereby constructing a dynamic simulation platform and synchronously outputting the operating scene data to the cloud. This process also includes: Set positioning markers for the device, and load the dynamic simulation platform by scanning the positioning markers; By subscribing to the running scene data of the dynamic simulation platform, the AR device displays the running scene data as an AR scene overlaid with the device's real-time status parameters.

6. The method according to claim 1, characterized in that, The method further includes: Electronic work orders are generated based on the equipment's diagnostic information and synchronized to the cloud; The diagnostic information includes: diagnostic results, repair procedures, maintenance logs, and replacement parts.

7. The method according to claim 1, characterized in that, The method further includes: The dynamic simulation platform is used to convert the running scene data in the cloud into an AR scene marked with the real-time status parameters of the device and transmit it to the client terminal with AR vision during training. Provide AR scene reproduction functionality for the client terminal with AR field of view; and After the user sets the device status parameters corresponding to the running scenario data, the simulation simulates the function of the AR scenario set by the user for training purposes.

8. An equipment operation and maintenance management system, characterized in that, include: The 3D module is used to process pre-acquired equipment structure data into BIM equipment data using BIM software, and to display the BIM equipment data in CAD software to create a 3D model. The dynamic simulation module is used to synchronously simulate the real-time variable data of the device during operation in the three-dimensional model through twin technology, thereby constructing a dynamic simulation platform and unidirectionally outputting the operation scene data to the cloud for storage. The AR module is used to convert the running scene data into an AR scene marked with real-time device status parameters in the cloud. The information interaction module is used to enable real-time status parameters of the device in the AR scene to be invoked by the client terminal or cloud user after authorization authentication during device diagnosis, thereby realizing information interaction; wherein the client terminal and the cloud are connected to communicate via an authorized protocol.

9. An electronic device, characterized in that, include: A processor and a memory, wherein the processor is configured to execute a device operation and maintenance management program stored in the memory to implement the device operation and maintenance management method according to any one of claims 1 to 7.

10. A storage medium, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the equipment operation and maintenance management method according to any one of claims 1 to 7.

Images