Equipment management method, device and system and electronic equipment
By displaying fault point marks on the equipment's digital twin model and obtaining guidance information, the problem of low equipment fault positioning efficiency is solved, fast and accurate fault repair is achieved, and maintenance costs are reduced.
Patent Information
- Application Number
- CN202310659501.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-05
- Publication Date
- 2024-12-06
AI Technical Summary
During the failure maintenance of existing equipment, engineers need to understand the structure and fault types of each component, resulting in low fault positioning efficiency and affecting maintenance efficiency.
By creating a digital twin model of the device and displaying fault point marks on it, and obtaining guidance information in combination with interactive operations, we can achieve rapid location and repair of fault points.
It reduces the professional requirements of maintenance personnel, improves the speed and accuracy of fault location, allows users to maintain simple faults on their own, and saves maintenance costs.
Smart Images

Figure CN119090473A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of equipment maintenance, and more specifically, to an equipment management method, an equipment management apparatus, an equipment management system, an electronic device, a non-volatile computer-readable storage medium, and a computer program product. Background Art
[0002] At present, when performing fault maintenance on equipment, the professional requirements for engineers are relatively high. Engineers are required to understand the components involved in each fault and the specific structure of the components, and then manually locate the fault of each component that may fail on site to facilitate subsequent maintenance, resulting in low fault location efficiency, which affects equipment maintenance efficiency. Summary of the invention
[0003] Embodiments of the present application provide a device management method, a device management apparatus, a device management system, an electronic device, a non-volatile computer-readable storage medium, and a computer program product.
[0004] An equipment management method according to one embodiment of the present application includes displaying a digital twin model of the equipment and a fault point mark, wherein the fault point mark is used to indicate the location of the fault point in the digital twin model; in response to an interactive operation on the fault point mark, obtaining guidance information corresponding to the fault point mark, wherein the guidance information is used to guide the maintenance of the fault point corresponding to the fault point mark.
[0005] In some embodiments, the digital twin model and fault point mark of the display device include: based on the location information of the device and the extended reality device, superimposing and displaying the scene where the device is located, the digital twin model and the fault point mark in each of the extended reality devices.
[0006] In some embodiments, the device management method also includes identifying the device to obtain the digital twin model of the device and the fault point mark, and the digital twin model is generated based on the three-dimensional model of the device and operation and maintenance data.
[0007] In some embodiments, the interactive operation includes a selection operation, and the obtaining of guidance information corresponding to the fault point mark in response to the interactive operation on the fault point mark includes: obtaining the guidance information corresponding to the selected fault point mark in response to a selection operation on the fault point mark by one or more target objects.
[0008] In some embodiments, the interactive operation includes a troubleshooting operation, and the interactive operation in response to the fault point mark obtains guidance information corresponding to the fault point mark, including: in response to the troubleshooting operation of the fault point mark by one or more target objects, controlling the component corresponding to the troubleshooted fault point mark to stop running; obtaining the guidance information corresponding to the troubleshooted fault point mark according to the operation and maintenance data of the equipment before the troubleshooted component stops running and the operation and maintenance data of the equipment after the troubleshooting component stops running, the guidance information including whether the troubleshooted component has a fault.
[0009] In some embodiments, the guidance information includes navigation information, a structural diagram of the component corresponding to the fault point mark, and at least one of maintenance information; the navigation information includes at least one of a navigation path and a navigation prompt; and obtaining the guidance information corresponding to the fault point mark includes: displaying the navigation path from the current position to the component corresponding to the fault point mark; and / or issuing the navigation prompt based on the current position and the navigation path; and / or displaying the structural diagram and the maintenance information.
[0010] In some embodiments, the fault point mark is determined based on the location information of the fault point in the device, and the fault point of the device is determined based on the operation and maintenance data of the device and cloud big data.
[0011] In some embodiments, the device management method further includes obtaining relevant information about the device or a component of the device in response to an interactive operation on the digital twin model.
[0012] The equipment management device of the present application includes a display module and a first acquisition module. The display module is used to display the digital twin model and the fault point mark of the equipment, and the fault point mark is used to indicate the location of the fault point in the digital twin model; the first acquisition module is used to respond to the interactive operation of the fault point mark, and obtain the guidance information corresponding to the fault point mark, and the guidance information is used to guide the maintenance of the fault point corresponding to the fault point mark.
[0013] The electronic device of an embodiment of the present application includes a display, one or more processors, a memory and one or more computer programs, wherein one or more of the computer programs are stored in the memory and executed by one or more of the processors, and the computer program includes instructions for executing the device management method of any of the above embodiments.
[0014] The device management system of the embodiment of the present application comprises a device and an electronic device. The electronic device can be connected to the device for communication, and the electronic device is used to execute the device management method described in any one of the above embodiments.
[0015] The computer-readable storage medium of the embodiment of the present application includes a computer program. When the computer program is executed by a processor, the processor executes the device management method of any of the above embodiments.
[0016] The computer program product of the embodiment of the present application includes a computer program, and when the computer program is executed by a processor, the device management method described in any one of the above embodiments is implemented.
[0017] In the equipment management method, equipment management device, equipment management system, electronic device, non-volatile computer-readable storage medium and computer program product of the implementation mode of the present application, the digital twin model of the equipment is displayed so that the maintenance personnel can intuitively see the structure of different components of the equipment. In addition, the fault point mark used to indicate the location of the fault point in the digital twin model is displayed in the digital twin model. Through the interactive operation with the fault point mark, the guidance information corresponding to the fault point mark can be obtained. The repair of the fault point marked by the fault point mark is guided by the guidance information, which not only has lower requirements for maintenance personnel, but also does not require manual fault location, and the fault location is fast and accurate, thereby improving the efficiency of equipment maintenance. Moreover, for simple faults, even users can perform self-maintenance based on the fault point mark and the corresponding guidance information, which greatly saves equipment maintenance costs.
[0018] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0020] Figure 1 is a flow chart of a device management method of certain embodiments of the present application;
[0021] Figure 2 is a schematic diagram of the structure of an electronic device according to some embodiments of the present application;
[0022] Figure 3 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0023] Figure 4 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0024] Figure 5 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0025] Figure 6is a flow chart of a device management method of certain embodiments of the present application;
[0026] Figure 7 is a flow chart of a device management method of certain embodiments of the present application;
[0027] Figure 8 is a flow chart of a device management method of certain embodiments of the present application;
[0028] Fig. 9 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0029] Fig.10 is a flow chart of a device management method of certain embodiments of the present application;
[0030] Fig.11 is a flow chart of a device management method of certain embodiments of the present application;
[0031] Fig.12 is a flow chart of a device management method of certain embodiments of the present application;
[0032] Fig.13 is a module schematic diagram of a device management device in certain embodiments of the present application;
[0033] Fig.14 It is a schematic diagram of the connection status of a non-volatile computer-readable storage medium and a processor in certain embodiments of the present application. DETAILED DESCRIPTION
[0034] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the embodiments of the present application.
[0035] See also Figures 1 to 3 , the device management method of the implementation mode of the present application, the device management method comprises:
[0036] Step 011: displaying a digital twin model 201 and a fault point mark 202 of the device 200, where the fault point mark 202 is used to indicate the location of the fault point in the digital twin model 201;
[0037] Among them, the digital twin makes full use of physical models, sensor updates, operation history and other data, integrates multi-disciplinary, multi-physical quantity, multi-scale, and multi-probability simulation processes, completes mapping in the virtual space, and thus reflects the entire life cycle of the corresponding physical equipment.
[0038] The equipment can be HVAC equipment, which includes heating, ventilation and air conditioning. HVAC equipment refers to equipment related to heating, ventilation and air conditioning, such as air conditioners, boilers, radiators, electric heaters, etc. The equipment can also be household appliances, such as washing machines, water heaters, refrigerators, etc.
[0039] The digital twin model 201 of the device 200 is the mapping of the device 200 in three-dimensional space. The digital twin model 201 can realize simulation operation. The size of the digital twin model 201 and the device 200 is 1:1. The operating parameters of the digital twin model 201 during simulation operation are consistent with the operating parameters of the device 200 during actual operation, and the parameters of the sensors in the digital twin model 201 are consistent with the parameters of the corresponding sensors of the device 200. By checking the working conditions of the digital twin model 201, the actual working conditions of the device 200 can be obtained.
[0040] Specifically, when displaying, the digital twin model 201 can be displayed through the display interface T of the display 20 of the electronic device 100. The electronic device 100 can be an extended reality (Extended Reality, XR) device (such as XR glasses), so that maintenance personnel can use XR glasses to superimpose the digital twin model 201 on the device 200 in the real scene for display, thereby facilitating maintenance personnel. The electronic device 100 can also be an electronic device 100 with a display 20 (such as a mobile phone, a computer, a smart watch, etc.), and the digital twin model 201 and related information can be directly displayed through the display 20.
[0041] Among them, XR refers to the combination of reality and virtuality through computers to create a virtual environment for human-computer interaction. It is also a general term for multiple technologies such as augmented reality (AR), virtual reality (VR), and mixed reality (MR).
[0042] The digital twin model 201 of the device 200 can be established in advance, and then the simulation operation of the digital twin model 201 can be realized based on the real-time acquisition of the operation and maintenance data of the device 200. After the device 200 fails, different faults will cause corresponding deviations in the operation and maintenance data of the device 200. For example, after the motor is damaged, the motor of the device 200 cannot operate normally, and the operation and maintenance data of the motor is stopped. Therefore, by obtaining the operation and maintenance data of the device 200 (specifically, it can be the operation information collected by one or more sensors in the device 200), combined with the big data information maintained by the device 200, a rapid judgment of the fault point can be realized, so that the fault point mark 202 is displayed in the digital twin model 201, and the fault point mark 202 can indicate the location of the fault point in the digital twin model 201. In this way, there is no need to locate the fault point through the personal experience of the maintenance personnel, which saves the time of locating the fault point.
[0043] Step 012: In response to the interactive operation on the fault point mark 202, the guidance information 203 corresponding to the fault point mark 202 is obtained, and the guidance information 203 is used to guide the maintenance of the fault point corresponding to the fault point mark 202.
[0044] Specifically, it can be understood that there may be one or more fault point marks 202. When it is necessary to repair the component corresponding to the fault point mark 202, it is necessary to find the location of the component and then perform the repair according to the corresponding repair method.
[0045] For example, please combine Figure 3 and Figure 4 , the multiple fault point marks 202 include a fault point mark A, a fault point mark B, a fault point mark C, and a fault point mark D. The maintenance personnel or the user (hereinafter, the maintenance personnel is taken as an example) can perform interactive operations on any fault point mark 202. If the operation is selected, the guidance information 203 corresponding to the fault point mark 202 can be obtained. The guidance information 203 can guide the maintenance personnel or the user to repair the fault corresponding to the fault point mark 202. If the maintenance personnel selects the fault point mark A, the indication information 203 corresponding to the fault point mark A is displayed; if the maintenance personnel selects the fault point mark B, the indication information 203 corresponding to the fault point mark B is displayed; if the maintenance personnel selects the fault point marks A and B, the indication information 203 corresponding to the fault point marks A and B are displayed at the same time; if the maintenance personnel selects the fault point marks A to D, the indication information 203 corresponding to the fault point marks A to D are displayed at the same time.
[0046] It can be understood that if the maintenance personnel are to be guided to repair the fault corresponding to the fault point mark 202, the guidance information 203 may include information that can guide the maintenance personnel to find the location of the component corresponding to the fault point mark 202, and may include a maintenance method for the component corresponding to the fault point mark 202, so that after the maintenance personnel find the component, they can perform maintenance according to the corresponding maintenance method. For example, the component corresponding to the fault point mark A is the motor of the device 200. After the motor has an abnormal temperature fault, the location of the motor can be marked with the fault point mark A in the data twin model 201 to guide the maintenance personnel to find the motor; when the maintenance personnel selects the indication information 203 corresponding to the motor, the maintenance information corresponding to the abnormal temperature fault of the motor is displayed, so that the maintenance personnel can repair the motor according to the maintenance method. After the maintenance, the temperature of the motor can be checked again in the digital twin model 201. If the temperature returns to normal, it means that the maintenance is successful.
[0047] Among them, see Figure 5 , the guidance information 203 may be image information, such as displaying the navigation path S from the current position of the maintenance personnel A to the position of the component corresponding to the fault point mark 202 in the form of a navigation path, and displaying the maintenance method of the component corresponding to the fault mark point in the form of text. Alternatively, the guidance information 203 may also be voice information, such as guiding the maintenance personnel to move to the position of the component corresponding to the fault point mark 202 in the form of a voice prompt, or explaining the maintenance method of the component corresponding to the fault mark point in the form of a voice prompt. Alternatively, the guidance information 203 may include both image information and voice information to guide the maintenance personnel from different angles, such as displaying the navigation path from the current position of the maintenance personnel to the position of the component corresponding to the fault point mark 202 in the form of a navigation path, and guiding the movement direction of the maintenance personnel in the form of a voice prompt, and displaying the maintenance method of the component corresponding to the fault mark point in the form of text, and explaining the maintenance method of the component corresponding to the fault mark point in the form of a voice prompt.
[0048] Optionally, the guidance information 203 may also include a structural diagram of the component corresponding to the fault point mark 202, so that maintenance personnel can quickly understand the specific structure of the component that needs to be repaired. Obtaining the guidance information 203 corresponding to the fault point mark 202 is to display the structural diagram of the component corresponding to the fault point mark 202 (such as a three-dimensional diagram and an exploded diagram of the component corresponding to the fault point mark 202).
[0049] Optionally, the guidance information 203 includes fault prediction information and maintenance information of the fault point corresponding to the fault point mark 202, the fault prediction information includes the fault type of the fault point corresponding to the fault point mark 202 and the confidence corresponding to the fault type, the maintenance information at least includes obtaining maintenance plans for all fault types of the fault point corresponding to the fault point mark 202, and obtaining the guidance information 203 corresponding to the fault point mark 202 is to display the fault prediction information and maintenance information of the component corresponding to the fault point mark 202.
[0050] It can be understood that the fault point mark is determined based on the location information of the fault point in the device 200. There may be multiple types of faults at the fault point corresponding to the fault point mark 202, and the probability of each fault occurring is different. By obtaining the operation and maintenance data of the device 200 (such as the operation information collected by one or more sensors in the device 200, the maintenance information of different components in the device 200 (such as whether it has been repaired, etc.)), combined with the big data information maintained in the cloud, the possible fault type of each fault point and the confidence of the fault type can be obtained. The higher the confidence, the greater the probability that the fault point will have a fault of the fault type corresponding to the confidence.
[0051] If the operating information of the component corresponding to the fault point matches the preset operating information of the component when it is abnormal in the cloud big data, it can be determined that the confidence is high; or, different fault types have corresponding preset operating information, and the confidence of different fault types can be determined by the matching degree between the operating information of the component and each preset operating information, thereby providing a reference for maintenance personnel. Alternatively, when determining the confidence of a fault at the fault point, the maintenance information of the component can also be considered, such as the confidence of the component being over-maintained is greater than the confidence of the component not being over-maintained.
[0052] The indication information contains fault prediction information to assist maintenance personnel in determining the priority of fault handling, such as giving priority to faults with high confidence. The indication information also provides the maintenance plan corresponding to each fault type, that is, the specific method of repairing each fault type, as well as maintenance precautions, etc.
[0053] The device management method of the embodiment of the present application displays the digital twin model 201 of the device 200 so that the maintenance personnel can intuitively see the structure of different components of the device 200. In addition, the fault point mark 202 used to indicate the location of the fault point in the digital twin model 201 is displayed in the digital twin model 201. Through the interactive operation with the fault point mark 202, the guidance information 203 corresponding to the fault point mark 202 can be obtained. The maintenance of the fault point of the fault point mark 202 is guided by the guidance information 203, which not only has low requirements for maintenance personnel, but also does not require manual fault location, and the fault location is fast and accurate, thereby improving the maintenance efficiency of the device 200. Moreover, for simple faults, even users can perform self-maintenance according to the fault point mark 202 and the corresponding guidance information 203, which greatly saves the maintenance cost of the device 200.
[0054] See also Figure 2 , Figure 3 and Figure 6 , step 011: displaying the digital twin model 201 and the fault point mark 202 of the device 200, including:
[0055] Step 0111: Based on the location information of the device 200 and the extended reality device, the scene where the device 200 is located, the digital twin model 201 and the fault point mark 202 are superimposed and displayed in each extended reality device.
[0056] Specifically, in order to realize the superimposed display of the digital twin model 201, the device 200, the scene where the device 200 is located, and the fault point mark 202 through the XR glasses, the XR glasses are required to obtain the position of the device 200 and the scene where the device 200 is located (such as the XR glasses obtain the scene image through the camera to achieve visual positioning), and then combined with the position of the XR glasses, the digital twin model 201, the device 200, the scene where the device 200 is located, and the fault point mark 202 can be superimposed and displayed from the perspective of the XR glasses. At this time, the position of the displayed digital twin model 201 is the actual position of the device 200.
[0057] In addition, the maintenance personnel may include on-site maintenance personnel and remote maintenance personnel. Both the on-site maintenance personnel and the remote maintenance personnel have electronic devices 100 (such as wearing XR glasses). After the on-site maintenance personnel obtain the digital twin model 201, they can synchronize the display content (such as the on-site scene, digital twin model 201, device 200, and the fault mark point superimposed display content) and interactive operations to the remote maintenance personnel's XR glasses, so that the scene where the device 200 is located, the digital twin model 201 and the fault point mark 202 are superimposed in each extended reality device, so that the on-site maintenance personnel and the remote maintenance personnel can achieve multi-person collaboration and jointly complete the maintenance.
[0058] See also Figure 2 , Figure 3 and Figure 7 In some embodiments, the device management method further includes:
[0059] Step 013: Identify the device 200 to obtain the digital twin model 201 and the fault point mark 202 of the device 200. The digital twin model 201 is generated based on the three-dimensional model and operation and maintenance data of the device 200, and the fault point mark 202 is generated based on the operation and maintenance data.
[0060] Specifically, each digital twin model 201 can be pre-established based on the corresponding device 200. When establishing it, it is necessary to obtain the three-dimensional model of the corresponding device 200 and the operation and maintenance data. Only after the three-dimensional model and the operation and maintenance data are combined and the simulation operation of the three-dimensional model is realized, the establishment of the digital twin model 201 is realized.
[0061] In order to accurately obtain the digital twin model 201 corresponding to the device 200, the image of the device 200 can be captured by XR glasses, and then the model of the device 200 can be identified to obtain the digital twin model 201 corresponding to the device 200, thereby ensuring the accuracy of obtaining the digital twin model 201. After the device 200 is accurately identified, the digital twin model 201 and the fault point mark 202 corresponding to the device 200 can be obtained.
[0062] Alternatively, the digital twin model 201 is not pre-established but generated in real time by the XR glasses. The XR glasses can obtain an image of the device 200, and then identify the model of the device 200 based on the image, thereby obtaining a three-dimensional model that matches the model; after obtaining the three-dimensional model of the device 200, the XR glasses communicate with the device 200 to obtain the operation and maintenance data of the device 200, thereby combining the three-dimensional model and operation and maintenance data of the device 200 to generate the digital twin model 201 in real time.
[0063] See also Figure 2 , Figure 3 , Figure 8 and Fig. 9 The interactive operation includes a selection operation. Step 012: in response to the interactive operation on the fault point mark 202, obtaining the guidance information 203 corresponding to the fault point mark 202, including:
[0064] Step 0121: in response to a selection operation of a fault point mark 202 by one or more target objects, obtaining guidance information 203 corresponding to the selected fault point mark 202.
[0065] Specifically, maintenance personnel may include on-site maintenance personnel and remote maintenance personnel. Both on-site maintenance personnel and remote maintenance personnel have electronic devices 100 (such as wearing XR glasses). After the on-site maintenance personnel obtain the digital twin model 201, they can synchronously display content (such as on-site scenes, digital twin models 201, equipment 200, and content superimposed on fault markers) and interactive operations, so that on-site maintenance personnel and remote maintenance personnel can achieve multi-person collaboration and complete maintenance together.
[0066] Therefore, in response to the selection operation of one or more target objects (such as the electronic devices 100 of the on-site maintenance personnel and the remote maintenance personnel) on the fault point mark 202 in their respective electronic devices 100, the fault point mark 202 that needs to be repaired or troubleshooted can be collaboratively selected by obtaining the selection operations of multiple parties. For example, the on-site maintenance personnel selects the fault point mark A through the selection operation, and the remote maintenance personnel thinks that the fault point mark B may also have a fault, and selects the fault point mark B through the selection operation. Therefore, the fault point marks 202 that need to be repaired or troubleshooted are finally selected as the fault point mark A and the fault point mark B. At this time, the display content of one or more electronic devices 100 is synchronized, and the guidance information 203 corresponding to the selected fault point mark 202 can be displayed. For example, the guidance information 203 corresponding to the selected fault point mark A and the fault point mark B are displayed at the same time, so as to repair or troubleshoot the components corresponding to the fault point mark A and the fault point mark B.
[0067] See also Fig.10 and Fig.11 In some implementations, step 012: in response to an interactive operation on the fault point mark 202, obtaining guidance information 203 corresponding to the fault point mark 202 includes:
[0068] Step 0122: in response to the troubleshooting operation of the one or more target objects on the fault point mark 202, controlling the component corresponding to the troubleshooting fault point mark 202 to stop running;
[0069] Step 0123: Based on the operation and maintenance data of the device 200 before and after the component being checked stops running, obtain the guidance information 203 corresponding to the fault point mark 202 being checked, and the guidance information 203 includes whether the component being checked has a fault.
[0070] Specifically, there may be multiple fault marking points, but the actual fault point may be only one of them. The current practice generally requires maintenance personnel to go to the locations of the fault marking points one by one for on-site inspection based on personal experience, and then finally determine the fault marking point where the fault occurs and complete the maintenance. The troubleshooting takes a long time.
[0071] In this embodiment, the real-time synchronization property of the digital twin model 201 and the device 200 can be utilized to control the components of the device 200 through the digital twin model 201. For example, if the motor of the digital twin model of the device 200 stops rotating, the motor of the device 200 will also stop rotating. Based on the above properties, fault marking points can be quickly troubleshooted in the digital twin model 201.
[0072] When it is necessary to troubleshoot the fault marked point, the maintenance personnel only need to perform troubleshooting operations on the fault point mark 202 through the electronic device 100. For example, after double-clicking the fault point mark 202, a troubleshooting confirmation pop-up window is displayed. By clicking "Yes" or "No" again, it is determined whether to troubleshoot the selected fault point mark 202. Clicking "Yes" will troubleshoot the corresponding fault point mark 202. After the troubleshooting operation is performed on the fault point mark 202, the component corresponding to the fault point mark 202 is controlled to stop running.
[0073] It can be understood that when the component corresponding to the fault point mark 202 is faulty, the operation and maintenance data of the device 200 may not change even if the control stops running. When the component corresponding to the fault point mark 202 is normal and does not have a fault, if it stops running, the operation and maintenance data of the device 200 will inevitably change. Therefore, according to the difference between the operation and maintenance data of the device 200 before the stopped running of the checked component and the operation and maintenance data of the device 200 after the stopped running, it can be determined whether the checked component has a fault. If the operation and maintenance data of the device 200 before the stopped running and the operation and maintenance data of the device 200 after the stopped running are different, it is determined that there is no fault; if the operation and maintenance data of the device 200 before the stopped running and the operation and maintenance data of the device 200 after the stopped running are the same, it is determined that there is a fault. After completing the troubleshooting of the fault point mark 202, the corresponding guidance information 203 can be displayed to indicate to the maintenance personnel that the troubleshooting of the fault point mark 202 is completed, whether there is no fault and no need for maintenance, or there is a fault and needs maintenance. In this way, by performing a troubleshooting operation on the fault point mark 202, the troubleshooting of the component that may have a fault can be quickly achieved, which greatly saves the number of components that the maintenance personnel need to troubleshoot, and improves the efficiency of troubleshooting.
[0074] See also Figure 3 and 12 In some embodiments, the device management method further includes:
[0075] Step 014: In response to interactive operations on the digital twin model 201, obtain relevant information of the device 200 or a component of the device 200.
[0076] Specifically, maintenance personnel can also interact with the digital twin model 201 to obtain relevant information of the device 200 or components of the device 200, including basic information of the device 200 or components of the device 200 (such as the name, model, type, rated parameters, etc. of the device 200), operation and maintenance data (such as whether it is currently running, real-time parameters of sensors during operation, etc.), structural images, etc.
[0077] For example, the interactive operation includes a selection operation, by selecting the device 200 or any component of the device 200, the operation and maintenance data of the device 200 or any component of the device 200 can be viewed; or, a stereoscopic view or an exploded view of the device 200 or its component can be displayed. Alternatively, the interactive operation includes a zoom operation, by which the device 200 or any component of the device 200 is zoomed in and out, and the structure of the device 200 or its component is conveniently viewed, thereby providing information reference for maintenance personnel when performing maintenance and improving maintenance efficiency.
[0078] See also Fig.13 In order to better implement the above-mentioned equipment management method, the embodiment of the present application also provides an equipment management device 10. The equipment management device 10 may include a display module 11 and a first acquisition module 12. The display module 11 is used to display the digital twin model 201 and the fault point mark 202 of the device 200, and the fault point mark 202 is used to indicate the location of the fault point in the digital twin model 201; the first acquisition module 12 is used to respond to the interactive operation of the fault point mark 202, and obtain the guidance information 203 corresponding to the fault point mark 202, and the guidance information 203 is used to guide the maintenance of the fault point corresponding to the fault point mark 202.
[0079] The display module 11 is specifically used to overlay the scene where the display device 200 is located, the digital twin model 201 and the fault point mark 202 in each extended reality device according to the location information of the device 200 and the extended reality device.
[0080] The equipment management device 10 further includes an identification module 13. The identification module 13 is used to identify the equipment 200 to obtain a digital twin model 201 and a fault point mark 202 of the equipment 200. The digital twin model 201 is generated according to the three-dimensional model of the equipment 200 and operation and maintenance data.
[0081] The first acquisition module 12 is further specifically configured to acquire the guidance information 203 corresponding to the selected fault point mark 202 in response to a selection operation of the fault point mark 202 by one or more target objects.
[0082] The first acquisition module 12 is also specifically used to control the component corresponding to the fault point mark 202 to stop running in response to the troubleshooting operation of one or more target objects on the fault point mark 202; according to the operation and maintenance data of the device 200 before the troubleshooting component stops running and the operation and maintenance data of the device 200 after the troubleshooting component stops running, obtain the guidance information 203 corresponding to the troubleshooting fault point mark 202, and the guidance information 203 includes whether the troubleshooting component is faulty
[0083] The display module 11 is also used to display the navigation path and / or issue navigation prompts. The display module 11 is also used to display the structure diagram and maintenance information.
[0084] The device management apparatus 10 further includes a second acquisition module 14. The second acquisition module 14 is used to acquire relevant information of the device 200 or a component of the device 200 in response to an interactive operation on the digital twin model 201.
[0085] Please refer again Figure 2 An electronic device 100 of one embodiment of the present application includes a display 20, one or more processors 30, a memory 40 and one or more computer programs 42, wherein the one or more computer programs 42 are stored in the memory 40 and executed by the one or more processors 30, and the computer program 42 includes instructions for the device management method of any of the above-mentioned embodiments.
[0086] Optionally, the electronic device 100 may be any device 200 with a display 20, such as XR glasses, a mobile phone, a tablet computer, a smart watch, a head-mounted display 20, etc. This application takes the electronic device 100 as an example of XR glasses, and it can be understood that the specific form of the electronic device 100 is not limited to XR glasses.
[0087] The present application also provides a device management system, which includes a device 200 and an electronic device 100. The electronic device 100 can be connected to the device 200 for communication, and the electronic device 100 is used in the device management method of any of the above embodiments, which will not be described in detail.
[0088] See also Fig.14 The embodiment of the present application also provides a computer-readable storage medium 300 on which a computer program 310 is stored. When the computer program 310 is executed by a processor 320, the steps of the device management method of any of the above-mentioned embodiments are implemented. The processor 320 can be the processor of the electronic device 100. For the sake of brevity, it will not be repeated here.
[0089] An embodiment of the present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the device management method of any of the above-mentioned embodiments, wherein the processor may be the processor 30 in the electronic device 100 in the above-mentioned embodiment, which will not be described in detail here for the sake of brevity.
[0090] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0091] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0092] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. A device management method, characterized in that: include: A digital twin model of a display device and a fault point mark, wherein the fault point mark is used to indicate the location of the fault point in the digital twin model; In response to an interactive operation on the fault point mark, guidance information corresponding to the fault point mark is acquired, where the guidance information is used to guide maintenance of the fault point corresponding to the fault point mark.
2. The device management method according to claim 1, characterized in that: The digital twin model and fault point marking of the display device include: According to the location information of the device and the extended reality device, the scene where the device is located, the digital twin model and the fault point mark are superimposed and displayed in each of the extended reality devices.
3. The device management method according to claim 1, characterized in that: Also includes: Identify the device to obtain the digital twin model of the device and the fault point mark, wherein the digital twin model is generated based on the three-dimensional model of the device and the operation and maintenance data.
4. The device management method according to claim 1, characterized in that: The interactive operation includes a selection operation, and the obtaining of guidance information corresponding to the fault point mark in response to the interactive operation on the fault point mark includes: In response to a selection operation of the fault point mark by one or more target objects, the guidance information corresponding to the selected fault point mark is acquired.
5. The device management method according to claim 1, characterized in that: The interactive operation includes a troubleshooting operation, and the obtaining, in response to the interactive operation on the fault point mark, guidance information corresponding to the fault point mark includes: In response to a troubleshooting operation of one or more target objects on the fault point mark, controlling a component corresponding to the troubleshooted fault point mark to stop running; According to the operation and maintenance data of the equipment before and after the checked component stops running, the guidance information corresponding to the checked fault point mark is obtained, and the guidance information includes whether the checked component has a fault.
6. The device management method according to any one of claims 1 to 5, characterized in that: The guidance information includes navigation information, a structural diagram of a component corresponding to the fault point mark, and at least one of maintenance information; the navigation information includes at least one of a navigation path and a navigation prompt; and obtaining the guidance information corresponding to the fault point mark includes: Display the navigation path from the current position to the component corresponding to the fault point mark; and / or issue the navigation prompt according to the current position and the navigation path; and / or display the structural diagram and the maintenance information.
7. The device management method according to claim 1, characterized in that: The fault point mark is determined according to the location information of the fault point in the device, and the fault point of the device is determined according to the operation and maintenance data of the device and the cloud big data.
8. The device management method according to claim 1, characterized in that: Also includes: In response to interactive operations on the digital twin model, relevant information about the device or a component of the device is obtained.
9. A device management device, characterized in that: include: A display module, used to display a digital twin model of a device and a fault point mark, wherein the fault point mark is used to indicate a location of a fault point in the digital twin model; The first acquisition module is used to obtain guidance information corresponding to the fault point mark in response to an interactive operation on the fault point mark, wherein the guidance information is used to guide the maintenance of the fault point corresponding to the fault point mark.
10. An electronic device, characterized in that: include: monitor; One or more processors, memory; and One or more computer programs, wherein the one or more computer programs are stored in the memory and executed by one or more processors, and the computer programs include instructions for executing the device management method according to any one of claims 1 to 8.
11. A device management system, characterized in that: include: equipment; and An electronic device capable of being communicatively connected with the device, and configured to execute the device management method according to any one of claims 1 to 8.
12. A non-volatile computer-readable storage medium containing a computer program, wherein when the computer program is executed by a processor, the processor executes the device management method according to any one of claims 1 to 8.
13. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the device management method according to any one of claims 1 to 8 is implemented.
Citation Information
Cited By
Fault early warning method and device for automatic teller machine and storage medium
CN121330818A
