Maintenance support method and support device for equipment

Abstract

The present invention provides an equipment maintenance method, a device, and a system. The present invention: creates and displays a simulation scene on the basis of an engineering model of an implementation location of equipment; helps a maintenance operator to specify target equipment in the simulation scene; helps, in a field where the target equipment is located, to display related information of the target equipment and a simple interaction with the simulation scene; and thereby effectively improves maintenance efficiency and is useful to inspect and / or repair hidden equipment.

Description

Technical Field

[0001] The present invention relates to the field of equipment maintenance, and particularly to an equipment maintenance method, apparatus, and system.

Background Art

[0002] With the development of science and technology, various devices are being applied in various fields of life and production.

[0003] Currently, after a device fails, an after-sales service technician needs to visit the customer's home to inspect and confirm the information of the faulty device, further find the faulty parts, and then place an order to provide to the parts supply side. In the stage until the after-sales service technician visits the customer's home to inspect and confirm the faulty device and finds the faulty parts, the general operation process is as follows.

[0004] The after-sales service technician manually removes and inspects the device based on experience on-site and provides the device model number and part information to the administrator. The administrator searches for the part ID according to the device disassembly diagram on the device management website based on the provided information, and further registers on the parts inventory website to search for the inventory information and price of the parts by the part ID, and then feedbacks to the after-sales service technician.

[0005] In recent years, some technologies for assisting in the management and maintenance of devices based on virtual display have also emerged. For example, by setting a virtual display mark on the device, the mark is scanned by a mobile phone terminal to view the operation information of the device.

[0006] It should be noted that the above introduction of the technical background is only for the purpose of easily explaining the technical content of the present invention clearly and completely and making it easy for those skilled in the art to understand. These technical contents are only described in the part of the background art of the present invention, and thus the above technical contents cannot be regarded as known to those skilled in the art.

Summary of the Invention

[0007] However, the inventors discovered that manual inspection, repair, and maintenance methods, which primarily rely on experience to remove and inspect equipment, are inefficient, time-consuming, and make repairs to hidden faulty equipment and conduits more difficult and time-consuming. Furthermore, even with the introduction of virtual display technology, the process is usually complex. For example, in the case of the conventional technology described above, it is necessary to set virtual display marks for each piece of equipment, resulting in a complex and costly process.

[0008] To solve at least one of the above problems, embodiments of the present invention provide a method, apparatus, and system for maintaining equipment, which create and display a simulation scene based on an engineering model of the equipment's installation location, assist maintenance workers in identifying target equipment in the simulation scene, and display relevant information about the target equipment at the site where the target equipment is located, assisting maintenance workers in maintaining the target equipment. In this way, by forming a maintenance simulation scene based on an engineering model, maintenance workers can more easily identify target equipment that requires maintenance, and by displaying relevant information about the target equipment and simple interaction with the simulation scene at the equipment site, maintenance workers can more quickly identify target parts that require maintenance on the target equipment. Therefore, in addition to effectively improving maintenance efficiency, the simulation scene helps maintenance workers inspect and repair hidden equipment.

[0009] A first embodiment of the present invention provides a method for maintaining equipment, which includes: obtaining an engineering model of the equipment's mounting location; creating and displaying a simulation scene based on the engineering model and assisting a maintenance worker in identifying a target equipment in the simulation scene; and displaying relevant information about the target equipment based on the simulation scene at the site where the target equipment is located and assisting the maintenance worker in maintaining the target equipment.

[0010] A second embodiment of the present invention provides a device for maintaining equipment, comprising: acquisition means for acquiring an engineering model of the equipment's mounting location; first display means for creating and displaying a simulation scene based on the engineering model and assisting a maintenance worker in identifying a target equipment in the simulation scene; and second display means for displaying relevant information about the target equipment based on the simulation scene at the site where the target equipment is located and assisting a maintenance worker in maintaining the target equipment.

[0011] A third embodiment of the present invention provides a maintenance system for equipment, comprising the apparatus described in the second embodiment of the present invention and a detection device for detecting the gaze and / or movements of a maintenance worker.

[0012] One of the beneficial effects of the embodiment of the present invention is that a simulation scene is created and displayed based on an engineering model of the equipment installation location, and maintenance workers are assisted in identifying target equipment in the simulation scene. Furthermore, relevant information about the target equipment is displayed at the site where the target equipment is located, and maintenance workers are assisted in maintaining the target equipment. In this way, a maintenance simulation scene is formed based on the engineering model, making it easier for maintenance workers to identify target equipment that requires maintenance. By displaying relevant information about the target equipment and simple interaction with the simulation scene at the equipment site, maintenance workers can more quickly identify target parts that require maintenance on the target equipment. Therefore, in addition to effectively improving maintenance efficiency, the simulation scene helps maintenance workers inspect and repair equipment that is hidden.

[0013] Specific embodiments of the present invention are disclosed in detail with reference to the following description and drawings, and the embodiments in which the principles of the present invention may be employed are clearly indicated. Embodiments of the present invention should be considered not to be limited in scope. Within the spirit and scope of the appended claims, embodiments of the present invention include many changes, amendments and equivalents.

[0014] Features described and / or shown in one embodiment may be used in the same or similar manner in one or more other embodiments, combined with or substituting features in other embodiments.

[0015] When used in this text, the term "include / contain" refers to the presence of feature information, an entire component, a step, or a component, but it should be emphasized that it does not exclude the presence / addition of one or more other feature information, an entire component, a step, or a component. [Brief explanation of the drawing]

[0016] The present invention can be better understood from many angles by referring to the following drawings. The components in the drawings are not proportional and are merely for illustrating the principles of the present invention. Corresponding parts in the drawings may be enlarged or reduced in order to illustrate certain parts of the present invention. Elements and feature information described in one drawing or one embodiment of the present invention can be combined with elements and feature information shown in one or more other drawings or embodiments. In addition, similar reference numerals in the drawings may indicate corresponding components in several drawings and corresponding components used in one or more embodiments. The drawings are as follows:

[0017] [Figure 1] This is a flowchart of the maintenance method for the equipment according to Embodiment 1 of the present invention. [Figure 2] This is a flowchart of a method for assisting a maintenance worker in identifying a target device in a simulation scene according to Embodiment 1 of the present invention. [Figure 3] This is a flowchart of a method for realizing step 103 according to Embodiment 1 of the present invention. [Figure 4] This is a flowchart of another method for realizing step 103 according to Embodiment 1 of the present invention. [Figure 5] This is a flowchart of a method for realizing step 402 according to Embodiment 1 of the present invention. [Figure 6] This is a flowchart of a method for realizing step 403 according to Embodiment 1 of the present invention. [Figure 7] This is a flowchart of another method for realizing step 403 according to Embodiment 1 of the present invention. [Figure 8] This is a flowchart of yet another method for realizing step 403 according to Embodiment 1 of the present invention. [Figure 9] This is a flowchart of yet another method for realizing step 403 according to Embodiment 1 of the present invention. [Figure 10] This is a flowchart of a method for realizing step 902 according to Embodiment 1 of the present invention. [Figure 11] Another flowchart of the equipment maintenance method according to Embodiment 1 of the present invention. [Figure 12] A flowchart specifically implementing the equipment maintenance method according to Embodiment 1 of the present invention. [Figure 13] A schematic diagram of the equipment maintenance device according to Embodiment 2 of the present invention. [Figure 14] A structural diagram of the equipment maintenance system according to Embodiment 3 of the present invention.

Embodiments for Implementing the Invention

[0018] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[0019] <Example 1> Embodiment 1 of the present invention provides an equipment maintenance method. FIG. 1 is a flowchart of the equipment maintenance method according to Embodiment 1 of the present invention. As shown in FIG. 1, the method includes step 101 of obtaining an engineering model of the equipment installation location, step 102 of creating and displaying a simulation scene based on the engineering model, and assisting the maintenance worker to identify the target equipment in the simulation scene, step 103 of displaying the related information of the target equipment based on the simulation scene at the site where the target equipment is located, and assisting the maintenance worker to maintain the target equipment.

[0020] In this way, by creating maintenance simulation scenes based on engineering models, maintenance workers can more easily identify target equipment requiring maintenance. By displaying relevant information about the target equipment and simple interaction with the simulation scene at the equipment site, maintenance workers can more quickly identify target parts requiring maintenance on the target equipment. Therefore, in addition to effectively improving maintenance efficiency, the simulation scenes also help maintenance workers inspect and repair equipment that is hidden from view.

[0021] In the embodiments of the present invention, instead of obtaining an engineering model of the mounting location of the equipment, the equipment model of the target equipment may be directly obtained and the equipment model may be displayed. That is, step 103 can be performed directly without performing steps 101 and 102, and in step 103, the equipment model of the target equipment is obtained, each component in the equipment model is displayed in an unfolded manner, a target component that may fail is identified, and information about the target component is obtained.

[0022] For example, a maintenance worker selects the model number of the equipment, retrieves the corresponding equipment model from the background, directly disassembles and unpacks the equipment, selects the faulty part, and identifies the part's information.

[0023] For specific implementation methods, please refer to the detailed explanation for Step 103 below.

[0024] In embodiments of the present invention, the apparatus for carrying out the method may be, for example, a terminal device, which may be, for example, an augmented reality (AR) device, a virtual reality (VR) device, or a mixed reality (MR) device.

[0025] In embodiments of the present invention, the AR device may be any type of AR device, such as AR glasses, a smartphone, a tablet, or a customized AR handheld device.

[0026] In embodiments of the present invention, the target equipment to be maintained may be various types of equipment, such as air conditioners, ventilation equipment, or floor heating equipment. Furthermore, the equipment to be maintained may also include various piping, such as refrigerant lines, electrical conduits, and condensate lines of air conditioners.

[0027] In embodiments of the present invention, the target equipment to be maintained may include, for example, indoor units mounted on suspended ceilings and concealed equipment such as various conduits.

[0028] In the embodiments of the present invention, the timing for performing the method may be, for example, when a malfunction occurs in the equipment, or when periodic maintenance or servicing is performed.

[0029] In the embodiments of the present invention, the mounting location of the equipment refers to the site where the mounted equipment is located, which may be, for example, inside a building or outdoors.

[0030] In embodiments of the present invention, the engineering model may be any type of three-dimensional engineering model, such as a Building Information Modeling (BIM).

[0031] In step 101, obtain an engineering model of the equipment's mounting location.

[0032] For example, obtain a BIM model of the equipment installation location from a cloud server or an existing BIM platform.

[0033] After obtaining the engineering model, in step 102, a simulation scene is created and displayed based on the engineering model, and assistance is provided to the maintenance worker in identifying the target equipment in the simulation scene.

[0034] For example, by positioning the engineering model at the site where the target equipment is located, the engineering model is superimposed on the site, and the engineering model is displayed on a terminal device, that is, a maintenance simulation scene is displayed.

[0035] Various positioning techniques can be used for specific positioning methods.

[0036] For example, positioning may be performed using two location points at the site, or using three location points at the site, or by scanning a two-dimensional code at the site, or by using a magnetometer, or by using ultra-wideband (UWB) technology, or by combining multiple of the above methods.

[0037] For example, the terminal device is an AR device, a VR device, or an MR device.

[0038] After creating and displaying a maintenance simulation scene, it is possible to assist maintenance workers in identifying target equipment within that simulation scene.

[0039] Figure 2 is a flowchart of a method according to Embodiment 1 of the present invention for assisting a maintenance worker in identifying target equipment in a simulation scene. As shown in Figure 2, the method includes the following:

[0040] Step 201 involves identifying the target equipment and its location in the simulation scene by detecting the voice, gaze, or blinking of the maintenance worker.

[0041] For example, by detecting a voice command from a maintenance worker that includes the name of the target equipment, and identifying the target equipment that the maintenance worker intends to maintain and its location in the simulation scene, For example, by tracking the eyeballs of a maintenance worker, that is, by tracking and detecting their gaze, the target equipment that the maintenance worker intends to maintain and its location can be identified in the simulation scene. For example, the system can detect the blinking motion of a maintenance worker and identify the target equipment and its location in the simulation scene.

[0042] In embodiments of the present invention, methods for specifically detecting the voice, gaze, or blinking of a maintenance worker can be found in related technologies, and a detailed explanation is omitted here.

[0043] Furthermore, after identifying the target equipment and its location, it is possible to mark the displayed simulation scene.

[0044] In this way, the target equipment can be quickly located by detecting the voice, gaze, or blinking of the maintenance worker.

[0045] In an embodiment of the present invention, as shown in Figure 2, the method may further include step 202, in which the terminal device displays a travel path that guides the maintenance worker toward the target equipment.

[0046] For example, the displayed simulation scene shows the route from the current location to the target device.

[0047] In this way, on-site maintenance workers can be guided to the location of the target equipment conveniently and quickly, and can then begin further inspection and maintenance of the equipment.

[0048] After the maintenance worker reaches the location of the target equipment, in step 103, relevant information about the target equipment is displayed at the site where the target equipment is located, based on the simulation scene, and assistance is provided to the maintenance worker in performing maintenance on the target equipment.

[0049] Figure 3 is a flowchart of a method for realizing step 103 according to Embodiment 1 of the present invention. As shown in Figure 3, the method is Step 301 involves obtaining the equipment number and part number of the target equipment, Step 302 involves searching for information on the target equipment and each component based on the displayed information table of equipment and components. This includes step 303, which involves obtaining information about the target part.

[0050] For example, the system automatically retrieves the equipment number and part number of the target equipment, and also retrieves and displays an information table of the corresponding equipment and part from the database. In this way, maintenance workers can quickly find the number corresponding to the part requiring maintenance using a table lookup method and quickly identify the repair method.

[0051] Figure 4 is a flowchart of another method for realizing step 103 according to Embodiment 1 of the present invention. As shown in Figure 4, the method is Step 401 to obtain the equipment model of the target equipment, Step 402, which displays each component of the equipment model in an unfolded manner, Step 403 involves identifying the target part, The procedure includes step 404, which involves obtaining information about the target part.

[0052] For example, the equipment model of the target device is obtained from the background or a database, and this equipment model is a 3D model.

[0053] In this way, maintenance workers can intuitively and quickly identify target parts that require maintenance, and obtain relevant information, further improving the efficiency of maintenance.

[0054] In step 402, each component of the equipment model is displayed in an unfolded state. For example, each component is displayed in an assembled perspective view.

[0055] Figure 5 is a flowchart of a method for realizing step 402 according to Embodiment 1 of the present invention. As shown in Figure 5, the method is Step 501, which displays the device model at the front of the line of sight using a terminal device, The procedure includes step 502, which involves unfolding and displaying each component of the equipment model in a manner that simulates an assembly perspective view based on the detection of the maintenance worker's voice or gestures.

[0056] In this way, maintenance workers can view each component conveniently and intuitively.

[0057] Furthermore, in step 402, based on the detection of the maintenance worker's action of removing the target equipment, the individual components of the equipment model can be displayed in an unfolded state. In this way, the disassembled display of each component can be synchronized with the actual removal action, making it easier for the maintenance worker to perform the work and improving the efficiency of maintenance.

[0058] In step 403, the target part is identified. The various methods for identifying the target part are described in detail below.

[0059] Figure 6 is a flowchart of a method for realizing step 403 according to Embodiment 1 of the present invention. As shown in Figure 6, the method is Step 601 involves searching for the names of each component in the equipment model based on the detection of the voice of the maintenance worker, and obtaining a selection of parts. The procedure includes step 602, which highlights the selected parts.

[0060] For example, a maintenance worker, after viewing each displayed component, identifies a component that may be prone to failure and speaks aloud the name of part or all of that component. Based on the detection of the voice, the system recognizes the name as a keyword, performs a fuzzy search based on the keyword, and highlights all components in the equipment model whose component name contains the keyword. After the fuzzy search and selection, the user can input further voice to perform further searches and selections to identify the target component, or they can visually identify the target component using gestures.

[0061] Alternatively, a maintenance worker may emit a voice message containing the part number or name, and based on the detection of the voice message, an accurate matching may be performed and the part highlighted on the equipment model.

[0062] Furthermore, voice messages uttered by maintenance workers may not include the name or number of the equipment, but may contain keywords for control purposes. For example, if the voice includes similar content such as "disassembly and unpacking" or "automatic model unpacking," the system will execute processes such as disassembling and unpacking the equipment model.

[0063] In this way, maintenance workers can conveniently and intuitively identify and view target parts, further improving maintenance efficiency.

[0064] In embodiments of the present invention, some components can be highlighted using various methods, for example, by highlighting the components that require emphasis, or by rendering the components that require emphasis in a different color.

[0065] Alternatively, the component requiring highlighting may be moved to the front edge of the line of sight.

[0066] Figure 7 is a flowchart of another method for realizing step 403 according to Embodiment 1 of the present invention. As shown in Figure 7, the method is Step 701 involves zooming, rotating, and translating each of the unfolded parts based on the detection of the maintenance worker's gestures, The procedure includes step 702, which involves identifying the target part selected by the maintenance worker.

[0067] In this way, maintenance workers can perform various operations on the target part in a virtual scene by making simple gestures, which helps them to quickly identify the target part.

[0068] Figure 8 is a flowchart of yet another method for realizing step 403 according to Embodiment 1 of the present invention. As shown in Figure 8, the method is Step 801 involves operating each of the unfolded parts based on the detection of the maintenance worker's line of sight, The procedure includes step 802, which identifies a target part selected by the maintenance worker based on the detection of the maintenance worker's blinking.

[0069] In this way, maintenance workers can manipulate and identify target parts in a virtual scene through simple actions such as glancing or blinking.

[0070] In step 801, the maintenance worker may operate by gazing and rotating their eyes, for example by moving their eyes up, down, left, and right to rotate the model, and may also operate by blinking, gazing, and then rotating their head.

[0071] In step 802, for example, a target part is selected by blinking twice quickly, and the target part is the part where the gaze is positioned after blinking twice.

[0072] In step 403, based on various other information, potential target parts that may have a malfunction can be pushed to maintenance personnel.

[0073] In the embodiments of the present invention, the candidate target part pushed to the maintenance worker may be a single part, or it may be multiple parts, such as a list of multiple parts.

[0074] Figure 9 is a flowchart of yet another method for realizing step 403 according to Embodiment 1 of the present invention. As shown in Figure 9, the method is Step 901 involves obtaining at least one of the target equipment's historical maintenance information, operating information, and failure information. Step 902 identifies candidate target parts based on at least one of the target equipment's historical maintenance information, operating information, and failure information. The procedure includes step 903, which pushes the candidate target part to the maintenance worker.

[0075] In this way, by automatically pushing candidate target parts based on at least one of the target equipment's historical maintenance information, operating information, and failure information, the inspection time for maintenance workers can be reduced, and the efficiency and accuracy of maintenance can be further improved.

[0076] For example, the fault information includes a fault code, and in step 902, a component that is likely to experience the fault corresponding to that fault code is designated as a candidate target component.

[0077] In this way, fault codes allow for easy and rapid identification of potential target parts, further improving the efficiency and accuracy of maintenance.

[0078] Furthermore, candidate target parts can be identified based on the predictive model.

[0079] Figure 10 is a flowchart of a method for realizing step 902 according to Embodiment 1 of the present invention. As shown in Figure 10, the method is Step 1001 involves inputting at least one of the usage status, operating data, and loss status of each component of the target equipment into a predictive model. The process includes step 1002, which sets the target component output from the prediction model as a candidate target component.

[0080] In the embodiment of the present invention, the predictive model is, for example, an AI model obtained through training.

[0081] For example, the usage time, operating conditions, and operating parameters of each component are input into a neural network, the loss status of each component is ranked and output, candidate target components are output based on the ranking, the model is waited for to converge, and the model is saved.

[0082] Thus, identifying candidate target parts using a pre-created predictive model can be applied to situations where each part has failed, offering broader applicability and further improving maintenance efficiency.

[0083] Furthermore, in the embodiments of the present invention, candidate target parts may be identified based on the equipment's maintenance history information.

[0084] For example, in step 902, candidate target parts are identified based on the number of times each part has been repaired in the historical maintenance information of the target equipment.

[0085] For example, the part with the most repairs, or one of the parts with the highest number of repairs, could be designated as a candidate target part.

[0086] In this way, candidate target parts can be easily identified based on historical maintenance information.

[0087] In step 903, the candidate target part is pushed to the maintenance worker. For example, the candidate target part is highlighted.

[0088] For example, you could highlight the parts that need to be highlighted, or render them in a different color. Alternatively, you could move the parts that need to be highlighted to the front edge of the viewer's field of view.

[0089] For example, it can also display a list of candidate target parts.

[0090] In embodiments of the present invention, the various methods for identifying the target component may be used individually or in combination.

[0091] After identifying the target part in step 403, information about the target part is obtained in step 404.

[0092] For example, based on the maintenance worker's selection of a target part, detailed information about that target part is searched for and displayed.

[0093] For example, you can double-click to obtain the ID on the model, and then use the corresponding part's ID number to search for information on the corresponding target part.

[0094] In embodiments of the present invention, the detailed information of the target part may include at least one of the following: shipping information, supplier information, price information, inventory information, repair instruction information, and installation / removal instruction information for the target part.

[0095] In embodiments of the present invention, repair instruction information and installation / removal instruction information can be dynamically displayed in the form of a video or animation. In this way, maintenance workers can intuitively refer to the information, further improving the efficiency of maintenance.

[0096] In this way, it is possible to provide convenience to maintenance workers when working on target parts, further improving the efficiency of maintenance.

[0097] For example, a maintenance worker can open the inventory information display page with one gesture and the shipping information display page with another gesture.

[0098] In embodiments of the present invention, the detailed information may further include order information for the target part. For example, the method further includes generating an order based on the order information based on the operation of the maintenance worker.

[0099] For example, a maintenance worker places an order on the displayed order page.

[0100] In this way, maintenance workers can directly perform order operations, further improving the efficiency of maintenance.

[0101] Figure 11 is another flowchart of the maintenance method for the equipment according to Embodiment 1 of the present invention. As shown in Figure 11, the method is Step 1101 involves obtaining an engineering model of the equipment installation location, Step 1102 involves positioning the engineering model at the site where the target equipment is located, thereby superimposing the engineering model onto the site, and displaying the engineering model on a terminal device. Step 1103 assists the maintenance worker in identifying the target equipment based on the displayed engineering model, Step 1104 identifies the target parts based on the push-delivered target parts and / or actual detection results for each part, Step 1105 involves displaying the equipment model of the target equipment and unfolding and displaying each component in the equipment model, Step 1106 involves operating the target part in each of the unfolded parts based on the actions of the maintenance worker, Step 1107 to obtain information on the target part, The process includes step 1108, which generates order information for the target part.

[0102] For specific instructions on how to implement each of the above steps, please refer to the previously mentioned content; a detailed explanation will be omitted here.

[0103] Figure 12 is a flowchart illustrating the specific implementation of the equipment maintenance method according to Embodiment 1 of the present invention. Using an air conditioner as an example, the method is as shown in Figure 12: After launching the program, the AR glasses perform step 1201, which retrieves the air conditioner model and pipeline model from the BIM platform. Step 1202 involves positioning the BIM air conditioner model and pipeline model on the actual building using a positioning method such as code scanning, and having AR glasses display the simulation scene. Step 1203 involves a maintenance worker selecting a target air conditioner in a simulation scene, obtaining a high-definition virtual model of the selected air conditioner from a server based on the air conditioner's ID, and displaying a disassembled, oblique, and assembled view of the air conditioner using AR glasses. Step 1204 involves the system analyzing the operating information of the selected air conditioner to determine, for example, the usage time and operating conditions of each common component, such as operating time, operating temperature, and operating time. Step 1205 involves referring to the air conditioner's fault codes, analyzing the results, prioritizing potentially faulty parts, and pushing this information to on-site maintenance personnel. Step 1206 involves a maintenance worker selecting a target air conditioner, viewing repair-related information such as the air conditioner's repair history and the extent of parts loss, and performing inspection and repair based on suggestions pushed from the system, thereby improving inspection and repair efficiency and enabling rapid identification of the cause of failure. Step 1207 involves constructing a virtual spatial coordinate system with the device itself as the origin, allowing maintenance workers to move and display a virtual air conditioner model in front of their eyes. Step 1208 involves using a camera system to perform hand recognition, then modeling a virtual hand model after recognizing the hand, capturing the hand's posture in real time, and mapping it to the virtual hand model. The system monitors collisions between the virtual hand model and the virtual air conditioner model in real time. If a collision is completed, it determines the direction of hand movement. If the hand moves linearly, it calculates the coordinate difference between the hand model and the virtual air conditioner model. By adding this coordinate difference to the hand model's coordinates in real time, the system ensures that the virtual equipment always moves in sync with the hand model, thereby achieving the objective of grasping and moving the model with the hand. This is achieved through a step 1209 of grasping the moving member. The system monitors collisions between a virtual hand model and a virtual device model in real time. Once a collision is complete, it determines the direction of hand movement. If the hand rotates, it obtains the arc of the hand model's movement, calculates a rotation angle with the device model as its center, and provides this rotation angle to the virtual device in real time. The system grasps a rotating member in order to achieve the objective of the model rotating along with the arm. The system monitors collisions between the virtual hand model and the virtual equipment model in real time. If both hands complete a collision with the model, and both hands move linearly along the same axis, or in the opposite direction, the distance moved by both hands is calculated, divided by the distance at the time of collision to obtain a coefficient C greater than 1, and the entire coefficient C is multiplied by the zoom value of the equipment model to achieve an enlargement effect, while conversely achieving a reduction effect, by grasping the member with both hands and enlarging it in step 1211. Step 1212, which completes the three basic functions of moving, rotating, and zooming on a model using gestures, involves finding a part model, recognizing a single tap of the finger, and upon completing a collision with the part model, determining that a selection operation on the part is to be performed at this time, and displaying its information while highlighting the part. After selecting a part, the inventory information, shipping information, repair history, etc. are displayed, and the order details page is generated directly, allowing for direct ordering (step 1213). Step 1214 includes automatically recording the repair status after the repair is completed, including the repair worker, time, location, and details of the repair.

[0104] As can be seen from the above embodiment, a simulation scene is created and displayed based on an engineering model of the equipment's installation location, assisting maintenance workers in identifying target equipment in the simulation scene, and displaying relevant information about the target equipment at the site where the target equipment is located, assisting maintenance workers in maintaining the target equipment. In this way, a maintenance simulation scene is formed based on the engineering model, making it easier for maintenance workers to identify target equipment requiring maintenance, and by displaying relevant information about the target equipment and simple interaction with the simulation scene at the equipment site, maintenance workers can more quickly identify target parts requiring maintenance on the target equipment. Therefore, in addition to effectively improving maintenance efficiency, the simulation scene helps maintenance workers inspect and repair equipment that is hidden.

[0105] <Example 2> Embodiment 2 of the present invention provides a maintenance device for equipment corresponding to the equipment maintenance method described in Embodiment 1, and its specific implementation can be found by referring to the implementation of the method described in Embodiment 1, without repeating the same content or related parts.

[0106] Figure 13 is a schematic diagram of a maintenance device for equipment according to Embodiment 2 of the present invention. As shown in Figure 13, the equipment maintenance device 1300 is Acquisition means 1301 for obtaining an engineering model of the equipment mounting location, A first display means 1302 creates and displays a simulation scene based on the engineering model and assists maintenance workers in identifying target equipment in the simulation scene, The system includes a second display means 1303 that displays relevant information about the target equipment based on the simulation scene at the site where the target equipment is located, and assists the maintenance worker in performing maintenance on the target equipment.

[0107] In embodiments of the present invention, the maintenance device 1300 for the equipment may be a terminal device.

[0108] For example, the device is an augmented reality (AR) device, a virtual reality (VR) device, or a mixed reality (MR) device. Alternatively, some functions of the device's maintenance device 1300 may be implemented by terminal equipment, and some functions may be implemented by a cloud server.

[0109] In embodiments of the present invention, the realization of the functions of each of the above means can be achieved by referring to the relevant steps in Embodiment 1, and will not be described again here.

[0110] As can be seen from the above embodiment, a simulation scene is created and displayed based on an engineering model of the equipment's installation location, assisting maintenance workers in identifying target equipment in the simulation scene, and displaying relevant information about the target equipment at the site where the target equipment is located, assisting maintenance workers in maintaining the target equipment. In this way, a maintenance simulation scene is formed based on the engineering model, making it easier for maintenance workers to identify target equipment requiring maintenance, and by displaying relevant information about the target equipment and simple interaction with the simulation scene at the equipment site, maintenance workers can more quickly identify target parts requiring maintenance on the target equipment. Therefore, in addition to effectively improving maintenance efficiency, the simulation scene helps maintenance workers inspect and repair equipment that is hidden.

[0111] <Example 3> Embodiment 3 of the present invention provides a maintenance system for equipment including the equipment maintenance device described in Embodiment 2, the specific implementation of which can be referenced to the implementation of the device described in Embodiment 2 and the method described in Embodiment 1, and the same content or related parts will not be repeated.

[0112] Figure 14 is a structural diagram of the equipment maintenance system according to Embodiment 3 of the present invention. As shown in Figure 14, the equipment maintenance system 1400 is Equipment maintenance device 1401, Includes a detection device 1402 that detects the gaze and / or movements of a maintenance worker.

[0113] In embodiments of the present invention, the specific structure and function of the equipment maintenance device 1401 can be described by referring to the device described in Example 2 and the method described in Example 1, and will not be described again here.

[0114] In embodiments of the present invention, the detection device 1402 may be various detection devices capable of detecting the gaze and / or actions of a maintenance worker, such as detection equipment including a camera.

[0115] As shown in Figure 14, the equipment maintenance system 1400 may further include a cloud server 1403 that stores engineering models, equipment models, and maintenance data.

[0116] As can be seen from the above embodiment, a simulation scene is created and displayed based on an engineering model of the equipment's installation location, assisting maintenance workers in identifying target equipment in the simulation scene, and displaying relevant information about the target equipment at the site where the target equipment is located, assisting maintenance workers in maintaining the target equipment. In this way, a maintenance simulation scene is formed based on the engineering model, making it easier for maintenance workers to identify target equipment requiring maintenance, and by displaying relevant information about the target equipment and simple interaction with the simulation scene at the equipment site, maintenance workers can more quickly identify target parts requiring maintenance on the target equipment. Therefore, in addition to effectively improving maintenance efficiency, the simulation scene helps maintenance workers inspect and repair equipment that is hidden.

[0117] The apparatus and method described above in the embodiment of the present invention can be implemented by hardware, or by a combination of hardware and software. The present invention relates to a computer-readable program that, when executed on a logic member, can cause the logic member to implement the above-mentioned apparatus or components, or to implement the above-mentioned various methods or steps.

[0118] Embodiments of the present invention further relate to storage media for storing the above-mentioned program, such as hard disks, magnetic disks, optical disks, DVDs, and flash memory.

[0119] Furthermore, the limitations on each step of this plan are not considered to restrict the order in which the steps are performed, provided that they do not affect the implementation of the specific plan. The previous step may be performed first, the next step may be performed, or even simultaneously. As long as this plan can be implemented, all of these steps should be considered to fall within the scope of protection of this application.

[0120] Although the present application has been described above with reference to specific embodiments, those skilled in the art will understand that these descriptions are illustrative and do not limit the scope of the claims of this application. Those skilled in the art may make various modifications and amendments to this application based on the idea and principles of this application, and these modifications and amendments are also within the scope of this application.

Claims

1. A method for assisting in the maintenance of equipment by a computer, Obtaining an engineering model of the equipment's installation location, Based on the aforementioned engineering model, a simulation scene is created and displayed, and at least one of the target equipment's component history maintenance information, operating information, and failure information is acquired to assist maintenance personnel in identifying the target equipment in the simulation scene. At the site where the target equipment is located, relevant information about the target equipment is displayed based on the simulation scene, and the maintenance worker is supported in performing maintenance on the target equipment. Includes, Obtaining an engineering model of the installation location of the aforementioned equipment includes obtaining an air conditioner model and a pipeline model from the BIM platform as the engineering model. Displaying relevant information about the target equipment based on the aforementioned simulation scene is: Based on the ID of the air conditioner, a high-resolution virtual model of the air conditioner, which can be displayed in disassembled, oblique, and assembled state, is obtained from the server as the equipment model of the target equipment. The system is characterized by including automatically obtaining the equipment number and part number of the target equipment based on the high-resolution virtual model, and obtaining and displaying the corresponding equipment and part information table from the database. Methods for supporting equipment maintenance.

2. Creating and displaying a simulation scene based on the aforementioned engineering model means that The method is characterized by positioning the engineering model at the site where the target equipment is located, thereby superimposing the engineering model onto the site, and displaying the engineering model on a terminal device. A method for supporting the maintenance of the equipment described in claim 1.

3. The above means that the engineering model is positioned at the site where the target equipment is located. The position is determined by the two location points at the site, or The position is determined by the three location points at the site, or This is characterized by including positioning by scanning a two-dimensional code at the site. A method for supporting the maintenance of the equipment described in claim 2.

4. The fact that maintenance workers are assisting in identifying target equipment in the simulation scene is, This is characterized by including the identification of target equipment and its location in the simulation scene by detecting the voice, gaze, or blinking of the maintenance worker. A method for supporting the maintenance of the equipment described in claim 2.

5. The fact that maintenance workers are assisting in identifying target equipment in the simulation scene is, The terminal device further includes displaying a travel route that guides the maintenance worker toward the target equipment, characterized in that A method for supporting the maintenance of the equipment described in claim 4.

6. The above-mentioned means displaying relevant information about the target equipment based on the simulation scene and assisting the maintenance worker in maintaining the target equipment, To obtain the equipment number and part number of the aforementioned target equipment, Based on the displayed information table of equipment and components, the information of the target equipment and each component is searched, A feature that includes obtaining information on the target part, A method for supporting the maintenance of the equipment described in claim 1.

7. The above-mentioned means displaying relevant information about the target equipment based on the simulation scene and assisting the maintenance worker in maintaining the target equipment, To obtain the equipment model of the aforementioned target equipment, To display each component of the aforementioned equipment model in its deployed form, Identifying the target part, The method is characterized by including obtaining information on the target component, A method for supporting the maintenance of the equipment described in claim 1.

8. The above, which displays each component in the equipment model in an unfolded manner, The terminal device displays the aforementioned device model at the front of the line of sight, The method is characterized by including the following: unfolding and displaying each component of the equipment model in a manner that simulates an assembly perspective view based on the detection of the voice or gestures of the maintenance worker, A method for supporting the maintenance of the equipment described in claim 7.

9. The above, which displays each component in the equipment model in an unfolded manner, The system is characterized by including unfolding and displaying each component in the equipment model based on the detection of the maintenance worker's action of removing the target equipment, A method for supporting the maintenance of the equipment described in claim 7.

10. Identifying the target part, Based on the detection of the voice of the maintenance worker, the system searches for the names of each component in the equipment model and retrieves a selection of components. A feature comprising highlighting the selected parts, A method for supporting the maintenance of the equipment described in claim 7.

11. Identifying the target part, Based on the detection of the maintenance worker's gestures, the parts in the unfolded display are zoomed, rotated, and translated. A method characterized by including identifying the target part selected by the maintenance worker, A method for supporting the maintenance of the equipment described in claim 7.

12. Identifying the target part, Based on the detection of the maintenance worker's line of sight, the operator manipulates each of the unfolded parts, The method is characterized by including identifying a target part selected by the maintenance worker based on the detection of the maintenance worker's blinking, A method for supporting the maintenance of the equipment described in claim 7.

13. Identifying the target part, To acquire at least one of the historical maintenance information, operating information, and failure information of the aforementioned target equipment, Identifying candidate target parts based on at least one of the historical maintenance information, operating information, and failure information of the aforementioned target equipment, The present invention is characterized by including the push delivery of the candidate target parts to the maintenance worker, A method for supporting the maintenance of the equipment described in claim 7.

14. The aforementioned fault information includes a fault code, The above-mentioned method of identifying candidate target parts based on at least one of the historical maintenance information, operating information, and failure information of the target equipment is as follows: This is characterized by including designating a component that is likely to experience a failure corresponding to the aforementioned fault code as a candidate target component. A method for supporting the maintenance of the equipment described in claim 13.

15. The above-mentioned method of identifying candidate target parts based on at least one of the historical maintenance information, operating information, and failure information of the target equipment is as follows: The prediction model is to input at least one of the operating status, operational data, and loss status of each component of the aforementioned target equipment. This is characterized by including setting the target component output from the prediction model as a candidate target component, A method for supporting the maintenance of the equipment described in claim 13.

16. The above-mentioned method of identifying candidate target parts based on at least one of the historical maintenance information, operating information, and failure information of the target equipment is as follows: This method is characterized by including identifying candidate target parts based on the number of repairs performed on each part in the historical maintenance information of the target equipment. A method for supporting the maintenance of the equipment described in claim 13.

17. The aforementioned means that the aforementioned candidate target parts are pushed to the maintenance worker. The method is characterized by including highlighting the candidate target component. A method for supporting the maintenance of the equipment described in claim 13.

18. The acquisition of information on the target component means that The system is characterized by including searching for and displaying detailed information about the target part based on the selection of the target part by the maintenance worker. A method for supporting the maintenance of the equipment described in claim 7.

19. The detailed information of the target part is characterized by including at least one of the following: shipping information, supplier information, price information, inventory information, repair instruction information, and installation / removal instruction information for the target part. A method for supporting the maintenance of the equipment described in claim 18.

20. The aforementioned detailed information further includes order information for the target part, A method for supporting the maintenance of the equipment described in claim 19.

21. The further comprising generating an order based on the order information based on the operation of the maintenance worker, is characterized by A method for supporting the maintenance of the equipment described in claim 20.

22. A method for assisting in the maintenance of equipment by a computer, Obtaining an engineering model of the equipment's installation location, By positioning the engineering model at the site where the target equipment is located, the engineering model is superimposed on the site, and the engineering model is displayed on a terminal device. The system acquires at least one of the historical maintenance information, operating information, and failure information of the components of the target equipment, and assists the maintenance worker in identifying the target equipment based on the displayed engineering model. Identifying target parts based on the push-delivered target parts and / or actual detection results for each part, The equipment model of the aforementioned target equipment is displayed, and each component of the aforementioned equipment model is displayed in an expanded form. Based on the actions of the maintenance worker, the target part is operated in each of the unfolded parts, To obtain information on the aforementioned target component, To generate order information for the aforementioned target parts, Includes, Obtaining an engineering model of the installation location of the aforementioned equipment includes obtaining an air conditioner model and a pipeline model from the BIM platform as the engineering model. Displaying the equipment model of the aforementioned target equipment is, Based on the ID of the air conditioner, a high-resolution virtual model of the air conditioner, which can be displayed in disassembled, oblique, and assembled state, is obtained from the server as the equipment model of the target equipment. The system is characterized by including automatically obtaining the equipment number and part number of the target equipment based on the high-resolution virtual model, and obtaining and displaying the corresponding equipment and part information table from the database. Methods for supporting equipment maintenance.

23. Means for obtaining the engineering model of the equipment's implementation location, A first display means creates and displays a simulation scene based on the engineering model, acquires at least one of the target equipment's component history maintenance information, operating information, and failure information, and assists a maintenance worker in identifying the target equipment in the simulation scene. A second display means that displays relevant information about the target equipment based on the simulation scene at the site where the target equipment is located, and assists the maintenance worker in performing maintenance on the target equipment, Includes, Obtaining an engineering model of the installation location of the aforementioned equipment includes obtaining an air conditioner model and a pipeline model from the BIM platform as the engineering model. Displaying relevant information about the target equipment based on the aforementioned simulation scene is: Based on the ID of the air conditioner, a high-resolution virtual model of the air conditioner, which can be displayed in disassembled, oblique, and assembled state, is obtained from the server as the equipment model of the target equipment. The system is characterized by including automatically obtaining the equipment number and part number of the target equipment based on the high-resolution virtual model, and obtaining and displaying the corresponding equipment and part information table from the database. Equipment maintenance support device.

24. It is characterized by being an augmented reality (AR) device, a virtual reality (VR) device, or a mixed reality (MR) device. A maintenance support device for the equipment described in claim 23.

Images